# Answer Phone

> Multi-stage progress tracking with ring detection, speech understanding and end-of-call recognition under severe visual aliasing. The robot revisits nearly identical visual states at different semantic stages of the task.

Source: https://hear.irmv.top/videos/answer-phone/ · Language: en

## Why this task

The robot revisits nearly identical visual states at different semantic stages of the task.

## What it tests

Multi-stage progress tracking with ring detection, speech understanding and end-of-call recognition under severe visual aliasing.

## Context

Part of the real-robot evaluation of the HEAR framework, in which the primary metric is the sound-causal success rate: a trial counts as successful only if the robot completes the physical goal after the relevant acoustic condition has occurred. Reaching the goal early is recorded as a failure. All tasks were run on a Franka Panda with a single ambient workspace microphone and two RGB views.

---

Chang Nie, Tianchen Deng, Guangming Wang, Zhe Liu and Hesheng Wang, “Towards the Vision-Sound-Language-Action Paradigm: The HEAR Framework for Sound-Centric Manipulation”, The International Journal of Robotics Research, 2026. arXiv:2603.16086.