Answer Phone
Multi-stage progress tracking with ring detection, speech understanding and end-of-call recognition under severe visual aliasing. The robot revisits nearly identical visual states at different semantic stages of the task.
Why this task
The robot revisits nearly identical visual states at different semantic stages of the task.
What it tests
Multi-stage progress tracking with ring detection, speech understanding and end-of-call recognition under severe visual aliasing.
Context
Part of the real-robot evaluation of the HEAR framework, in which the primary metric is the sound-causal success rate: a trial counts as successful only if the robot completes the physical goal after the relevant acoustic condition has occurred. Reaching the goal early is recorded as a failure. All tasks were run on a Franka Panda with a single ambient workspace microphone and two RGB views.