Back to feed

AgentHands: Generating interactive hand gestures for spatially grounded agent conversations in XR

The latest research from Google

Aug 25, 2026

8/25/2026

AgentHands Integrates LLM Output With Synchronized Spatial Hand Gestures and Object References

AgentHands: Generating interactive hand gestures for spatially grounded agent conversations in XR · The latest research from Google

Science, Technology & Innovation · Aug 25, 2026

AgentHands turns LLM responses into synchronized, spatially grounded hand gestures by linking inline gesture events to gaze-registered 3D objects, word-level speech timing, and an on-device XR animation engine. Its design shows that embodied agents need structured gesture tokens, spatial references, and local timing control—not just better prompts.


8/25/2026

XR Gestures And Visual Effects Bind Risk Cues To Actions In Context To Improve Safety Communication

AgentHands: Generating interactive hand gestures for spatially grounded agent conversations in XR · The latest research from Google

Science, Technology & Innovation · Aug 25, 2026

AgentHands improves XR safety communication by combining pointing, action-depicting and emotional gestures with visual effects—such as a burn glow on a 3D printer’s hot nozzle—making hazards more noticeable and reducing cognitive burden through contextual, partner-like guidance.


8/25/2026

Embodied Gesture Improves Object Localization and Action Understanding in XR Guidance Compared to Speech Alone

AgentHands: Generating interactive hand gestures for spatially grounded agent conversations in XR · The latest research from Google

Science, Technology & Innovation · Aug 25, 2026

In a study of 12 participants performing orchid-care and 3D-printer tasks, synchronized agent hand gestures significantly improved object identification, directional understanding, and action following compared with identical speech-only instructions (p < 0.05). Gestures clarify references through temporal-spatial alignment and convey action meaning, supporting their use in XR maintenance, training, and care workflows.