The latest research from Google
Aug 25, 2026
AgentHands: Generating interactive hand gestures for spatially grounded agent conversations in XR · The latest research from Google
Science, Technology & Innovation · Aug 25, 2026
AgentHands turns LLM responses into synchronized, spatially grounded hand gestures by linking inline gesture events to gaze-registered 3D objects, word-level speech timing, and an on-device XR animation engine. Its design shows that embodied agents need structured gesture tokens, spatial references, and local timing control—not just better prompts.
AgentHands: Generating interactive hand gestures for spatially grounded agent conversations in XR · The latest research from Google
Science, Technology & Innovation · Aug 25, 2026
AgentHands improves XR safety communication by combining pointing, action-depicting and emotional gestures with visual effects—such as a burn glow on a 3D printer’s hot nozzle—making hazards more noticeable and reducing cognitive burden through contextual, partner-like guidance.
AgentHands: Generating interactive hand gestures for spatially grounded agent conversations in XR · The latest research from Google
Science, Technology & Innovation · Aug 25, 2026
In a study of 12 participants performing orchid-care and 3D-printer tasks, synchronized agent hand gestures significantly improved object identification, directional understanding, and action following compared with identical speech-only instructions (p < 0.05). Gestures clarify references through temporal-spatial alignment and convey action meaning, supporting their use in XR maintenance, training, and care workflows.