---
url: /foundations/xr/design/interaction.md
description: Resources and guidance for immersive extended reality (XR) devices
---

# Design for immersive XR

Resources and guidance for immersive extended reality (XR) devices

[Overview](overview.md) · **Interaction** · [Layout](layout.md) · [Accessibility](accessibility.md)

XR interactions should be flexible, comfortable, and intuitive. People expect to interact with digital objects just like they do with physical ones.

<video controls src="https://firebasestorage.googleapis.com/v0/b/design-spec/o/projects%2Fgoogle-material-3%2Fimages%2Fmowkhgek-content-maps.mp4?alt=media" aria-label="XR Google Maps switches from a floating 2D map to a 3D aerial city view, followed by a hand-gesture navigated restaurant tour."></video>

A person should be able to switch between hands, eyes, voice, or controllers depending on their posture and preference

## Natural interactions

Natural interactions like gestures allow people to navigate, select, and move content using their hands. Gestures should be:

* Easy to learn
* Follow familiar patterns, such as press, pinch, and swipe on mobile
* Comfortable to use repeatedly


Support one-handed interactions for essential actions. Don’t require large, repetitive arm movements, as they can cause fatigue.


[More on Android XR gestures](https://developer.android.com/design/ui/xr/guides/foundations#understanding-system)

<video controls src="https://firebasestorage.googleapis.com/v0/b/design-spec/o/projects%2Fgoogle-material-3%2Fimages%2Fmowkzvav-xr-interaction-02.mp4?alt=media" aria-label="A person uses their hand to hover on and switch between 3 spatial panels."></video>

A person can select items by pinching with the index finger and thumb

### System navigation

People should be able to open a navigation menu anywhere, anytime.



On Android XR, the system-level navigation menu includes:

* Go back: Operates the same as the [back gesture](https://developer.android.com/guide/components/activities/tasks-and-back-stack) on Android phones
* Launcher: Goes to the home screen
* Recents: People can open, close, and switch apps

<video controls src="https://firebasestorage.googleapis.com/v0/b/design-spec/o/projects%2Fgoogle-material-3%2Fimages%2Fmowwbqda-xr-interaction-03.mp4?alt=media" aria-label="An animated hand moves its palm up, and pinches the index finger and thumb to open the navigation menu."></video>

A navigation menu should always be available using a simple gesture, so people don’t get lost

## Multimodal inputs

XR apps should support flexible, multimodal inputs, such as hand and eye tracking, voice, keyboard and mouse, and controllers.



[More on Android XR multimodal inputs](https://developer.android.com/design/ui/xr/guides/foundations#design-multimodal)

### Hand & eye tracking

Tracking allows people to interact with the virtual world without a controller.


Hand tracking

* Direct: People can touch, grab, or push virtual objects in arm's reach
* Ray-based: A ray, like a laser pointer, extends from the hand to target distant items, then a pinch selects it

Eye tracking

* Enables gaze and dwell interactions
* Looking at an object triggers a hover state

<video controls src="https://firebasestorage.googleapis.com/v0/b/design-spec/o/projects%2Fgoogle-material-3%2Fimages%2Fmowojjby-Spatialize_3D-Content_5%20(2).mp4?alt=media" aria-label="A person uses ray-based hand tracking to move a 3D globe from a table to a credenza. When selected, a highlighted box appears under the globe."></video>

Distant elements can be moved using hand and eye tracking

### Voice, keyboard, mouse, & controller inputs

XR apps should also support voice and physical inputs including:

* Voice for hands-free text entry on virtual keyboards
* Voice commands for common actions like **Open Settings** or **Go back**
* Mouse & keyboard inputs for precision and text-heavy workflows
* Six degrees of freedom (6DoF) controllers for gaming or complex 3D manipulation

## Motion

In XR, motion sickness can happen when visual cues disconnect from the inner ear's sense of balance.

To keep people comfortable:

* Use [standard easing](../../../styles/motion/easing-and-duration/tokens-specs.md#601d5552-a6e6-4d74-9886-ff8f24b9ec35) and [long duration](../../../styles/motion/easing-and-duration/tokens-specs.md#48bf653e-46f9-48f5-87e0-eaf8ea3fe716) motion tokens
* Maintain a stable horizon line
* Limit continuous motion. To switch locations, use teleportation or instant jump instead.
* Use tunnel vision or vignetting to reduce the field of view while in motion

::: warning Caution
<video controls src="https://firebasestorage.googleapis.com/v0/b/design-spec/o/projects%2Fgoogle-material-3%2Fimages%2Fmowqbjui-xr-accessibility-01.mp4?alt=media" aria-label="A person walking in a spatial environment, with a steady visual horizon."></video>

Limit use of continuous motion. If required, keep the horizon line stable.
:::

## Feedback

Since virtual objects lack physical resistance, use visual, audio, and sensory feedback to confirm interactions.

### Visual cues

Use hover icons, focus indicators, ripples, text labels, and elevation changes to show an object’s interaction [state](../../interaction/states/overview.md "States show the interaction status of a component or UI element.").



To indicate an item is targeted, use [spatial elevation](https://developer.android.com/design/ui/xr/guides/spatial-ui#spatial-elevation) or a highlight state.

<video controls src="https://firebasestorage.googleapis.com/v0/b/design-spec/o/projects%2Fgoogle-material-3%2Fimages%2Fmowqhvfh-Spatialize_3D-Content_3%20(1).mp4?alt=media" aria-label="When a person uses hand tracking to target a 3D model, a focus indicator appears."></video>

Use visual clues to show when a spatial element is hovered, focused, or selected

### Spatial audio

Sound emitters can be positioned in 3D space and provide audio confirmation of an action. For example, add a **click** sound when a button is pressed.

<video controls src="https://firebasestorage.googleapis.com/v0/b/design-spec/o/projects%2Fgoogle-material-3%2Fimages%2Fmowqk798-spatial%20audio.mp4?alt=media" aria-label="As sound emits from 1 of 4 spheres, a person looks toward the active sphere."></video>

Spatial audio can help signify where a person should look or that an action was taken

### Haptics

For controllers, allow people to turn vibration on or off to simulate the feel of touching or grabbing an object.