Glossary
What Is a Visuomotor Policy?
Last reviewed: October 2026
Short answer
A visuomotor policy is a robot policy that turns camera images, usually with the robot’s own state, into actions. It is learned from demonstrations pairing what the robot saw with what was done, and the term names the role, not one architecture.
01
What is a visuomotor policy?
A visuomotor policy is the part of a robot that connects seeing to moving. The Diffusion Policy paper introduces its method as “a new way of generating robot behavior by representing a robot’s visuomotor policy as a conditional denoising diffusion process.”
02
What does Firsthand capture for visuomotor training data?
Firsthand does not train, ship or benchmark visuomotor policies or models. The site states that it captures egocentric video from a head camera and two wrist cameras, depth recovered from the calibrated stereo rig, IMU, 3D hand pose, wrist trajectories, action segments, contact events and a task instruction per episode. Delivery is in RLDS, LeRobot, WebDataset or HDF5. Robot joint or gripper commands, a policy-ready export and policy results are Not stated.
03
What inputs and outputs does a visuomotor policy use?
In the Diffusion Policy paper, the policy takes the latest few steps of observation data as input and predicts a run of future actions, some of which are executed before it replans. A visual encoder maps the raw image sequence into a latent embedding.
The paper’s bimanual setup uses scene and wrist cameras plus proprioception, with desired end-effector poses and gripper widths as actions. GR00T N1 (arXiv 2503.14734) describes its model input as robot state, visual observations and a language instruction, and its output as the corresponding motor action.
04
How is a visuomotor policy different from a VLA model or behavioral cloning?
A vision-language-action (VLA) model also maps images to actions, and adds a language instruction as input. GR00T N1 describes itself as a VLA model that “generates actions from image and language instruction input.” Whether a VLA model counts as a visuomotor policy is a naming choice the cited papers do not settle.
Behavioral cloning describes how a policy is trained, by copying demonstrations, not what the policy is. Diffusion Policy evaluates its policies “under the behavior cloning formulation,” so a visuomotor policy is often trained by behavioral cloning. The second table lays out the three terms.
05
Can visuomotor policies learn from egocentric human video?
The cited work says yes with caveats. EgoScale (arXiv 2602.16710) trains a VLA model on over 20,854 hours of action-labeled egocentric human video. Camera motion and hand pose are estimated from head-mounted egocentric RGB by off-the-shelf pipelines. The authors conclude that large-scale human motion provides “a reusable, embodiment-agnostic motor prior.”
GR00T N1 notes that its human video datasets carry no explicit action labels, so it learns latent actions to stand in for them.
06
What data does a visuomotor policy need?
Observations paired with actions, in order, on one timeline. Diffusion Policy notes that it inherits a limit of behavior cloning: suboptimal performance with inadequate demonstration data.
Human video has no robot actions in it, so a team derives a target from hand pose or wrist motion, as EgoScale does, or learns latent actions, as GR00T N1 does. A buyer builds the training targets and trains the policy in their own pipeline.
07
How do you request fast, on-demand custom collection for visuomotor training?
Request a custom dataset and write the tasks, environments, streams, labels and delivery format into the spec. The site states a median of 48 hours from a signed spec to a first validated batch where coverage is already deep, and three to four weeks in thin environments, and billing is per validated hour. If your policy consumes depth, a language instruction or a particular action target, say so in the spec.
08
Policy inputs and outputs the cited papers describe, and what Firsthand’s stated deliverables provide
| Policy input or output | What the cited papers describe | Firsthand stated deliverable | Status |
|---|---|---|---|
| Camera images | Image observations from scene and wrist cameras, encoded into a latent embedding (arXiv 2303.04137) | Head camera and two wrist cameras | Stated |
| Depth | Not stated in the passages cited | Depth recovered from the calibrated stereo rig, delivered as a metric depth_mm stream | Stated; use by a policy Not stated |
| Robot state | End-effector poses and gripper widths; robot state as a GR00T N1 input | IMU is stated; robot joint or gripper state is not a stated field | Robot state Not stated |
| Language instruction | An input to GR00T N1 (arXiv 2503.14734) | A task instruction paired to each episode | Stated |
| Action target | A run of future actions: end-effector poses and gripper widths | 3D hand pose, wrist trajectories, action segments and contact events | Robot commands Not stated |
10
Visuomotor policy, VLA model and behavioral cloning, using facts from the linked sources
| Term | What it is | Inputs per the cited papers | Source |
|---|---|---|---|
| Visuomotor policy | A policy that maps visual observations to actions | Recent observation steps, with image and proprioceptive data, to a run of actions | arXiv 2303.04137 |
| VLA model | GR00T N1 “generates actions from image and language instruction input” | Robot state, visual observations and a language instruction, to motor action | arXiv 2503.14734 |
| Behavioral cloning | A training formulation that copies demonstrations, not a model class | Demonstration observation and action pairs | arXiv 2303.04137 |
11
Frequently asked questions
- What is a visuomotor policy?
- A robot policy that maps camera images, usually with the robot’s own state, to actions, learned from demonstrations that pair what the robot saw with what was done.
- Is a visuomotor policy the same as a diffusion policy?
- No. Diffusion Policy represents a visuomotor policy as a diffusion process, so diffusion is one way to build one.
- How is a visuomotor policy different from a VLA model?
- A VLA model adds a language instruction to the image input.
- Can a visuomotor policy learn from human video?
- In the cited work, EgoScale trains on over 20,854 hours of action-labeled egocentric human video, and GR00T N1 learns latent actions for human video that has no action labels.
- Does Firsthand train or ship visuomotor policies?
- No. The site states no trained, shipped or benchmarked policy or model. Firsthand captures the data, and the buyer trains the policy.
- How do I get custom visuomotor training data fast?
- Request a custom dataset with the streams, labels and format written into the spec. The site states a median of 48 hours to a first validated batch where coverage is deep, and three to four weeks in thin environments.
Related terms