Now recruiting capture teams worldwide. Get paid to record first-person video of real work.

Apply to capture

Glossary

What Is EgoBridge (Domain Adaptation for Imitation from Egocentric Human Data)?

EgoBridge is a published co-training framework that aligns human and robot policy latent spaces with optimal transport. Firsthand is not affiliated.

Last reviewed: November 2026

Short answer

EgoBridge is the method in “EgoBridge: Domain Adaptation for Generalizable Imitation from Egocentric Human Data” (arXiv 2509.19626, Georgia Institute of Technology). It is a co-training framework that uses domain adaptation to align the policy latent spaces of human and robot data, so a robot policy can learn from egocentric human demonstrations. Third-party; Firsthand is not affiliated.

01

What is EgoBridge, and what problem does it address?

EgoBridge is named in EgoBridge: Domain Adaptation for Generalizable Imitation from Egocentric Human Data (arXiv 2509.19626) by Ryan Punamiya, Dhruv Patel, Patcharapong Aphiwetsa, Pranav Kuppili, Lawrence Y. Zhu, Simar Kareer, Judy Hoffman and Danfei Xu of the Georgia Institute of Technology; the arXiv listing notes acceptance at NeurIPS 2025 and an oral at CoRL 2025. The authors describe egocentric human experience data as a vast resource for end-to-end imitation learning, but say domain gaps in visual appearance, sensor modalities and kinematics between human and robot impede transfer. They also note that simply co-training on cross-domain data does not automatically yield effective knowledge transfer. Their answer is to treat human-robot learning as a domain adaptation problem.

02

Where does Firsthand fit next to EgoBridge?

Firsthand is not affiliated with the EgoBridge authors. No named model, EgoBridge included, was trained on Firsthand data, and Firsthand does not claim to use any hardware or software named in the paper: it names Project Aria glasses, a bimanual robot built from two ViperX 300 arms with RealSense D405 wrist cameras, and a leader-follower teleoperation rig. Firsthand captures real human egocentric video, custom collection, fast and on demand, to a written spec, with depth derived from a calibrated stereo rig, 3D hand pose at 21 joints per hand and 6-DoF IMUs at 200 Hz, delivered in RLDS, LeRobot format or WebDataset under a buyer-owned commercial license, with one task instruction per episode. Robot trajectories, retargeted actions, action labels, domain-adaptation alignments, optimal-transport or shared latent-space features, co-training mixtures, pretrained representations, embeddings, simulation environments and other language annotations are not Firsthand deliverables.

03

How does EgoBridge align human and robot data?

Per the paper, EgoBridge trains one shared encoder and one policy on both human and robot data. A behavior-cloning loss is applied across both datasets, and an Optimal Transport (OT) loss, computed with the differentiable Sinkhorn formulation, is added on the encoder’s latent features. The OT loss aligns the joint distribution of latent features and actions, not only the latent features, which the authors say preserves the action-relevant information a policy needs.

To decide which human and robot samples should be matched, the authors use Dynamic Time Warping (DTW) over action trajectories. In each mini-batch, DTW finds the most behaviorally similar human sample for each robot sample, and those pseudo-pairs get a discounted OT cost. The authors say this accounts for humans and robots doing the same task at different speeds.

04

What data does EgoBridge use, and what does it need from the human side?

The paper uses two sources: egocentric human demonstrations, with observations from wearable sensors such as head-mounted cameras, and teleoperated robot demonstrations. Both carry actions in a common action space, described as robot end-effector and human hand poses. Human actions are built from hand tracking relative to the egocentric camera, following EgoMimic. The authors use Project Aria glasses for the human data and for the robot’s egocentric camera.

EgoBridge needs actions on the human side to build its DTW pseudo-pairs. Firsthand states 3D hand pose at 21 joints per hand; turning that into the action space of a particular robot is the buyer’s own step, and action labels are not a Firsthand deliverable.

05

What did the authors report, and what are the limits?

The authors report an absolute policy success rate improvement of up to 44% over human-augmented cross-embodiment baselines in three real-world tasks: Scoop Coffee, Drawer and Laundry. In the Drawer task, robot data covers three of four drawer quadrants and one hour of human data covers all four; the authors report 33% success on the quadrant seen only in human data, where most baselines fail entirely. In Scoop Coffee they report 27% on a new target in a new scene. In an ablation they report that replacing the DTW pairing with a simple MSE cost lowered Drawer success from 47% to 17%. These are the authors’ figures; Firsthand has not verified them.

The authors name limits: the DTW cost may be less informative in multi-task settings, and they list natural-language embedding distances, multiple embodiments and internet human data without action labels as future work.

06

How does EgoBridge compare with related entries on this site?

EgoBridge follows EgoMimic’s data setup and compares against it, so the clearest difference is the alignment step: an explicit OT loss on joint latent features and actions, guided by DTW pairing, instead of masking and a shared pose head.

07

What would an EgoBridge-style approach need from custom collection?

Per the sources read, it needs egocentric human demonstrations with hand-derived actions, plus a smaller robot dataset of the same tasks. The authors collected their own data, and no dataset licence is stated, so a licence is Not stated in the sources read. That is a note about format, not a compatibility claim: the action construction, alignment and training are the buyer’s own.

No off-the-shelf dataset for this is stated here, so this is custom collection: request on-demand collection and confirm it on a Spec Pilot, with a median of 48 hours to a first validated batch where coverage is deep and three to four weeks where it is thin.

08

EgoBridge at a glance, as stated in the paper and project page

EgoBridge at a glance, as stated in the paper and project page
ItemWhat the sources state
PaperEgoBridge: Domain Adaptation for Generalizable Imitation from Egocentric Human Data (arXiv 2509.19626)
AuthorsRyan Punamiya, Dhruv Patel, Patcharapong Aphiwetsa, Pranav Kuppili, Lawrence Y. Zhu, Simar Kareer, Judy Hoffman, Danfei Xu
InstitutionGeorgia Institute of Technology
VenueNeurIPS 2025 and CoRL 2025 oral, per the arXiv listing
Core ideaCo-training with Optimal Transport domain adaptation on joint latent features and actions
Pairing signalDynamic Time Warping over action trajectories
Human capture deviceProject Aria glasses, as named in the paper
Robot namedBimanual platform of two ViperX 300 arms with RealSense D405 wrist cameras
Dataset licenceNot stated in the sources read
Firsthand relationshipNone

10

EgoBridge components, as stated in the paper and project page

EgoBridge components, as stated in the paper and project page
ComponentWhat the sources state
EncoderShared across human and robot; a shared vision stem handles the main egocentric images of both
PolicyShared transformer decoder that maps latent features to actions
Training lossBehavior-cloning co-training loss plus a weighted joint OT loss
OT formulationDifferentiable Sinkhorn OT over joint latent-feature and action distributions
Cost shapingDTW finds behaviorally similar human samples; those pairs get a discounted cost
Human actionsHand poses expressed in the egocentric camera frame
Real-world tasksScoop Coffee, Drawer, Laundry

11

EgoBridge beside related entries on the site

EgoBridge beside related entries on the site
Site entryWhat the entry statesHow EgoBridge differs (sources read)
EgoMimicCo-trains robot policies on egocentric human video with 3D hand tracking and on robot dataEgoBridge builds on that setup and compares against it, adding an OT alignment loss
MimicPlayLearns latent plans from human play video to guide a robot controller trained on few demosThe paper uses it as a baseline that aligns marginals with a KL divergence; EgoBridge aligns joint latent-action distributions
Embodiment gapThe mismatch between a human body and a robot’s hardware that keeps human demonstration data from transferring directlyEgoBridge addresses appearance, sensor and kinematic gaps in latent space
Cross-embodiment learningTraining one policy on data from multiple embodiments, including human demonstrationsEgoBridge is one human-robot case, framed as domain adaptation
Co-trainingTraining one policy on multiple data sources at onceThe paper’s Co-train baseline is the same recipe without the alignment loss

12

What EgoBridge consumes beside what the Firsthand site states

What EgoBridge consumes beside what the Firsthand site states
AspectEgoBridge (sources read)What the Firsthand site states
Human videoEgocentric RGB from Project Aria glassesEgocentric capture, custom collection to a written spec
DepthNot a stated input for the human sideDepth derived from a calibrated stereo rig
Hand signalsHand tracking converted into actions in the egocentric frame3D hand pose at 21 joints per hand
LanguageNot described as a training inputOne task instruction per episode
Robot-side dataTeleoperated demonstrations from the authors’ own robotRobot trajectories, retargeted actions and action labels are not Firsthand deliverables
AlignmentOT loss with DTW pseudo-pairs, learned in trainingDomain-adaptation alignments and shared latent features are not Firsthand deliverables

13

Frequently asked questions

What is EgoBridge?
Per the paper (arXiv 2509.19626), EgoBridge is a unified co-training framework that aligns the policy latent spaces of human and robot data using domain adaptation based on Optimal Transport. It is third-party research.
Why does EgoBridge use Optimal Transport and Dynamic Time Warping?
The authors use OT to align joint latent features and actions, and DTW over action trajectories to find behaviorally similar human and robot samples, which handles the two doing a task at different speeds.
What did the authors report for EgoBridge?
They report up to a 44% absolute success rate improvement over human-augmented cross-embodiment baselines in three real-world tasks, and transfer to objects, scenes and motions seen only in human data. Firsthand has not verified these figures.
How is EgoBridge different from EgoMimic?
The paper follows EgoMimic’s human data setup and uses it as a baseline. EgoBridge adds an explicit alignment loss on joint latent features and actions, where EgoMimic uses visual masking and a shared pose head.
Was EgoBridge trained on Firsthand data?
No. Firsthand is not affiliated with the authors and no named model was trained on Firsthand data. Robot trajectories, action labels, alignments and latent features are not Firsthand deliverables.
Does Firsthand use Project Aria glasses or the EgoBridge robot?
No claim is made. The paper names Project Aria glasses and a bimanual ViperX 300 robot as its hardware; Firsthand does not state that it uses either.
How can I request a custom egocentric dataset for human-to-robot learning?
Request a custom dataset with your objects, interactions and signals. Collection is fast and on demand, with a first validated batch in a median of 48 hours where coverage is deep.