Glossary

What Is π0.5 (pi0.5)?

π0.5 is a published vision-language-action model built on π0 for open-world generalization. Firsthand is not part of it and makes no claim about it.

Last reviewed: October 2026

Short answer

π0.5 (pi0.5) is a vision-language-action model from Physical Intelligence, built on π0 and co-trained on heterogeneous data: multiple robots, high-level subtask prediction, web data and verbal instructions. The authors use it to control mobile manipulators cleaning kitchens and bedrooms in homes not seen in training. Firsthand is not part of it.

01

What is π0.5?

π0.5 is introduced in the paper π0.5: a Vision-Language-Action Model with Open-World Generalization (arXiv 2504.16054) and an official blog post, both from Physical Intelligence. The authors state that, to their knowledge, it is the first end-to-end learning-enabled robotic system shown performing long-horizon, dexterous skills such as cleaning a kitchen or bedroom in entirely new homes. The blog adds that the goal is not new skills or high dexterity, but generalizing to new settings.

02

Where does Firsthand fit next to π0.5?

π0.5 is third-party research. Firsthand is not part of it, endorsed by it or affiliated with Physical Intelligence or its authors, and makes no claim that π0.5 uses Firsthand data or that any model was trained on Firsthand data. Egocentric human video is not described in the π0.5 training mix in the sources read. What Firsthand states is custom egocentric collection for VLA-style training, to a written spec, fast and on demand.

03

How does π0.5 differ from π0?

The paper names two differences in its comparison. π0.5 additionally uses high-level subtask data and web data, and it trains in a hybrid way: discrete tokens in pre-training, then a flow matching action expert only in post-training. π0 always uses the action expert.

At run time one model first predicts a high-level subtask as text, such as “pick up the pillow”, then the low-level action chunk. The blog describes the chunk as 50 steps, or 1 second. The authors report that π0.5 significantly outperforms π0 in their mock homes. That is their result on their own robots, and Firsthand draws no comparison from it.

04

How is π0.5 trained?

In two stages. Pre-training mixes all sources with actions as discrete tokens, for 280k gradient steps. Post-training specializes the model for mobile manipulation and adds the flow matching action expert, for 80k more steps.

The mixture has five slices: mobile manipulator data (about 400 hours in about 100 homes), non-mobile robot data, cross-embodiment laboratory data including the open-source OXE dataset, manually annotated high-level subtask data, and multimodal web data. Post-training adds verbal instruction demonstrations. The paper states that 97.6% of first-phase examples came from sources other than mobile manipulators doing household tasks.

05

What does open-world generalization mean for robot data?

In the paper, it means working in environments that were not in the training data. All experiments used novel environments: mock homes for comparisons and three real homes for the final evaluation. The authors say brute-force scaling of robot data collection is infeasible for long-horizon tasks like cleaning a kitchen.

Their scaling study varied training environments from 3 to 104 locations. Performance generally improved with more locations, and the 104-location model reached similar performance to a control trained on the test homes. Removing other-robot data degraded results significantly, and removing web data hurt performance on unseen object categories.

06

What does π0.5 mean for robot training data?

The recipe argues against relying on one source: embodiment-matched home data was a small share of examples, and the other sources carried most of the mixture. The authors also state that π0.5 still makes mistakes and processes relatively simple prompts, and that other data sources could be explored more broadly.

This page draws no further conclusion. How much custom data a π0.5 fine-tune needs, and whether egocentric human video helps π0.5, are Not stated in the sources read.

07

When do you need custom egocentric data collection?

When a VLA-style program needs skills and environments its mixture does not cover, specified in writing. Firsthand does not build or train models, and makes no claim that egocentric video replaces robot data or any π0.5 slice.

Confirm the spec on a Spec Pilot, a small fast first batch. Where coverage is deep, the median from signed spec to first validated batch is 48 hours; where it is thin, three to four weeks. Billing is per validated hour.

08

π0.5 at a glance, as stated in the official sources

π0.5 at a glance, as stated in the official sources
ItemWhat the official sources state
Paperπ0.5: a Vision-Language-Action Model with Open-World Generalization (arXiv 2504.16054)
CategoryVision-language-action model based on π0, co-trained on heterogeneous tasks
BackbonePaliGemma vision-language model of about 2B parameters, plus a 300M action expert
Training stagesPre-training with discrete tokens (280k steps), then post-training with a flow matching action expert (80k steps)
Action chunk50 steps, or 1 second, per the blog
Mobile manipulation dataAbout 400 hours in about 100 home environments
Code and weightsopenpi repository with a π0.5 base checkpoint; repository licence Apache 2.0; checkpoint licence Not stated in the sources read
Egocentric human video in trainingNot described in the sources read
Firsthand relationshipNone

10

Training data sources π0.5 describes, and what custom egocentric capture states

Training data sources π0.5 describes, and what custom egocentric capture states
Source in the π0.5 mixtureWhat the official sources stateCustom egocentric capture (per the site)
Mobile manipulator dataAbout 400 hours in about 100 homesEgocentric capture to a written spec; mapping to any robot embodiment Not stated
Non-mobile robot dataSingle-arm and two-arm data from many homesNot stated
Cross-embodiment lab dataLaboratory tasks across robot types, plus OXENot stated
High-level subtask dataManually annotated subtask labels and bounding boxesAction-segment labels; bounding boxes Not stated
Multimodal web dataCaptioning, question answering, object localizationNot a Firsthand deliverable
Verbal instructionsExpert users commanding the robot with language, in post-trainingA task instruction paired to the episode; verbal-instruction demonstrations Not stated

11

Frequently asked questions

What is π0.5?
A vision-language-action model from Physical Intelligence, built on π0 and co-trained on multi-robot data, subtask prediction, web data and verbal instructions to generalize to homes not seen in training.
How is π0.5 different from π0?
π0.5 adds high-level subtask and web data, predicts a subtask before each action chunk, and trains with discrete tokens first, then a flow matching action expert. π0 always uses the action expert.
What does open-world generalization mean?
In the paper, performing tasks in environments that were not in the training data. The authors evaluate π0.5 in new kitchens and bedrooms, including three real homes.
Was π0.5 trained on egocentric human video?
Egocentric human video is not described as part of the π0.5 training mix in the sources read.
Is π0.5 open source?
The official openpi repository provides a π0.5 base checkpoint and fine-tuning examples, and lists the Apache License 2.0. The checkpoint licence is Not stated in the sources read.
Is Firsthand data part of π0.5?
No. Firsthand is not part of it or affiliated with Physical Intelligence or its authors, and makes no claim that π0.5 uses Firsthand data or that any model was trained on it.