Glossary
What Is VLA-0?
Last reviewed: October 2026
Short answer
VLA-0 is a published vision-language-action design (arXiv 2510.13054, NVIDIA) that represents robot actions directly as text. A pretrained vision-language model is prompted to output actions as space-separated integers, with no new tokens, vocabulary changes or added layers. It is third-party research; Firsthand is not affiliated.
01
What is VLA-0?
VLA-0 is introduced in VLA-0: Building State-of-the-Art VLAs with Zero Modification (arXiv 2510.13054) by Ankit Goyal, Hugo Hadfield, Xuning Yang, Valts Blukis and Fabio Ramos of NVIDIA, with an official project page and GitHub repository (NVlabs/vla0). Read: the arXiv abstract page and full paper text, the project page and the GitHub README. Check the version you cite.
02
Where does Firsthand fit next to VLA-0?
VLA-0 is third-party research. Firsthand is not part of it or affiliated with its authors, and makes no claim that any model was trained on Firsthand data. Firsthand captures human egocentric video, not robot data. What the site states is custom collection of real human demonstrations, fast and on demand, to a written spec: 3D hand pose at 21 joints per hand, calibrated stereo depth and 6-DoF IMUs at 200 Hz, delivered in RLDS, LeRobot format or WebDataset with a buyer-owned commercial license. The only language data the site states is one task instruction per episode. Whether that fits a VLA-0 style prompt is Not stated.
03
What problem does VLA-0 address?
Per the abstract, the best way to build vision-language-action models remains an open question. Current approaches often add complexity, such as modifying a vision-language model’s vocabulary with action tokens or introducing special action heads.
The authors write that the simplest strategy, representing actions directly as text, has remained largely unexplored, and introduce VLA-0 to test it.
04
How does VLA-0 turn a vision-language model into a VLA?
Per the paper, VLA-0 keeps the model intact: it introduces no new tokens, alters no vocabulary and adds no layers. The input is a system prompt, one or more images and a task instruction, and the output is a sequence of space-separated integers.
Continuous action values are normalized to a fixed integer range, with 0 to 1000 given as an example, so resolution is set by that range rather than by the vocabulary. The authors build on a 3-billion-parameter Qwen-VL-2.5 model and say the method applies to any other vision-language model.
05
What recipe makes actions as text work?
The authors name three components: action decoding, ensemble prediction and masked action augmentation. At each step the model predicts several future actions, and the predictions available for the current step are averaged, a technique they credit to the Action-Chunking Transformer.
During training, characters in the target action string are randomly masked, so the model has to rely on the images and instruction rather than auto-completing numbers. Training is full fine-tuning with cross-entropy loss: 64 epochs, batch size 192, learning rate 5e-6, about 32 hours on 8 A100 GPUs, per the authors.
06
What did the authors report?
On LIBERO, the authors report a 94.7 average success rate, the best among models without large-scale robot-action pretraining. Against pretrained models they report an average rank of 2.8, behind OpenVLA-OFT at 1.5.
In the real world, on an SO-100 robot with LeRobot, four tasks and 100 demonstrations per task, they report VLA-0 outperforming SmolVLA by 12.5 points, at 4 Hz inference on a desktop with a 5090 GPU. These are the authors’ results. Firsthand does not reproduce them and ranks no models.
07
Which design choices mattered in the ablations?
On LIBERO, removing ensembling lowered the average success rate by 2.0 points and removing masked action augmentation by 1.2. An action resolution of 250 lowered it by 1.5, while 4000 gave no further gain over 1000. Tiling images into one composite versus feeding them separately made no discernible difference.
08
How is VLA-0 different from OpenVLA, FAST and VLA-Adapter?
The paper groups OpenVLA with discrete-token VLAs, which map action bins to vocabulary tokens, and π-FAST with custom designs. The site’s FAST entry describes a discrete cosine transform, quantization and byte-pair encoding that turn action chunks into tokens. VLA-0 instead writes the numbers out as text.
The site’s VLA-Adapter entry covers a lightweight Policy module with Bridge Attention. How VLA-0 relates to it is Not stated in the sources read.
09
What limits and licences are stated, and how does language enter?
The authors list two open areas: how VLA-0 performs when trained with large-scale action data, and faster inference through quantization and distillation. Their example instruction is “put the banana on the plate”. On the site, the only language data is one task instruction per episode.
The GitHub README states that the code and the LIBERO model are released under CC BY-NC 4.0 and that the base model is subject to the Qwen Research License. Check both before any use.
10
When do you need custom egocentric data collection instead?
When a program needs real human egocentric demonstrations that public data does not cover, specified in writing. Firsthand does not build or train models. Confirm the spec on a Spec Pilot, a small fast first batch; the median from signed spec to first validated batch is 48 hours where coverage is deep, three to four weeks where thin. Billing is per validated hour.
11
VLA-0 at a glance, as stated in the paper and README
| Item | What the sources state |
|---|---|
| Paper | VLA-0: Building State-of-the-Art VLAs with Zero Modification (arXiv 2510.13054) |
| Authors | Ankit Goyal, Hugo Hadfield, Xuning Yang, Valts Blukis, Fabio Ramos (NVIDIA) |
| Core idea | Prompt a vision-language model to output actions as text |
| Output format | Space-separated integers; the paper’s example range is 0 to 1000 |
| Base model | 3-billion-parameter Qwen-VL-2.5 (the README writes Qwen2.5-VL-3B) |
| Recipe | Action decoding, ensemble prediction, masked action augmentation |
| Training | Full fine-tuning, cross-entropy loss; 64 epochs, batch size 192, learning rate 5e-6 |
| Code licence | CC BY-NC 4.0 for the code and LIBERO model; base model under the Qwen Research License (README) |
| Firsthand relationship | None |
13
LIBERO success rates reported by the authors for VLA-0 (Table I of the paper, in %)
| Suite | VLA-0 success rate |
|---|---|
| Spatial | 97.0 |
| Object | 97.8 |
| Goal | 96.2 |
| Long | 87.6 |
| Average | 94.7 |
14
VLA-0 next to related terms on this site
| Term | Per the site or the paper | Relation to VLA-0 (per the sources read) |
|---|---|---|
| OpenVLA | Open-source VLA; the paper classes it as a discrete-token VLA | Compared as a baseline in the paper |
| FAST action tokenizer | Discrete cosine transform plus byte-pair encoding turns action chunks into tokens | The paper classes π-FAST as a custom-tokenizer VLA; VLA-0 writes actions as plain text |
| VLA-Adapter | Lightweight Policy module with Bridge Attention for tiny-scale VLAs | Not stated in the sources read |
| Vision-language-action model | Maps a visual scene and a language instruction to an action | VLA-0 is one design for this mapping |
15
VLA-0 versus custom egocentric capture
| Aspect | VLA-0 (per the sources read) | Custom egocentric capture (per the site) |
|---|---|---|
| What it is | A model design, a recipe and published results | A dataset delivered to a written spec |
| Source of data | Robot demonstrations, for example 100 per real-world task | Real human demonstrations, not robot data |
| Language data | A task instruction in the prompt | One task instruction per episode |
| Inputs | One or more camera images | Egocentric video with stereo depth and hand pose |
| Hand data | Not stated in the sources read | 3D hand pose at 21 joints per hand |
| Delivery | LeRobot datasets supported in the README | RLDS, LeRobot format or WebDataset, buyer-owned commercial license |
16
Frequently asked questions
- What is VLA-0?
- A published vision-language-action design (arXiv 2510.13054) from NVIDIA authors in which a pretrained vision-language model is prompted to output robot actions as text. It is third-party research.
- What does zero modification mean?
- Per the paper, VLA-0 introduces no new tokens, alters no vocabulary and adds no new layers to the vision-language model. Actions are written as space-separated integers using the model’s native text generation.
- What did the authors report on LIBERO?
- A 94.7 average success rate, the best among models without large-scale robot-action pretraining, and an average rank of 2.8 against pretrained models. These are the authors’ figures.
- Is the VLA-0 code available?
- Yes. The authors link an official GitHub repository (NVlabs/vla0) and project page. The README states CC BY-NC 4.0 for the code and LIBERO model, with the base model under the Qwen Research License.
- Does Firsthand data train VLA-0?
- No claim is made. Firsthand is not affiliated with its authors, captures human egocentric video rather than robot data, and does not state that any model was trained on Firsthand data. The only language data the site states is one task instruction per episode.
Related terms