Glossary
What Is VLA-Adapter?
Last reviewed: October 2026
Short answer
VLA-Adapter is a published paradigm for tiny-scale vision-language-action models, introduced in arXiv 2509.09372. It adds a lightweight Policy module with Bridge Attention that injects vision-language conditions into the action space, so it can use a 0.5B-parameter backbone without robotic data pre-training. It is third-party research, not Firsthand’s.
01
What is VLA-Adapter?
VLA-Adapter is introduced in arXiv 2509.09372 by Yihao Wang and co-authors, with an official project page, GitHub repository and Hugging Face organization. The abstract says VLA models typically bridge perception and action by pre-training a large vision-language model on robotic data, which raises performance but also training cost. Read: the abstract, project page, most of the README and the Hugging Face page; not the full paper text.
02
Where does Firsthand fit next to VLA-Adapter?
VLA-Adapter is third-party research. Firsthand is not affiliated with its authors and claims no use, training or compatibility with it. Firsthand captures real first-person human video, not robot data, fast, on demand and to a written spec: 21 keypoints per hand with a visibility flag, wrist trajectories and action segments, plus one task instruction per episode.
03
What problem does VLA-Adapter address, per the sources?
The abstract names training cost: large-scale VLM pre-training on robotic data helps, but is expensive. The project page asks whether shrinking the backbone is enough, compares OpenVLA-OFT with 7B and 0.5B backbones, and concludes that an effective way to bridge vision-language to action is needed to cut backbone size while keeping performance. Its result tables are not reproduced here.
04
How is VLA-Adapter built, per the sources?
The project page says the VLM follows the Prismatic-VLMs architecture. At each layer, Raw features (the VLM’s vision and language representations) and ActionQuery features (additional learnable tokens) are integrated by Bridge Attention with the matching action latent, and the Policy has the same layer count as the VLM. The degree of Raw-feature injection is learnable. Total model size is Not stated in the sources read.
05
How is VLA-Adapter trained, per the sources?
The abstract says no robotic data pre-training, and a powerful VLA trained in 8 hours on a single consumer-grade GPU. The README fine-tunes a Prismatic-VLMs Qwen2.5-0.5B checkpoint with LoRA, lists configurations for GPUs from 10GB to 80GB or more of VRAM, and says the paper used four H100 GPUs. The project page says the backbone can also be frozen, training only the ActionQuery latent and Policy.
06
How was VLA-Adapter evaluated, per the sources?
The abstract says experiments on simulated and real-world robotic benchmarks show state-of-the-art-level performance and fast inference. The project page reports the LIBERO benchmark (Spatial, Object, Goal and Long suites), CALVIN ABC→D, and a throughput comparison with OpenVLA and OpenVLA-OFT. Scores and speeds are not reproduced here; real-world task details are Not stated in the sources read.
07
How does a VLA relate to real human egocentric video?
The sources read describe robot benchmarks: the README downloads LIBERO and CALVIN data in RLDS, and its example configuration uses two images per input plus proprioception. Egocentric human video as training data is not described. Firsthand states no robot actions or joint state, so it is not a drop-in swap for that data; any use with a given policy is the buyer’s pipeline.
08
What real-world egocentric demonstration data can you get custom-collected on demand?
Firsthand captures real human first-person video, with no synthetic or simulated data. Write tasks, environments and signals into a spec and confirm them on a Spec Pilot. The median from signed spec to first validated batch is 48 hours where coverage is deep and three to four weeks where thin. Formats: RLDS, LeRobot v2.1, WebDataset, HDF5.
09
VLA-Adapter architecture and training setup, as stated in the official sources
| Item | What the official sources state |
|---|---|
| Backbone | Prismatic-VLMs architecture with a Qwen2.5-0.5B LLM (project page, README); total model size Not stated in the sources read |
| Bridge | Bridge Attention joins per-layer Raw and ActionQuery features with the action latent; Raw injection is learnable |
| ActionQuery | Additional learnable tokens; 64 chosen (project page) |
| Policy size | 97M parameters with Qwen2.5-0.5B (project page); Pro version 207MB (README) |
| Robotic-data pre-training | None, per the abstract |
| Fine-tuning | LoRA, rank 64 in the README examples; frozen-backbone option on the project page |
| Training hardware | Single consumer-grade GPU, 8 hours (abstract); four H100 GPUs for the paper (README) |
| Code | MIT License on the repository; weight licences Not stated in the sources read |
| Firsthand relationship | None |
11
Design findings stated on the VLA-Adapter project page
| Question | Finding as stated |
|---|---|
| Which VLM layer for Raw features? | Middle-layer beats deep-layer |
| Which layer for ActionQuery features? | Deep-layer beats other layers |
| One layer or many? | Multi-layer features beat a single layer |
| ActionQuery or Raw? | ActionQuery generally outperforms Raw |
| How many ActionQueries? | Too few or too many hurt; 64 selected |
| How much to inject? | ActionQuery fully; Raw under controlled injection |
12
What VLA-Adapter’s sources describe beside what the Firsthand site states
| Aspect | VLA-Adapter (sources read) | What the Firsthand site states |
|---|---|---|
| Named benchmarks | LIBERO and CALVIN ABC→D; abstract says simulated and real-world | Not applicable; real human egocentric capture, custom-collected to spec |
| Images | Two images per input in the README example | Head-mounted egocentric video plus two wrist cameras |
| State and actions | Proprioception and robot actions | Not stated; human video, not robot data. 21 keypoints per hand, visibility flag, wrist trajectories, action segments |
| Language | Written task instructions on the project page | One task instruction per episode |
| File layout | RLDS for LIBERO and CALVIN (README) | RLDS, LeRobot v2.1, WebDataset, HDF5 |
| Compatibility | Not claimed | Not claimed |
13
Frequently asked questions
- What is VLA-Adapter?
- A paradigm for tiny-scale VLA models with a lightweight Policy module and Bridge Attention, introduced in arXiv 2509.09372.
- Does VLA-Adapter need robotic data pre-training?
- The abstract says it reaches high performance with a 0.5B-parameter backbone and no robotic data pre-training.
- How long does VLA-Adapter take to train?
- The abstract says 8 hours on a single consumer-grade GPU. Other training times are Not stated in the sources read beyond the README’s per-configuration notes.
- Is VLA-Adapter open source?
- The repository lists the MIT License, and checkpoints are on the Hugging Face organization. Weight licences are Not stated in the sources read.
- Was VLA-Adapter trained on egocentric human video?
- Not described in the sources read. The README describes LIBERO and CALVIN robot benchmark data.
- Does Firsthand use VLA-Adapter, and can I request a custom dataset?
- Firsthand is not affiliated with the VLA-Adapter authors and claims no use, training or compatibility. You can request a custom dataset, confirmed first on a Spec Pilot.
Related terms