Pilot collection

Egocentric Data Collection Pilot

Committing to a full egocentric collection on a spec that has never been run against real footage is a bet on a pitch deck, not on data. A Spec Pilot turns that bet into a measured result — a small, fast first batch captured against your written spec, QA’d and delivered with the same reporting a full order gets — so task definitions, label quality, and coverage can be corrected before they are repeated at scale.
Starting point
Written skill spec
Pilot size
Small, fast first batch
Billing unit
Validated hour (same as full order)
License
Perpetual, buyer-owned
A sample episode of first-person egocentric footage captured against a written spec, the kind of batch a Spec Pilot delivers before a buyer commits to full volume
A pilot batch proves the spec and the accept criteria on real footage, at low volume, before a buyer commits to scale.

How it works

What a pilot proves before you commit to volume.

01

The spec, tested on real footage

A written spec reads well on paper; a pilot shows whether the tasks, scenes, and labels it describes actually produce the episodes a training pipeline needs, before that spec is repeated at scale.

02

The same QA and reporting as a full order

A pilot batch is not a lower-bar sample — it passes through the same calibration, sync, and label review as any custom collection, and ships with the same reject log and coverage reporting.

03

A small commitment before a large one

Billing is per validated hour, the same unit as a full collection, but at pilot volume — so the cost of discovering a spec needs correction is small, and corrections happen before they are repeated across a much larger batch.

04

A clear path from pilot to scale

Once a pilot batch is accepted, the same written spec — corrected where the pilot surfaced an issue — scales into the full order, without starting the specification process over.

Definition

What is an egocentric data collection pilot?

An egocentric data collection pilot — called a Spec Pilot — is a small, fast first batch of episodes captured against a buyer’s written skill spec. Its purpose is to prove the spec and the accept criteria on real footage before a buyer commits to the full volume of a custom collection, so the exact reject rate, coverage fill, and sync quality a buyer would get at scale are measured early, while the cost of being wrong is still small.

A pilot is not the same thing as a free sample pack. A sample pack shows existing footage already captured for a different purpose; a pilot is captured fresh against the buyer’s own written spec, so it proves that specific spec rather than a generic example of egocentric data.

Why pilot first

Why start with a pilot before a full egocentric collection?

Committing to full volume on a spec that has never been run against real footage means betting on how the plan reads on paper, not on what the data actually looks like once captured. A pilot replaces that bet with a measured result: the reject rate, coverage depth, and stream count the written spec actually produces, at low volume, before a larger commitment.

The pilot result can then be scored on the same criteria a buyer would use to evaluate any data source — sync error, annotation depth, license terms, consent handling, reject policy, and billing unit — before scaling. If the pilot surfaces a gap (a task definition that reads ambiguously, a label that needs tighter guidance), that correction happens once, on a small batch, rather than being repeated across the full order.

Inputs

What do you need to provide to start a pilot?

A pilot starts from the same written skill spec a full collection uses: the tasks to demonstrate, the scenes and objects involved, which streams to capture (RGB is the baseline; depth, IMU, and hand pose are added where the spec calls for them), which labels the training pipeline needs (hand pose, action segments), and the delivery format the pipeline expects.

A pilot does not require a larger standing program or a long-term commitment to start — a focused written brief covering tasks, scenes, and required streams and labels is a normal starting point for both a pilot and a full order.

Deliverable

What do you receive from an egocentric data pilot?

A pilot delivers a small batch of episodes captured against the written spec, structured and labeled exactly as the spec defines — the same streams, the same action-segment and hand-pose labels where ordered, and the same delivery format (RLDS, LeRobot, WebDataset, HDF5, zarr, Rerun .rrd, or raw streams with metadata) the full order would use.

Alongside the episodes, a pilot ships with a reject log and a coverage report against the spec — the same reporting a full custom collection gets — so a buyer is scoring the pilot on exactly what a full order would look like, not on a simplified preview.

Acceptance

How is a pilot dataset QA’d and accepted?

Pilot episodes pass through the same QA process as any egocentric order: calibration and synchronization checks on every active stream, and label and annotation review for hand pose and action segments where those are included. Episodes that fail are rejected rather than delivered with a quality caveat, and the reject decisions are recorded in the reject log that ships with the batch.

Because a pilot runs at low volume, a buyer can review every delivered episode against the written spec directly — checking that task definitions were followed consistently, that labels are aligned to the observation at each step, and that coverage of the specced tasks and scenes is adequate — before deciding whether to scale.

Timeline

How long does an egocentric pilot take?

Turnaround depends on the scope specced and how deep existing coverage is for the tasks and scenes requested. Where coverage is already deep, a first batch can turn around with a median of 48 hours; broader or more novel specs run on the order of three to four weeks, the same range that applies to a full custom collection, since a pilot runs through the identical pipeline at a smaller scale rather than a shortened process.

Because a pilot is a smaller batch than a full order, its absolute turnaround is often faster in practice even within that range — but the pipeline steps (spec review, capture, QA, delivery) are the same ones a full collection goes through.

Ownership

Who owns the pilot data and how is it licensed?

Pilot episodes ship under the same license as a full custom collection: perpetual, buyer-owned, and non-exclusive by default, not a hosted-access or research-only arrangement. Every contributor signs a consent release before capture, and that consent record travels with the episode through delivery; anonymization of bystander faces, plates, and screens is applied as a standard part of the pipeline for pilot batches the same way it is for a full order.

Billing for a pilot is per validated hour, the same unit used for a full collection — a pilot is priced as a smaller quantity of the same billing unit, not a separately structured trial fee.

Scaling up

How does a pilot scale into a full custom collection?

Once a pilot batch is reviewed and accepted, the same written spec — corrected for anything the pilot surfaced — scales directly into the full order, without restarting the specification process. The streams, labels, and format already proven in the pilot carry forward, so the full collection is an extension of the validated plan rather than a new negotiation.

If the pilot does surface a correction — a task definition that needs tightening, a label that needs clearer guidance, a scene or object set that needs broadening — that correction is made once, on the small pilot batch, and the full order runs against the corrected spec rather than repeating the issue at volume.

At a glance

What you get.

Starting point
Written skill spec (tasks, scenes, streams, labels, formats)
Deliverable
Small batch of episodes + QA report + reject log
Streams
RGB (head/wrist) • depth • IMU • hand pose • action segments, as specced
Formats
RLDS • LeRobot • WebDataset • HDF5 • zarr • Rerun .rrd • raw + metadata
Billing
Per validated hour, same unit as full collection
License
Perpetual, buyer-owned

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

Pilot deliverable

What a pilot batch includes, and the format fields it uses

Pilot deliverable, its contents, and the format fields that carry it
DeliverableContentsFormat fields
EpisodesSmall batch of first-person recordings captured against the written specRLDS • LeRobot • WebDataset • HDF5 • zarr • Rerun .rrd • raw + metadata
Streams (as specced)RGB (head/wrist), plus depth, IMU, and hand pose where orderedPer-stream, hardware-triggered timestamps on a shared clock
Action-segment and hand-pose labelsFrame-accurate labels tied to the observation at each step, where orderedDelivered alongside episodes in the chosen format
QA report and reject logPass/reject decision per episode, with reasons for any rejectionAccompanies delivery, same as a full order
Coverage reportFill against the spec’d tasks, scenes, and objectsAccompanies delivery, same as a full order

Acceptance checks

How a pilot batch is accepted

Acceptance check, what is checked, and the site-stated gate it is measured against
Acceptance checkWhat is checkedGate
CalibrationStereo rig calibration on every active camera streamPass/reject per episode during QA
SynchronizationHardware-triggered timestamps aligned across all active streamsPass/reject per episode during QA
Label alignmentHand-pose and action-segment labels aligned to the observation at each step, where orderedPass/reject per episode during QA
Coverage against specTask, scene, and object coverage measured against the written specReported in the coverage report delivered with the batch
Consent and anonymizationSigned consent release per session; bystander faces, plates, and screens anonymizedStandard part of the pipeline, checked before delivery

FAQ

Egocentric data collection pilot, answered.

What is an egocentric data collection pilot?
A small, fast first batch of first-person episodes captured against a written skill spec, QA’d and delivered with a reject log and coverage report, to prove the spec before committing to full volume.
Is a pilot the same as a free sample pack?
No. A sample pack shows existing footage captured for a different purpose. A pilot is captured fresh against your own written spec, so it proves that specific spec rather than a generic example.
Do I need a standing program to start a pilot?
No. A focused written brief covering tasks, scenes, and required streams and labels is a normal starting point for a pilot — no larger commitment is required first.
How is a pilot billed?
Per validated hour, the same unit used for a full custom collection, at pilot volume.
How long does an egocentric pilot take?
Where coverage is already deep, a first batch can turn around with a median of 48 hours; broader or more novel specs run on the order of three to four weeks, the same range as a full collection, since a pilot runs through the identical pipeline at smaller scale.
Who owns the data from a pilot?
The buyer. Pilot episodes ship under the same perpetual, buyer-owned, non-exclusive license used for a full custom collection.
What should I check in the pilot results before scaling?
Score the delivered episodes on sync error, label alignment, coverage against the written spec, consent handling, reject rate, and billing unit — the same criteria used to evaluate any data source — before committing to the full order.
Has Firsthand supplied pilot data to a specific lab or model?
This page describes the pilot collection service — specification, capture, QA, and delivery — and does not claim to have trained or supplied data to any named model or lab.

Sources

Where are the delivery formats documented?

Ready to prove your spec with a pilot batch?

Tell us the tasks, streams, and labels your training pipeline needs. We will run a Spec Pilot against your written spec and deliver a small batch with the same QA and reporting a full order gets.