Ongoing program

Ongoing Custom Data Collection Programs

A one-off custom dataset answers a fixed brief and ships once. An ongoing data collection program is different: it is the same written-spec, Spec Pilot, QA, and licensed-delivery pipeline run repeatedly, as a series of batches, so new tasks, new failure cases, and new coverage gaps can be added to the spec and captured as they are identified — rather than reopening a one-off order each time a model needs more data. This page covers how an ongoing program is structured after the first pilot, how the spec is versioned between batches, how quality is kept consistent across every batch, and how consent and licensing carry forward, using only the process, capture, QA, licensing, and format details already described elsewhere on this site.
Starting point
Written spec → Spec Pilot → repeated batches
First batch
a median of 48 hours (deep coverage)
Billing
Per validated hour, each batch
License
Perpetual, buyer-owned
A data engineer reviewing successive batches of egocentric capture footage as part of an ongoing custom data collection program
An ongoing program repeats the same written-spec, pilot, QA, and licensed-delivery pipeline as a series of batches rather than a single order.

What stays constant across a program

What carries across every batch in an ongoing program.

01

One spec, updated rather than replaced

The written skill spec that passed the Spec Pilot carries forward into every later batch — new tasks or scenes are added to it as cells, rather than the program restarting from a blank brief each time.

02

The same QA bar on every batch

Each batch passes through the same calibration, sync, and label review as the pilot that validated the spec, so later batches do not quietly drift from the quality bar the first batch set.

03

Consent and licensing carry forward

Every contributor across every batch signs the same consent release used in the pilot, and every batch ships under the same perpetual, buyer-owned commercial license — the license does not need to be renegotiated batch by batch.

04

New gaps become new spec cells

Where a deployed model surfaces a new failure case or an underrepresented scene, that gap is written up as a new cell in the spec and captured in the next batch, rather than requiring a separate engagement.

Definition

What is an ongoing data collection program?

A one-off custom egocentric order answers a fixed brief: a written spec, a Spec Pilot that proves it, and a delivery that closes out the engagement. An ongoing data collection program takes the same pipeline and keeps it running as a series of batches after that first pilot, so a buyer can keep adding coverage — new tasks, new failure cases, new scenes — as their model’s needs change, instead of treating each new data need as a separate order from scratch.

The unit of work does not change between a one-off order and an ongoing program: it is still a validated hour of first-person video, captured under a written spec, checked against a QA bar, and delivered under a license. What changes is the cadence — batches recur rather than a single delivery closing the engagement — and the fact that the spec itself is allowed to grow between batches as new requirements are identified.

When to use it

When does a recurring program beat a one-off dataset?

A one-off order fits a fixed, known need: a defined set of tasks and scenes that will not meaningfully change once delivered. An ongoing program fits a model that is actively being trained, evaluated, and deployed, where testing or deployment keeps surfacing new failure cases and coverage gaps — the same dynamic described by the data flywheel, where a model’s failures are observed, turned into a new data requirement, and closed with targeted collection, then the cycle repeats.

Because the spec, pilot, and delivery pipeline are already proven after the first pilot batch, later batches in a program do not need to re-run the full specification process from zero — only the new or changed portion of the spec needs to be written up and piloted before the next batch scales.

Starting point

How does a program start from the Spec Pilot?

An ongoing program starts exactly the way a one-off order does: a written skill spec covering the tasks, scenes, objects, and streams in scope, proven on a small, fast Spec Pilot batch before any volume is committed. The pilot is QA’d and delivered with a reject log and coverage report, the same reporting a full batch gets, so the spec and accept criteria are confirmed on real footage first.

What makes the engagement a program rather than a one-off is the decision, after that first pilot is accepted, to keep the same spec — and the pipeline that validated it — running as additional batches are scoped, rather than closing the engagement once the first delivery ships.

Spec versioning

How is the skill spec versioned between batches?

Each new requirement — a new task, a new failure case a deployed model surfaced, a scene or object variant that was thin in earlier coverage — is written up as a new cell added to the existing skill spec, the same way any task or scene is specified in a custom order: a clear start, end, outcome, and object set. The prior cells in the spec are not rewritten; the spec grows additively as new cells are appended.

Where a new cell represents a meaningfully different task or environment from what the pilot already validated, that cell can be piloted on its own small batch before it is scaled into a full-size batch, the same gap-driven pilot-then-scale approach used for a brand-new one-off order — applied to one cell of a larger, ongoing spec rather than to a whole new engagement.

Consistency

How is quality kept consistent across batches?

Every batch in an ongoing program passes through the same QA gate as the pilot that validated the spec: calibration and synchronization checks on every active stream, and label and annotation review for hand pose and action segments where those are included. Episodes that fail QA are rejected rather than delivered with a quality caveat, in every batch, not only the first.

This is the same consistency principle that holds a large-scale, single-order collection together across many contributors and sessions — a fixed calibration procedure and QA bar applied uniformly — extended across time instead of only across volume within one order. A reject log accompanies each batch, so the buyer can see what was screened out in that batch specifically.

Data flywheel

How do model failures feed the next batch?

A data flywheel is the loop an ongoing program is built to support: a model is tested or deployed, its failures are observed, those failures are written up as a new skill spec cell, targeted data is collected against that cell, and the retrained model is tested again. Each turn of the loop converts a specific, observed weakness into a precise data request rather than a generic instruction to "collect more."

Within an ongoing program, that loop maps directly onto the batch cadence: an observed failure becomes a new or updated spec cell, the next batch captures against it, and the data card that ships with that batch records which cells were captured and what was rejected — so each turn of the flywheel is documented, not just the first one.

Consent & licensing

How do consent, anonymization, and licensing carry across batches?

Every contributor across every batch in a program signs the same consent release that governs a one-off order, and every session carries its own consent record through delivery — consent is handled per session throughout the program, not renegotiated at the start of each new batch. Anonymization is applied with the same scope used elsewhere on the site, per session, as part of the standard pipeline.

Licensing does not need to be re-established batch by batch either: delivery across the program ships under one perpetual, buyer-owned commercial license, the same licensing model used for any order size on this site, so each new batch becomes a permanent addition to a training pipeline the buyer already owns outright rather than a separately licensed asset.

Delivery

What does each batch deliver and in which formats?

Each batch in an ongoing program delivers in the same format the training pipeline expects — RLDS, LeRobot, WebDataset, HDF5, zarr, Rerun .rrd, or raw streams with metadata — specified once as part of the original spec and held constant across every later batch, so a pipeline does not need to re-integrate a new format each time a batch arrives.

Billing stays on the same unit across the program: per validated hour, per batch, rather than a single lump-sum price for the whole engagement. This keeps each batch’s cost tied directly to the validated hours it delivers, the same way a single pilot or one-off order is billed.

Getting started

How do you start an ongoing data collection program?

An ongoing program starts the same way any custom order does: a written brief covering the tasks, scenes, objects, and streams currently in scope, run through a Spec Pilot before any volume is committed. The difference is in planning for growth — flagging up front that this is expected to continue as a series of batches, so the spec, consent process, and delivery format are set up to extend cleanly as new cells are added later.

From there, each new requirement that emerges from testing or deployment is written up as a new spec cell and scheduled into the next batch, following the same pilot-or-scale decision used for any new cell: pilot it first if it is meaningfully new, or fold it directly into the next scaled batch if it closely matches a cell the spec has already proven.

At a glance

What you get.

Starting point
Written spec → Spec Pilot → repeated batches
Streams
RGB (head/wrist) • depth • IMU • hand pose • action segments, as specced
Formats
RLDS • LeRobot • WebDataset • HDF5 • zarr • Rerun .rrd • raw + metadata
Billing
Per validated hour, each batch
License
Perpetual, buyer-owned

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

Program structure

What happens at each stage of an ongoing program

Program element, what happens, and what the buyer receives or controls
Program elementWhat happensWhat the buyer receives / controls
Spec PilotA small, fast first batch runs against the initial written specReject log and coverage report; confirms the spec before scaling
Spec versionNew tasks or failure cases are appended to the spec as new cellsFull visibility into what each new cell covers before it is captured
BatchA scheduled capture run against the current spec versionA validated-hour deliverable, billed per batch
Acceptance gateCalibration, sync, and label review applied to every episodeReject log per batch; failing episodes are not delivered
Calibration checkThe same calibration and sync procedure as the original pilotConsistency with the first batch, not a reset quality bar
DeliveryEach batch ships in the format set in the original specBuyer-owned files in RLDS, LeRobot, WebDataset, HDF5, zarr, Rerun .rrd, or raw + metadata

One-off vs. ongoing

A one-off custom dataset vs. an ongoing program

Comparing a single custom order with a recurring collection program across the dimensions that differ
DimensionOne-off custom datasetOngoing program
ScopeFixed brief, defined onceSame spec, extended with new cells as needs change
Spec changesScoped before the order starts; not expected to grow after deliveryExpected to grow batch to batch as new tasks or failures are identified
QA consistencyApplied once, across the single deliveryApplied identically to every batch, holding the bar constant over time
LicensingPerpetual, buyer-owned, set once at deliveryPerpetual, buyer-owned, carries forward across every batch without renegotiation
DeliveryOne delivery closes the engagementRecurring batches in the same agreed format

FAQ

Ongoing data collection program, answered.

What is the difference between a one-off custom dataset and an ongoing program?
A one-off order answers a fixed brief and closes once delivered. An ongoing program keeps the same written-spec, pilot, QA, and licensed-delivery pipeline running as a series of batches, with the spec extended as new tasks or failure cases are identified.
Does an ongoing program still start with a Spec Pilot?
Yes. It starts exactly the way a one-off order does: a written spec proven on a small, fast pilot batch before any volume is committed. What differs is that the spec and pipeline then continue into additional batches instead of closing out after one delivery.
How is the spec updated between batches?
New requirements — a new task, a failure case a deployed model surfaced, a thin scene or object variant — are written up as new cells appended to the existing spec. Prior cells are not rewritten; the spec grows additively.
Does quality stay the same across every batch?
Yes. Every batch passes through the same calibration, sync, and label review that the original pilot used. Episodes that fail are rejected, not delivered with a caveat, in every batch, and a reject log accompanies each one.
How does an ongoing program relate to a data flywheel?
A data flywheel is the loop an ongoing program supports: a model is tested or deployed, failures are observed, those failures become a new spec cell, targeted data is collected, and the model is retrained and tested again. The program’s batch cadence is how that loop keeps turning.
Do consent and licensing need to be renewed for each batch?
No. Every contributor signs the same consent release used across the program, and every batch ships under the same perpetual, buyer-owned commercial license established at the start — it does not need to be renegotiated batch by batch.
What formats do batches in an ongoing program ship in?
Whatever format the training pipeline expects — RLDS, LeRobot, WebDataset, HDF5, zarr, Rerun .rrd, or raw streams with metadata — set once in the original spec and held constant across every later batch.
How do you start an ongoing data collection program?
The same way as any custom order: a written brief covering current tasks, scenes, and streams, run through a Spec Pilot. Flag up front that the engagement is expected to continue as batches, so later spec growth and delivery stay consistent with the first batch.

Sources

Where are the delivery formats documented?

Need an ongoing data collection program?

Tell us what your model needs covered now, and how you expect that to grow. We will validate the spec with a Spec Pilot and set up a batch cadence that scales as new tasks and failure cases come in.