Delivery

Egocentric Data Delivery: Transfer, Checksums and Storage

How custom egocentric video moves from the field to your storage: daily encrypted upload, sha256 checksums at ingest, validation, cross-account delivery to your bucket, and where data is stored and kept, for robot training data delivery on a fast, on-demand cadence.
Upload
Daily, encrypted (TLS)
Integrity
sha256 at ingest
Delivery
S3, GCS or Azure
Storage
US (AWS)

Requirements

What does a delivery pipeline need?

01

Encrypted transfer from the field

Data leaves the capture device over an encrypted connection, so it is protected while it moves.

02

A fingerprint taken at ingest

A sha256 checksum recorded when the file arrives gives a later reader a way to tell whether it has changed.

03

Validation before shipping

Every batch is validated against signed accept criteria, with a reject log, before it is packaged.

04

Delivery into your own storage

Accepted data is pushed to your bucket in your format, on a cadence you agree, so it lands where your training jobs read it.

05

A stated storage and retention rule

You should know where data is stored and what happens to the field copies once a batch is accepted.

Why it matters

What is egocentric data delivery?

Egocentric data delivery is everything that happens between a clip being recorded and a batch being readable in your storage: upload, integrity checks, validation, packaging, transfer and clean-up. It is part of the service, not an afterthought.

Format pages on this site describe what a delivered file looks like. This page describes how it gets to you and what is stated about storage and retention along the way.

The path

What is the path from the field to my bucket?

The path has six stated stages. Devices upload to a cloud bucket, checksums are recorded at ingest, data is validated, accepted data is packaged in your format, it is pushed to your storage, and field copies are deleted after acceptance.

The table below sets each stage against what the site states. Where a detail is not stated, it is marked Not stated and agreed in the spec.

Upload

How does data get from the capture device to the cloud?

Devices upload daily over encrypted transfer, either directly or through a workstation, into a cloud bucket. Files land in per-site folders, so each capture site stays separate from the next.

Daily upload means a program reaches validation quickly, and a problem with a rig or a session shows up within a day, not at the end of a program.

Encryption

What does encrypted TLS transfer provide?

Transport Layer Security is a standard protocol for a secure channel between two endpoints. The version 1.3 specification describes it as designed to prevent eavesdropping, tampering and message forgery.

The site states that uploads are encrypted with TLS. It does not state a TLS version, cipher suite or certificate policy, so those are Not stated.

Integrity

What are sha256 checksums at ingest for?

A checksum is a short digest computed from a file. The NIST secure hash standard describes hash digests as a way to detect whether messages have changed since the digests were generated. A sha256 checksum recorded at ingest gives a later reader something to compare against.

The site states sha256 checksums at ingest. It does not state that checksums are re-verified at delivery or shipped alongside delivered files, so that step is Not stated.

Validation

How is data validated before it ships?

Every batch is validated against signed accept criteria, with a reject log, before it is packaged. A reviewer also confirms the privacy pass, in which faces, plates and screens are detected and irreversibly blurred at ingest.

Rejected items are recaptured at our cost, and billing is per validated hour, so you pay for what passes validation.

Formats

Which formats can accepted data be packaged in?

Accepted data is packaged in your format: MP4 with JSON or CSV, MCAP, LeRobot or a custom layout. The site also states RLDS, WebDataset, HDF5, zarr and Rerun .rrd. The format table below sets each against what its official documentation states.

Metadata and calibration files travel with the data. The exact field layout inside each format is agreed in the spec.

To your bucket

How is data delivered to my storage?

Data is pushed to your own bucket on S3, GCS or Azure by cross-account transfer. Delivery is rolling, per validated batch, weekly or on the cadence you agree.

Cross-account transfer means the data is written into an account you own, so you control access once it lands. The access rules you apply on your side are yours to set.

Large drops

What happens with very large deliveries?

For very large drops, data can be sent on encrypted physical drives instead of over the network. This suits a program whose accepted volume is too large to move practically in one transfer.

The drive encryption standard, shipping method and handling steps are Not stated. They are agreed when a drop is planned.

Storage

Where is data stored?

Data is stored in the United States, in an AWS US region. Alternative storage regions are available if required.

The site does not list which alternative regions are available, so that list is Not stated. Ask for the region you need when you scope the program.

Transit

Which route does data take?

Data goes from the collection country directly to United States cloud storage, and then on to your storage. In-region staging is available on request for programs that need data held in the collection region first.

The site does not state a legal basis for transfer between countries on this page. Country pages state the legal basis only where the site has papered it, and the rest is confirmed per engagement.

Retention

What is kept after a batch is accepted?

Field copies are deleted after acceptance. That is the retention rule the site states for the capture devices and the upload path.

Other retention periods, including how long data stays in cloud storage after delivery, are Not stated. The consent pages also state that delivered footage cannot be recalled after delivery, so plan access on your side accordingly.

Timing

How fast does a delivery program start and ramp?

A pilot reaches its first delivery in two to three weeks, and a standing program reaches full rate in four to six weeks. Those are program milestones. They assume capture coverage is already in place.

Where coverage is deep, the first validated batch of a Spec Pilot lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, and that rule still applies there, so we quote it up front.

What is not stated

What does the site not state about delivery and security?

The site does not state encryption at rest, key management, access controls, audit logs, certifications or compliance attestations for the delivery path. It also states no transfer speed, no checksum re-verification at delivery and no deletion certificate.

If your security or procurement team needs any of these, list them in the request. The table below sets each against its status.

Privacy

How does privacy fit into delivery?

Every episode links to a signed contributor release through a documented consent chain, and the consent record is part of the delivery. Faces, plates and screens are detected and irreversibly blurred at ingest, and the anonymization record ships with the data.

The site states no further privacy rule specific to the delivery path, so this page makes none.

The spec

How do you set up delivery for a pilot?

Tell us your target bucket provider, your format, your cadence and any region requirement. We write that into the spec alongside tasks and accept criteria, then quote reach, timeline and price before capture begins.

A Spec Pilot can prove the whole path, from first upload to a batch readable in your bucket, before you scale. Every collection ships under a perpetual, buyer-owned commercial license.

At a glance

What you get.

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

The path

What are the stages from capture to your bucket?

The stated delivery path, stage by stage, with the status of each on this site.
StageWhat is statedStatus
Field uploadDevices upload daily over encrypted (TLS) transfer, directly or through a workstation, into a cloud bucket in per-site foldersStated
Integritysha256 checksums recorded at ingestStated
ValidationEach batch validated against signed accept criteria, with a reject log; privacy pass confirmed by a reviewerStated
PackagingAccepted data packaged in your format, with metadata and calibration filesStated
DeliveryCross-account transfer to your S3, GCS or Azure bucket, weekly or on your cadence; encrypted drives for very large dropsStated
RetentionField copies deleted after acceptanceStated

Formats

Which formats can a delivery use?

Delivery formats stated on the site, set against what each official documentation states where the documentation was read.
FormatWhat the official documentation statesUsed for here
MCAPA container format for recording timestamped messages, with attachments for auxiliary artifacts such as calibration data (MCAP specification)Multi-stream timestamped data and calibration files
RLDSA dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README)Episode-based training loaders
LeRobotLeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation)LeRobot dataset format and tooling
WebDatasetTar files in which files that belong together share a basename, split into numbered shards (WebDataset README)Sharded streaming for large training runs
MP4 with JSON or CSV, HDF5, zarr, Rerun .rrdStated by Firsthand onlyCustom pipelines and review

Timing

What timing does the site state?

The timing figures the site states for a delivery program, and what each one covers.
MilestoneStated timingWhat it covers
Pilot to first deliveryTwo to three weeksProgram milestone, with coverage in place
Standing program at full rateFour to six weeksProgram milestone
First validated batch, deep coverageA median of 48 hours from signed specA Spec Pilot batch where coverage is deep
First validated batch, thin coverageThree to four weeksWhere vetting contributors is the bottleneck

What is not stated

Which delivery and security details does the site not state?

Details the site does not state, and where each one is settled.
ItemStatus on this siteWhere it is settled
TLS version, cipher suitesNot statedYour security review
Encryption at rest, key managementNot statedYour security review
Access controls, audit logsNot statedYour security review
Certifications and compliance attestationsNot statedYour security review
Checksum re-verification at deliveryNot stated; checksums are stated at ingestThe written spec
Alternative storage regionsNot stated; available if requiredAgreed when scoping
Drive encryption standard, drive handlingNot statedAgreed when a drop is planned
Retention after delivery in cloud storageNot stated; field copies are deleted after acceptanceThe written spec

FAQ

Robot training data delivery, answered.

How is egocentric robot training data delivered?
Devices upload daily over encrypted TLS transfer, checksums are recorded at ingest, batches are validated, and accepted data is pushed to your S3, GCS or Azure bucket, or sent on encrypted drives for very large drops.
Which cloud storage can you deliver to?
Your own bucket on S3, GCS or Azure, by cross-account transfer, weekly or on the cadence you agree.
What checksum is used?
sha256 checksums are recorded at ingest. Re-verification at delivery is Not stated and can be requested in the spec.
Where is data stored?
In the United States, in an AWS US region. Alternative storage regions are available if required, and in-region staging is available on request.
What happens to the field copies?
Field copies are deleted after acceptance. Other retention periods are Not stated.
How fast does a program start?
A pilot reaches its first delivery in two to three weeks, and a standing program reaches full rate in four to six weeks. Where coverage is deep, a Spec Pilot batch lands in a median of 48 hours.
Does the site state certifications or encryption at rest?
No. Certifications, compliance attestations, encryption at rest, key management and access controls are Not stated, so list what your security team needs in the request.
How do you set up delivery?
Tell us your bucket provider, format, cadence and region needs. We write them into the spec, and a Spec Pilot can prove the whole path before you scale.

Sources

Where are the delivery formats documented?

Request a custom dataset.

Tell us your bucket provider, format, cadence and region needs. We will quote reach, timeline and price against a written spec, and a Spec Pilot can prove the full delivery path before you scale.