Warehouse & logistics

Egocentric Video Data for Logistics and Fulfillment

Receiving, putaway, picking, packing, sortation, and loading, captured first-person across the full fulfilment flow rather than one station in isolation.
Flow covered
Receiving through loading, as one spec
Streams
Head/wrist RGB, depth, hand pose, action segments
Billing
Per validated hour
License
Perpetual, buyer-owned
A fulfilment facility interior with racking, conveyor sortation, and loading dock doors
Head-worn capture follows a worker across stations, from receiving dock to outbound load.

Requirements

What does fulfillment-flow data need?

01

The whole flow, not one station

A policy trained only on picking footage has no exposure to receiving, putaway, sortation, or loading. Writing the full flow into one spec means every station is captured with the same accept criteria and ships as one consistent dataset.

02

Captured on shift, in a live facility

A working fulfilment facility has mixed lighting, real multi-person traffic between stations, moving material-handling equipment, and genuine failure cases — mis-picks, dropped totes, jams — that a mock facility does not reproduce.

03

A named skill list per station

Dock-to-stock receiving scans, putaway to a location, single-item pick, barcode scan, carton break-down, pallet stacking, conveyor sortation diverts, and dock loading each need their own coverage rather than one generic "fulfillment" label.

04

Rights that let the data ship in a product

A perpetual, buyer-owned commercial license backed by a documented consent chain, so a policy trained across the fulfilment flow can go into a live product rather than staying a research artifact.

Why it matters

What egocentric data do logistics and fulfillment teams need?

Logistics and fulfillment covers the end-to-end flow inside a distribution center or 3PL facility: dock-to-stock receiving, putaway to a storage location, single-item and case picking, pack-out, conveyor and tilt-tray sortation, and dock loading. A model that only sees one station in isolation has no exposure to how work actually moves between them.

Public corpora that touch logistics are largely incidental footage of one station rather than a spec-driven capture of the full flow, and they carry no hardware-synchronized depth or manipulation-grade hand pose in the first place. A custom collection written against the full flow fills that gap directly.

Training station by station without a shared spec also means each station can end up with a different camera placement, a different label set, or a different accept bar, which makes it harder to combine batches into one consistent training run later. Writing receiving, putaway, picking, packing, sortation, and loading into a single spec up front keeps the data comparable across stations from day one, even if a buyer only captures a subset of them first.

Scope

Which fulfillment tasks can be captured first-person?

A fulfillment spec typically names tasks station by station: receiving (unload, dock-to-stock scan, damage check), putaway (location scan, shelf or bin placement), picking (single-item pick from bin to tote, case pick, barcode scan), packing (carton break-down, pack-out, label application), sortation (conveyor feed, tilt-tray or diverter handling, chute sorting), and loading (pallet build, shrink-wrap, trailer loading sequence).

A buyer does not need every station covered in one order — a spec can name just picking and packing, or the full receiving-to-loading flow, depending on what the training pipeline needs next. Coverage is scoped to the written spec, not assumed.

Capture setup

How is capture set up inside a warehouse or 3PL facility?

A head-mounted camera keeps the task motion in frame from the viewpoint a logistics policy will actually see from, following a worker through dock, aisle, pack bench, sortation line, and loading dock across a shift. Depth, hand pose, and action segments are aligned to video on one hardware clock.

Per-session recalibration accounts for cabling routed under hi-vis PPE, which shifts wrist extrinsics slightly between sessions. Long sight-lines down a pick aisle or across a sortation line push some pixels beyond reliable depth range; those are flagged rather than interpolated, so a buyer knows exactly where the depth stream stops being trustworthy.

Because a worker moves between stations during a shift, action segments also mark the transition points — leaving a pick aisle, arriving at a pack bench, feeding a sortation line — so a buyer can split a single continuous recording into per-station episodes during training without re-reviewing raw footage.

Labels

What labels come with logistics task data?

Delivered episodes carry 3D hand pose through reach, grasp, and place; instance segmentation and action segments marking task boundaries; and grasp and contact events. Depth ships synchronized to video, with distance-invalid pixels beyond reliable range flagged rather than filled in.

Every batch is measured against the accept criteria written into the spec before anything ships, billed per validated hour, with a reject log delivered alongside the data. Rejected items are recaptured at no cost to the buyer.

Privacy

How are workers and bystanders protected?

Each episode links to a signed contributor release through a documented consent chain. Faces, license plates on yard vehicles, and screens are detected and irreversibly blurred at ingest, and a reviewer confirms the result before anything ships; the anonymization record is delivered with the data.

A facility running at multi-person density, with pickers, packers, and equipment sharing the same aisles and dock space, means more bystanders pass through frame than in a lower-traffic setting. The same blur-at-ingest policy applies regardless of traffic; a clip that cannot be de-identified is discarded rather than shipped with a caveat.

Rights

What licence and documentation comes with fulfillment data?

Every custom collection ships under a perpetual, non-exclusive, buyer-owned commercial license by default; exclusivity is available on request so the data is never resold to another buyer. The consent chain and anonymization record travel with the delivery.

This is the same licensing and documentation structure used across every custom collection on this site — nothing fulfillment-specific changes about ownership or rights.

Delivery

What formats does logistics data ship in?

Logistics and fulfillment data ships in RLDS, LeRobot, and WebDataset, plus HDF5, zarr, and Rerun .rrd for inspection and debugging. Converter source is readable, so a buyer can retarget the schema to a different loader if needed.

These are the same delivery formats available across every custom collection on this site, chosen to drop into common imitation-learning and robotics training pipelines without a bespoke conversion step.

Getting started

How do you start a logistics data collection?

Describe the stations and tasks your training pipeline needs — picking only, packing and sortation, or the full receiving-to-loading flow. That becomes a written spec covering tasks, environments, capture tier, annotation depth, and accept criteria, quoted for reach, timeline, and price before any capture begins.

A Spec Pilot — a small, fast first batch run against that spec — proves coverage and reject rate on your facility type before you commit to full volume. On-demand top-ups run against the same spec and accept criteria afterward, so new data stays consistent with what you already hold.

At a glance

What you get.

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

By fulfillment stage

Fulfillment stage × typical tasks × capture setup

What a logistics and fulfillment collection captures, stage by stage.
Fulfillment stageTypical tasks capturedCapture setup & labels
ReceivingDock-to-stock scan, unload, damage checkHead/wrist RGB, depth, action segments
PutawayLocation scan, shelf or bin placementHead/wrist RGB, hand pose, action segments
PickingSingle-item pick, case pick, barcode scanHead/wrist RGB, depth, 3D hand pose, grasp events
PackingCarton break-down, pack-out, label applicationHead/wrist RGB, hand pose, instance segmentation
SortationConveyor feed, tilt-tray or diverter handlingHead/wrist RGB, depth, action segments
LoadingPallet build, shrink-wrap, trailer loading sequenceHead/wrist RGB, depth, hand pose, action segments

Facility constraints

Facility constraint × how the process handles it

Constraints specific to logistics and fulfillment facilities, and how the capture and privacy process addresses each.
Facility constraintHow the process handles it
Multi-person activity across stationsPer-session recalibration; capture scoped by station to keep task boundaries clean
Long sight-lines down aisles and sortation linesDistance-invalid depth pixels beyond reliable range flagged, not interpolated
Hi-vis PPE affecting rig fitPer-session recalibration accounts for cabling routed under PPE
Moving material-handling equipmentAction segments mark task boundaries so equipment movement is distinguishable from worker motion
Bystanders and coworkers in frameFaces, plates, and screens blurred at ingest; undeidentifiable clips discarded rather than shipped
Shift-based, mixed lightingCaptured on shift across lighting conditions rather than staged under studio lighting

FAQ

Logistics and fulfillment egocentric data, answered.

What is egocentric data for logistics and fulfillment?
Real-world, first-person demonstration data of the fulfilment flow — receiving, putaway, picking, packing, sortation, and loading — captured against a written spec, with depth, hand pose, and action segments synchronized to video.
How is this different from warehouse robotics training data?
Warehouse robotics training data on this site focuses on pick-and-pack and pallet-build tasks. This page covers the fulfillment flow end to end — receiving and putaway through sortation and loading — for buyers who need the full flow rather than one station.
Can we start with just one station, like picking or packing?
Yes. The written spec scopes exactly which stations are covered; a buyer can start with one station and expand the spec to cover more of the flow later.
Is capture done in a live facility or a mock set?
Live, working fulfilment space, captured on shift across receiving dock, aisles, pack bench, sortation line, and loading dock, rather than a staged mock facility.
How is fulfillment data billed?
Per validated hour, quoted against the written spec before capture begins. Rejected items are recaptured at no cost, so a buyer pays only for data that clears the accept criteria.
How are workers and bystanders protected during capture?
Every contributor signs a release through a documented consent chain, and bystander faces, plates, and screens are blurred at ingest with a reviewer confirming the result. A clip that cannot be de-identified is discarded rather than shipped.
Which delivery formats are supported?
RLDS, LeRobot, and WebDataset, plus HDF5, zarr, and Rerun .rrd, the same formats used across every custom collection on this site.
Can we start with a small pilot before committing to volume?
Yes. A Spec Pilot is a small, fast first batch that proves the spec and accept criteria before scaling volume on demand.

Sources

Where are the delivery formats documented?

Need data across your fulfillment flow?

Tell us which stations — receiving, putaway, picking, packing, sortation, loading — your training pipeline needs. We will turn them into a written spec and run a Spec Pilot before scaling to full volume.