A named packaging task list
Cartoning, sealing, labeling, palletizing and wrap-and-fold are different sequences, so a spec names each task and where on the line it happens.
Task family
Requirements
Cartoning, sealing, labeling, palletizing and wrap-and-fold are different sequences, so a spec names each task and where on the line it happens.
Most rows list a head-mounted phone or multiview rig and the bench rows list handheld grippers, so the spec states the mode per task.
Where the spec asks for them, contact events and action segments mark when a pack is sealed, a carton is closed or a wrap is folded, aligned to video and depth.
Where hand pose is part of the spec, a per-joint visibility flag records which joints were hidden behind a carton, a film or a fold.
A perpetual, buyer-owned commercial license backed by a documented consent chain.
Why it matters
Egocentric print and packaging line data is real-world video of work at the end of a production line: packing, closing, sealing, labeling, stacking and wrapping. It is recorded against a written spec, with depth, contact events and frame-accurate action segments aligned on one hardware clock where the spec includes them. The tasks it covers are the ones the site states in its task catalog, spread across three environments plus a Print & Packaging Plant environment.
The packing and kitting page covers packing at benches and kitting stations, and the manufacturing workflow page covers whole production procedures. This page covers the packaging-line rows and the print plant environment only.
Setting
The site states nine packaging-line task rows. Five sit in a Plastic & Light-Assembly Manufacturer environment, two in a Food & Beverage Manufacturing Plant, and two on a Deformables & Textiles Bench. Eight are rated Easy and one, wrapping and folding, is rated Medium.
The site also lists a Print & Packaging Plant environment, with the examples "Printing presses, die-cutting, folding and packaging lines". That environment holds one row, rated Medium and listed as Ready to deploy, and its description is generic. The table below lists every row with its catalog wording.
Cartons and pallets
Three rows in the Plastic & Light-Assembly Manufacturer environment cover cartons and pallets. The catalog descriptions read "Pack finished goods into cartons at the end of the line and seal and stack them", "Box finished goods, tape cartons shut, stack them on a pallet and stretch-wrap the load" and "Pack products into cartons, build the pallet in layers and wrap it for shipping." All three are rated Easy.
A fourth row reads "Pack finished units into boxes with inserts, seal and label them for dispatch." Carton sizes, pack counts, pallet patterns and line speeds are Not stated.
Sealing and labeling
Two rows in the Food & Beverage Manufacturing Plant cover packs: "Fill packages, run them through the sealer and apply labels before casing" and "Feed packs into the heat sealer, check the seal and run them through the label applicator." Both are rated Easy and listed as Ready to deploy.
A labeling row in the light-assembly environment reads "Apply product and barcode labels to units or cartons by hand or with a label gun." Seal types, film types, label formats and what counts as a good seal are Not stated.
Wrap and fold
Two rows on the Deformables & Textiles Bench cover wrapping and bagging. "Wrap an item in paper and fold" is rated Medium, and "Bag and seal soft goods" is rated Easy. Both use a multiview rig with handheld grippers and are listed as Available on request.
The wrap row is the closest the site comes to stating folding as a task. It does not describe a folding carton, a box blank or a die-cut sheet. The paper, the item and the fold pattern are Not stated.
Print work
Very little, and this page says so. The Print & Packaging Plant environment names "Printing presses, die-cutting, folding and packaging lines" as examples of where capture can happen. Its one row is titled with the environment name and described as "Target environment for commercial egocentric collection."
The site states no task row for press operation, print finishing, die-cutting, folding carton forming or gluing. A print task is therefore scoped in the written spec, not drawn from the catalog.
What is not covered
Packing cartons with void-fill and tape on a warehouse pack bench, and weighing and sealing a package there, sit on the packing and kitting page. Scanning and label printing sit on the barcode scanning and labeling page. Whole production procedures sit on the manufacturing workflow page.
Folding shirts and towels sits on the same bench as the wrap row, but it is a garment task and is not counted here.
Why it is hard
The catalog describes steps where the hands change the object as they go: cartons packed then taped shut, a load built in layers then stretch-wrapped, an item wrapped in paper then folded. Film behaviour, paper stiffness, fold sequence and glue handling are Not stated. What the site does state is what egocentric video puts into the training distribution: hands entering the frame from below, occlusion during grasp and motion blur during reach.
RGB alone leaves a model to infer 3D hand structure it cannot see reliably through occlusion and motion blur. Firsthand delivers 3D hand pose as handJoints[2][21][3] in metric units in the head-camera frame, with a visibility flag per joint. Whether it is populated for each packaging row is Not stated.
Capture setup
The catalog uses two modes. For most rows, "a head-mounted phone records the first-person view of real work on site; a multiview rig adds synchronized third-person angles when the spec asks for them." For the bench rows, the mode is "a staged working set recorded by a multiview rig while the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector."
The site states a head camera at 3840 × 2160 and 60 fps for its instrumented rig, but no camera count, resolution or frame rate for the packaging rows, so the capture tier is agreed in the spec.
Streams and labels
Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact and grasp events, and frame-accurate action segments. For packaging work, contact events mark when a hand meets a carton, a film or a label, and action segments mark each step.
Which streams each packaging row populates is Not stated. Force or tactile data is Not stated for these rows unless a spec adds the glove tier, as are success or quality labels for a seal, a label placement or a fold.
Setting and privacy
The catalog places the rows in a plastic and light-assembly manufacturer, a food and beverage manufacturing plant, a textiles bench and a print and packaging plant. Environment, access and schedule are agreed in the spec, and the number of sites is Not stated.
Every episode links to a signed contributor release through a documented consent chain. Faces, plates and screens are detected and irreversibly blurred at ingest, a reviewer confirms the result before anything ships, and the anonymization record is delivered with the data. An undocumented bystander is a stated reject criterion. How product logos, brand artwork, barcodes and printed labels are handled is Not stated, so name them in the spec.
Delivery
Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. The format table below sets each against what its official documentation states.
Every batch is machine-checked at ingest against the stated reject criteria, reviewed by a person and validated against signed accept criteria before it ships. A rejected item goes to the reject log and is recaptured at our cost. Delivery is rolling, per validated batch.
Fast · on demand
Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front.
On-demand top-ups run against the same spec and accept criteria after each training run.
The spec
You describe the packaging tasks, the sequence and the capture mode your policy needs. We turn that into a written spec covering tasks, environments, capture tier, annotation depth and accept criteria, then quote reach, timeline and price before any capture begins.
A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Billing is per validated hour, and every collection ships under a perpetual, buyer-owned commercial license.
At a glance
Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.
Catalog rows
| Environment | Catalog task | Catalog description | Skill |
|---|---|---|---|
| Plastic & Light-Assembly Manufacturer | Assembly Line Packaging | Pack finished goods into cartons at the end of the line and seal and stack them. | Easy |
| Plastic & Light-Assembly Manufacturer | Box and palletize finished goods using tape guns and stretch wrap | Box finished goods, tape cartons shut, stack them on a pallet and stretch-wrap the load. | Easy |
| Plastic & Light-Assembly Manufacturer | Boxing & Palletizing Finished Goods | Pack products into cartons, build the pallet in layers and wrap it for shipping. | Easy |
| Plastic & Light-Assembly Manufacturer | Labeling | Apply product and barcode labels to units or cartons by hand or with a label gun. | Easy |
| Plastic & Light-Assembly Manufacturer | Packaging operations | Pack finished units into boxes with inserts, seal and label them for dispatch. | Easy |
| Food & Beverage Manufacturing Plant | Packaging & Sealing | Fill packages, run them through the sealer and apply labels before casing. | Easy |
| Food & Beverage Manufacturing Plant | Seal and label packaged goods using a heat sealer and label applicator | Feed packs into the heat sealer, check the seal and run them through the label applicator. | Easy |
| Deformables & Textiles Bench | Bag + seal soft goods | Bag and seal soft goods. | Easy |
| Deformables & Textiles Bench | Wrap + fold packaging | Wrap an item in paper and fold. | Medium |
| Print & Packaging Plant | Print & Packaging Plant | Target environment for commercial egocentric collection. | Medium |
Capture and status
| Environment | Examples as listed | Capture mode | Status |
|---|---|---|---|
| Plastic & Light-Assembly Manufacturer | Consumer goods assembly, packaging operations, labeling, quality inspection on a production line | Phone (head-mounted) / multiview rig | Ready to deploy |
| Food & Beverage Manufacturing Plant | Packaged food factory, bottling plant, meat processing facility, ready-meal production line | Phone (head-mounted) / multiview rig | Ready to deploy |
| Deformables & Textiles Bench | Cloth-and-cable bench: garments, towels, cables, form boards, bags | Multiview rig + handheld grippers | Available on request |
| Print & Packaging Plant | Printing presses, die-cutting, folding and packaging lines | Phone (head-mounted) / multiview rig | Ready to deploy |
Streams and tasks
| Stream or label | Status on this site | What it carries in a packaging episode |
|---|---|---|
| Head and wrist RGB, depth | Stated; ten streams synced under 2 ms | Keeps the carton, the film and the hands on one timeline |
| 3D hand pose, per-joint visibility | Stated; two hands of 21 joints, with a visibility flag per joint | Carries how the fingers hold a pack and which joints were hidden |
| Contact and grasp events | Stated | Marks when a hand meets a carton, a film or a label |
| Action segments | Stated; frame-accurate | Separates packing, sealing, labeling, stacking and wrapping steps |
| Force or tactile data | Glove tier stated; use on packaging rows Not stated | Added only if a spec includes the glove tier |
Quality gates
| Reject criterion | Status on this site | On packaging work |
|---|---|---|
| Manipulated object out of frame for more than 15 percent of the episode | Stated | Applies to every episode; how often a carton leaves the view is Not stated |
| More than 35 percent invalid depth pixels in the manipulation region | Stated | Applies to every episode; depth behaviour on film and cartons is Not stated |
| Sync breach beyond the ceiling for more than three consecutive frames | Stated | Applies to every episode |
| Calibration drift beyond tolerance | Stated | Applies to every episode |
| Undocumented bystander | Stated | Applies to every episode; the episode is rejected |
| Mismatch against the named skill spec | Stated | Checked against the task and steps your spec names |
| Blur or sharpness rule | Not stated | Set in the spec if your policy needs one |
What is not stated
| Item | Status on this site | Where it is settled |
|---|---|---|
| Print tasks such as press operation, finishing, die-cutting or gluing | Not stated as task rows | The written spec |
| Machine, tool and equipment models | Not stated beyond the terms in the catalog rows | The written spec |
| Plant, line and facility types | Not stated beyond the environment examples | The written spec |
| Carton, film, paper and label types and sizes | Not stated | The written spec |
| Line speeds and throughput | Not stated | Quoted against your spec |
| Handling of logos, brand artwork and printed labels | Not stated | The written spec |
| Number of sites or episodes | Not stated | The written spec |
| Success or quality labels, robot results | Not stated | The written spec, if needed |
Formats
| Format | What the official documentation states | Used for here |
|---|---|---|
| RLDS | A dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README) | Episode-based training loaders |
| LeRobot | LeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation) | LeRobot dataset format and tooling |
| WebDataset | Tar files in which files that belong together share a basename, split into numbered shards (WebDataset README) | Sharded streaming for large training runs |
| HDF5 and zarr | Stated by Firsthand only | Array storage for custom pipelines |
| Rerun .rrd | Stated by Firsthand only | Multi-stream synchronized playback for review |
FAQ
Sources
Tell us the packaging or print tasks, the sequence and the capture mode your policy needs. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.