A named produce task list
Sorting, cleaning, weighing, labelling, packing and grading are different sequences, so a spec names each one and the produce it covers.
Task family
Requirements
Sorting, cleaning, weighing, labelling, packing and grading are different sequences, so a spec names each one and the produce it covers.
A head-mounted view keeps both hands, the tray or clamshell and the item in view while fruit is picked, checked and placed.
3D hand pose with per-joint visibility carries how the fingers pick, turn and set each item from the first touch to the closed container.
Frame-accurate action segments mark where sorting ends, where weighing starts and where packing and labelling begin, aligned to video and depth.
A perpetual, buyer-owned commercial license backed by a documented consent chain.
Why it matters
Egocentric produce packing and grading video data is real-world, first-person video of produce handling in a packhouse or on a farm. It is recorded from the worker viewpoint, with depth, 3D hand pose, contact events and frame-accurate action segments aligned on one hardware clock. The tasks it covers are the ones the site states in its task catalog: sorting and cleaning strawberries, weighing, packing, sealing and labelling them into clamshell containers, packing graded produce into crates, and grading crops by size and quality.
The packing and kitting page covers packing work in general, and the sorting task page covers sorting in general. Neither is about fruit and vegetables. This page covers the produce sequence, from the first item picked off a sorting table to a labelled, closed container.
Setting
The site states produce packing in its task catalog, in a Produce Packing Facility environment under the Agriculture & Grounds sector. The environment lists three rows, all about fresh strawberries, and its examples are a farm packhouse with sorting tables, weighing stations and packing lines.
Three more rows state produce grading or packing in two other agriculture environments: Crop Sorting & Grading under Farm & Field Operations, and Pack produce crate and Sort + grade produce under Greenhouse, Nursery & Garden Centre. This page uses all six rows and lists their skill rating and status as the catalog states them.
Sorting
The catalog row reads "Inspect, clean, and sort fresh strawberries, removing stems and damaged fruit, using sorting trays and collection bins." Its description is a strawberry farm processing area with sorting tables and washing stations. It is the stated inspection and culling task, and it comes before any weighing or packing.
The row is rated Easy and is Available on request. It names strawberries, stems and damaged fruit. The site does not state what counts as damaged, so the defect rule is set in the written spec.
Packing
The catalog row reads "Sort, weigh, pack, and label fresh strawberries into clamshell containers using a bench scale and a label gun." Its description is a produce packing facility with sorting tables, weighing stations and a dedicated packing line. One row therefore covers the whole run from sorting to a labelled container.
The row is rated Easy and is Available on request. Clamshell sizes, pack counts and target weights are Not stated, so they are set in the spec.
Sealing
The catalog row reads "Weigh, pack, seal, and label fresh strawberries into clamshell containers using a bench scale and a label gun." It starts at weighing, so it leaves out the sorting step, and it adds sealing the container before the label goes on.
The row is rated Easy and is Available on request. The site does not describe a scale reading or a label as a recorded field, so neither is claimed here.
Grading
The Farm & Field Operations environment lists a Crop Sorting & Grading row that reads "Sort harvested crops by size and quality, discard damaged items and grade into crates." It is the stated grading task, and it names crops in general, not one fruit.
The row is rated Easy and is listed as Ready to deploy. Grade classes and grading standards are Not stated, so the spec sets the classes and what each one means.
Crates
The Greenhouse, Nursery & Garden Centre environment lists two produce rows. Pack produce crate reads "Pack graded produce into crates," and Sort + grade produce reads "Grade produce by size and quality." Both are rated Easy and Available on request.
The site does not state why their capture mode differs from the packing rows, so choose the mode in the spec.
What is not covered
A Field Crate Loading & Hauling row fills, stacks and hauls field crates, a Harvest and sort produce row cuts produce with shears, and a retail Produce handling row unpacks crates, trims and culls items and stacks displays. They name produce, but they are hauling, harvesting and shelf work, so they are listed as neighbours and not counted.
Generic packing, kitting, sorting, parcel and grocery put-away lines on the site do not name fruit, vegetables or produce. They have their own pages and are not counted here.
Environments
The catalog places the packing rows in a farm packhouse and the grading rows on a farm and in a greenhouse or grow-bench set. The site names no farm, packhouse, city or region, and it does not state capture at a customer own farm, packhouse or facility.
Environment, access and schedule are agreed in the spec. The number of facilities and the seasons covered are Not stated.
Capture setup
A head-mounted phone records the first-person view of real work on site, and a multiview rig adds synchronized third-person angles when the spec asks for them. The greenhouse rows list a multiview rig with handheld grippers instead.
The site does not state a camera count, resolution or frame rate for produce work. Line speed and throughput are Not stated, so session length and volume are quoted against your spec.
Streams and labels
Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact and grasp events, and frame-accurate action segments. For produce, hand pose tracks how the fingers pick and place each item, contact events mark when fingers meet fruit, a tray or a container, and action segments mark each step.
Object labels use the terms your spec sets. Force or tactile data, and defect or quality-outcome labels, are Not stated. They are defined in the spec if your policy needs them.
Delivery
Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. The format table below sets each against what its official documentation states.
Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch.
Privacy
Every episode links to a signed contributor release through a documented consent chain, and the consent record is part of the delivery. Faces, plates and screens are detected and irreversibly blurred at ingest, and a reviewer confirms the result before anything ships. The anonymization record is delivered with the data.
The site states no further privacy rule specific to packhouses or farms, so this page makes none. The consent chain, the blur pass and the anonymization record are the stated privacy steps.
Fast · on demand
Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front.
On-demand top-ups run against the same spec and accept criteria after each training run. Most produce rows are Available on request, so the site states no capture timeline for them beyond a quote against your spec.
The spec
You describe the produce, steps and sequence your policy needs. We turn that into a written spec covering tasks, environments, capture tier, annotation depth and accept criteria, then quote reach, timeline and price before any capture begins.
A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Billing is per validated hour, a reject log ships with every batch, rejected items are recaptured at our cost, and every collection ships under a perpetual, buyer-owned commercial license.
At a glance
Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.
Catalog rows
| Task family | Catalog task and description | Skill | Status |
|---|---|---|---|
| Sort and clean | Inspect, clean, and sort fresh strawberries, removing stems and damaged fruit, using sorting trays and collection bins: strawberry farm processing area with sorting tables and washing stations | Easy | Available on request |
| Sort, weigh, pack, label | Sort, weigh, pack, and label fresh strawberries into clamshell containers using a bench scale and a label gun | Easy | Available on request |
| Weigh, pack, seal, label | Weigh, pack, seal, and label fresh strawberries into clamshell containers using a bench scale and a label gun | Easy | Available on request |
| Grading, farm | Crop Sorting & Grading: sort harvested crops by size and quality, discard damaged items and grade into crates | Easy | Ready to deploy |
| Crates, greenhouse | Pack produce crate: pack graded produce into crates | Easy | Available on request |
| Grading, greenhouse | Sort + grade produce: grade produce by size and quality | Easy | Available on request |
| Neighbour, retail | Produce handling: unpack produce crates, trim and cull items, stack displays and mist or rotate stock | Easy | Available on request |
Streams and tasks
| Stream or label | Status on this site | What it carries in a produce episode |
|---|---|---|
| Head and wrist RGB, depth | Stated; ten streams synced under 2 ms | Keeps the item, the container and both hands on one timeline |
| 3D hand pose, per-joint visibility | Stated | Carries how the fingers pick, turn and place each item |
| Contact and grasp events | Stated | Marks when fingers meet fruit, a tray, a clamshell or a crate |
| Action segments | Stated; frame-accurate | Separates sorting, weighing, packing, sealing and labelling |
| Object labels | Set by your spec | Names the produce and steps in the terms your policy uses |
What is not stated
| Item | Status on this site | Where it is settled |
|---|---|---|
| Crop or variety lists beyond strawberries | Not stated; the grading rows name crops and produce only | The written spec |
| Grading standards, grade classes | Not stated | The written spec |
| Line speeds, throughput | Not stated | Quoted against your spec |
| Pack counts, clamshell or case formats | Not stated; clamshell containers are named only | The written spec |
| Number of facilities or workers, seasons | Not stated | The written spec |
| Defect or quality-outcome labels | Not stated | The written spec, if needed |
| Force or tactile data | Not stated | The written spec, if needed |
Formats
| Format | What the official documentation states | Used for here |
|---|---|---|
| RLDS | A dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README) | Episode-based training loaders |
| LeRobot | LeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation) | LeRobot dataset format and tooling |
| WebDataset | Tar files in which files that belong together share a basename, split into numbered shards (WebDataset README) | Sharded streaming for large training runs |
| HDF5 and zarr | Stated by Firsthand only | Array storage for custom pipelines |
| Rerun .rrd | Stated by Firsthand only | Multi-stream synchronized playback for review |
FAQ
Sources
Tell us the produce, steps and sequence your policy needs to handle. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.