Task family

Egocentric Produce Packing and Grading Video Data

Sorting and cleaning strawberries, weighing and labelling clamshells, packing graded produce into crates and grading crops by size and quality, captured first-person against a spec you write, for produce packing robot training data and fast, on-demand custom agriculture collection.
Streams
Ten, synced under 2 ms
First batch
Median 48 h where coverage is deep
Billing
Per validated hour
License
Buyer-owned

Requirements

What does produce packing and grading data need?

01

A named produce task list

Sorting, cleaning, weighing, labelling, packing and grading are different sequences, so a spec names each one and the produce it covers.

02

Both hands and the produce in frame

A head-mounted view keeps both hands, the tray or clamshell and the item in view while fruit is picked, checked and placed.

03

Hand pose through every pick and place

3D hand pose with per-joint visibility carries how the fingers pick, turn and set each item from the first touch to the closed container.

04

Step boundaries on the same clock

Frame-accurate action segments mark where sorting ends, where weighing starts and where packing and labelling begin, aligned to video and depth.

05

Rights you can ship on

A perpetual, buyer-owned commercial license backed by a documented consent chain.

Why it matters

What is egocentric produce packing and grading video data, and why does it need its own page?

Egocentric produce packing and grading video data is real-world, first-person video of produce handling in a packhouse or on a farm. It is recorded from the worker viewpoint, with depth, 3D hand pose, contact events and frame-accurate action segments aligned on one hardware clock. The tasks it covers are the ones the site states in its task catalog: sorting and cleaning strawberries, weighing, packing, sealing and labelling them into clamshell containers, packing graded produce into crates, and grading crops by size and quality.

The packing and kitting page covers packing work in general, and the sorting task page covers sorting in general. Neither is about fruit and vegetables. This page covers the produce sequence, from the first item picked off a sorting table to a labelled, closed container.

Setting

Which produce tasks can be captured?

The site states produce packing in its task catalog, in a Produce Packing Facility environment under the Agriculture & Grounds sector. The environment lists three rows, all about fresh strawberries, and its examples are a farm packhouse with sorting tables, weighing stations and packing lines.

Three more rows state produce grading or packing in two other agriculture environments: Crop Sorting & Grading under Farm & Field Operations, and Pack produce crate and Sort + grade produce under Greenhouse, Nursery & Garden Centre. This page uses all six rows and lists their skill rating and status as the catalog states them.

Sorting

How is the strawberry sorting row described?

The catalog row reads "Inspect, clean, and sort fresh strawberries, removing stems and damaged fruit, using sorting trays and collection bins." Its description is a strawberry farm processing area with sorting tables and washing stations. It is the stated inspection and culling task, and it comes before any weighing or packing.

The row is rated Easy and is Available on request. It names strawberries, stems and damaged fruit. The site does not state what counts as damaged, so the defect rule is set in the written spec.

Packing

How is the sort, weigh, pack and label row described?

The catalog row reads "Sort, weigh, pack, and label fresh strawberries into clamshell containers using a bench scale and a label gun." Its description is a produce packing facility with sorting tables, weighing stations and a dedicated packing line. One row therefore covers the whole run from sorting to a labelled container.

The row is rated Easy and is Available on request. Clamshell sizes, pack counts and target weights are Not stated, so they are set in the spec.

Sealing

How is the weigh, pack, seal and label row described?

The catalog row reads "Weigh, pack, seal, and label fresh strawberries into clamshell containers using a bench scale and a label gun." It starts at weighing, so it leaves out the sorting step, and it adds sealing the container before the label goes on.

The row is rated Easy and is Available on request. The site does not describe a scale reading or a label as a recorded field, so neither is claimed here.

Grading

How is crop grading covered on the farm?

The Farm & Field Operations environment lists a Crop Sorting & Grading row that reads "Sort harvested crops by size and quality, discard damaged items and grade into crates." It is the stated grading task, and it names crops in general, not one fruit.

The row is rated Easy and is listed as Ready to deploy. Grade classes and grading standards are Not stated, so the spec sets the classes and what each one means.

Crates

How are crate packing and produce grading covered in the greenhouse environment?

The Greenhouse, Nursery & Garden Centre environment lists two produce rows. Pack produce crate reads "Pack graded produce into crates," and Sort + grade produce reads "Grade produce by size and quality." Both are rated Easy and Available on request.

The site does not state why their capture mode differs from the packing rows, so choose the mode in the spec.

What is not covered

Which neighbouring rows are not produce packing tasks?

A Field Crate Loading & Hauling row fills, stacks and hauls field crates, a Harvest and sort produce row cuts produce with shears, and a retail Produce handling row unpacks crates, trims and culls items and stacks displays. They name produce, but they are hauling, harvesting and shelf work, so they are listed as neighbours and not counted.

Generic packing, kitting, sorting, parcel and grocery put-away lines on the site do not name fruit, vegetables or produce. They have their own pages and are not counted here.

Environments

Where is produce packing work captured?

The catalog places the packing rows in a farm packhouse and the grading rows on a farm and in a greenhouse or grow-bench set. The site names no farm, packhouse, city or region, and it does not state capture at a customer own farm, packhouse or facility.

Environment, access and schedule are agreed in the spec. The number of facilities and the seasons covered are Not stated.

Capture setup

How is produce work captured from a first-person view?

A head-mounted phone records the first-person view of real work on site, and a multiview rig adds synchronized third-person angles when the spec asks for them. The greenhouse rows list a multiview rig with handheld grippers instead.

The site does not state a camera count, resolution or frame rate for produce work. Line speed and throughput are Not stated, so session length and volume are quoted against your spec.

Streams and labels

What does each produce episode contain?

Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact and grasp events, and frame-accurate action segments. For produce, hand pose tracks how the fingers pick and place each item, contact events mark when fingers meet fruit, a tray or a container, and action segments mark each step.

Object labels use the terms your spec sets. Force or tactile data, and defect or quality-outcome labels, are Not stated. They are defined in the spec if your policy needs them.

Delivery

How is produce packing data labeled and delivered?

Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. The format table below sets each against what its official documentation states.

Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch.

Privacy

How is privacy handled when capturing produce work?

Every episode links to a signed contributor release through a documented consent chain, and the consent record is part of the delivery. Faces, plates and screens are detected and irreversibly blurred at ingest, and a reviewer confirms the result before anything ships. The anonymization record is delivered with the data.

The site states no further privacy rule specific to packhouses or farms, so this page makes none. The consent chain, the blur pass and the anonymization record are the stated privacy steps.

Fast · on demand

How fast can a custom produce dataset be collected?

Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front.

On-demand top-ups run against the same spec and accept criteria after each training run. Most produce rows are Available on request, so the site states no capture timeline for them beyond a quote against your spec.

The spec

How do you start a pilot?

You describe the produce, steps and sequence your policy needs. We turn that into a written spec covering tasks, environments, capture tier, annotation depth and accept criteria, then quote reach, timeline and price before any capture begins.

A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Billing is per validated hour, a reject log ships with every batch, rejected items are recaptured at our cost, and every collection ships under a perpetual, buyer-owned commercial license.

At a glance

What you get.

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

Catalog rows

Which catalog rows cover produce packing and grading?

The six produce packing and grading rows with the catalog description, skill rating and status as listed, plus the neighbouring retail row. The three packing rows list a head-mounted phone or multiview rig as capture mode, and the greenhouse rows list a multiview rig with handheld grippers.
Task familyCatalog task and descriptionSkillStatus
Sort and cleanInspect, clean, and sort fresh strawberries, removing stems and damaged fruit, using sorting trays and collection bins: strawberry farm processing area with sorting tables and washing stationsEasyAvailable on request
Sort, weigh, pack, labelSort, weigh, pack, and label fresh strawberries into clamshell containers using a bench scale and a label gunEasyAvailable on request
Weigh, pack, seal, labelWeigh, pack, seal, and label fresh strawberries into clamshell containers using a bench scale and a label gunEasyAvailable on request
Grading, farmCrop Sorting & Grading: sort harvested crops by size and quality, discard damaged items and grade into cratesEasyReady to deploy
Crates, greenhousePack produce crate: pack graded produce into cratesEasyAvailable on request
Grading, greenhouseSort + grade produce: grade produce by size and qualityEasyAvailable on request
Neighbour, retailProduce handling: unpack produce crates, trim and cull items, stack displays and mist or rotate stockEasyAvailable on request

Streams and tasks

How do the stated streams map to produce tasks?

The streams the site states for Firsthand custom collections, set against what each carries in a produce episode.
Stream or labelStatus on this siteWhat it carries in a produce episode
Head and wrist RGB, depthStated; ten streams synced under 2 msKeeps the item, the container and both hands on one timeline
3D hand pose, per-joint visibilityStatedCarries how the fingers pick, turn and place each item
Contact and grasp eventsStatedMarks when fingers meet fruit, a tray, a clamshell or a crate
Action segmentsStated; frame-accurateSeparates sorting, weighing, packing, sealing and labelling
Object labelsSet by your specNames the produce and steps in the terms your policy uses

What is not stated

Which produce details does the site not state?

Produce fields the site does not state, and where each one is settled.
ItemStatus on this siteWhere it is settled
Crop or variety lists beyond strawberriesNot stated; the grading rows name crops and produce onlyThe written spec
Grading standards, grade classesNot statedThe written spec
Line speeds, throughputNot statedQuoted against your spec
Pack counts, clamshell or case formatsNot stated; clamshell containers are named onlyThe written spec
Number of facilities or workers, seasonsNot statedThe written spec
Defect or quality-outcome labelsNot statedThe written spec, if needed
Force or tactile dataNot statedThe written spec, if needed

Formats

Which formats carry produce packing data?

Delivery formats stated on the site, set against what each format official documentation states where the documentation was read.
FormatWhat the official documentation statesUsed for here
RLDSA dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README)Episode-based training loaders
LeRobotLeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation)LeRobot dataset format and tooling
WebDatasetTar files in which files that belong together share a basename, split into numbered shards (WebDataset README)Sharded streaming for large training runs
HDF5 and zarrStated by Firsthand onlyArray storage for custom pipelines
Rerun .rrdStated by Firsthand onlyMulti-stream synchronized playback for review

FAQ

Produce packing robot training data, answered.

What is egocentric produce packing and grading video data?
Real-world, first-person video of produce sorting, weighing, packing and grading, such as cleaning and sorting strawberries, packing them into clamshell containers and grading crops into crates, captured against a written spec with 3D hand pose, depth and action segments.
Which produce tasks does the site state?
The task catalog lists three strawberry rows in a Produce Packing Facility environment, plus Crop Sorting & Grading, Pack produce crate and Sort + grade produce in two other agriculture environments. All six are rated Easy.
Does the site state crop lists, grade classes, line speeds or pack counts?
No. Strawberries and clamshell containers are named, but other crops, grading standards, line speeds, pack counts and formats are Not stated, and the site does not state capture at a customer own farm, packhouse or facility.
Are force data or defect labels included?
Not stated. They are defined in the written spec if your policy needs them. The site states hand pose, depth, contact events and action segments.
How is privacy handled?
Faces, plates and screens are detected and irreversibly blurred at ingest, and a reviewer confirms the result. Each episode links to a signed contributor release, and the anonymization record ships with the data.
How fast can a custom produce dataset be collected?
Where coverage is deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, and most produce rows are quoted against your spec.
How do you start a pilot?
Describe the produce, steps and sequence you need. We write a spec, quote against it, and a Spec Pilot proves the accept criteria before you scale.

Sources

Where are the delivery formats documented?

Request a custom dataset.

Tell us the produce, steps and sequence your policy needs to handle. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.