A named bench sequence
Filling a pot, planting, watering, lifting a seedling and replanting it are different steps, so a spec names each one and the order it should run in.
Task family
Requirements
Filling a pot, planting, watering, lifting a seedling and replanting it are different steps, so a spec names each one and the order it should run in.
The capture setup keeps the hands, the pot, tray or seedling and the growing medium in view through the whole sequence, with the multiview rig adding synchronized angles on the bench.
3D hand pose with per-joint visibility carries the finger detail of filling a pot, setting a plant in it and lifting a seedling.
Frame-accurate action segments mark where filling ends, where planting becomes watering and where a lift-and-replant step starts and stops, aligned to video and depth.
A perpetual, buyer-owned commercial license backed by a documented consent chain.
Definition
Egocentric plant potting and nursery data is real-world, first-person video of a person potting plants and handling nursery stock on greenhouse and nursery benches. The site states two catalog rows for this under Greenhouse, Nursery & Garden Centre: Pot plants, which reads "Fill a pot, plant, and water," and Transplant seedlings, which reads "Lift and replant seedlings." It is recorded from the worker viewpoint, with depth, 3D hand pose, contact events and frame-accurate action segments aligned on one hardware clock, against a written spec.
People search for this under several names: plant potting robot training data, a nursery task video dataset, egocentric greenhouse data or custom horticulture data collection. They describe the same thing, a record of how a person fills a pot, settles a plant into it or moves a seedling into a new container, seen from the person own point of view, with both hands and the bench in frame.
Potting and transplanting are not the same as general plant care or farm fieldwork. The site also states a separate row, Plant and transplant seedlings using a hand trowel and seedling trays, under Farm & Field Operations, which reads "Take seedlings from trays, dig with a trowel and plant them at spacing along the row." That is outdoor row planting with a trowel, not bench potting, so this page keeps the two apart and treats the farm row as a neighbour rather than part of its own task set.
This page states only what the site already states. Where a detail is not in the catalog or the delivery terms, it is marked Not stated and left for the written spec.
Setting
The catalog states two rows that match a potting or transplanting query. Both sit in the Greenhouse, Nursery & Garden Centre environment, in the Agriculture & Grounds sector, and both are listed as Available on request. Pot plants is rated Easy, and Transplant seedlings is rated Medium. The environment examples read "Greenhouse / grow-bench set: pots, trays, plants, shears, stakes, crates," so both rows are listed on a bench set alongside pruning, trimming, grading and crate-packing rows.
The verbs in the two rows are the verbs a spec can build on: fill a pot, plant, water, lift a seedling and replant it. A buyer who needs only one stage, for example filling and watering a pot, can ask for that stage in the spec, and one who needs both rows covered can ask for them together. The catalog does not split either row into finer steps, so any split is a spec choice and not a stated task list.
The site does not state which plant species, pot or tray types, growing media or tools are used, how many pots or trays a session covers, or what a finished bench looks like. Those are Not stated and are set in the written spec before capture begins.
The Farm & Field Operations environment lists a related row, Plant and transplant seedlings using a hand trowel and seedling trays, with the examples line "Farm fieldwork, greenhouse, orchard, vineyard -- harvesting, planting, pruning, irrigation, equipment operation." That row covers trowel planting along an outdoor row rather than bench potting, so this page treats it as a neighbouring task and not as part of the potting and nursery task set.
Streams and labels
Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact events on grasp and release, and frame-accurate action segments. For potting and transplanting, hand pose tracks the fingers on a pot or a seedling, contact events mark when fingers meet a pot, a plant or a seedling, and action segments mark each step of the sequence.
The site also states 200 Hz 6-DoF IMUs on the Firsthand capture rig. Both potting rows list the capture mode Multiview rig + handheld grippers, which the site describes as a staged working set recorded by a multiview rig while the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector. Confirm the stream list in the spec before you plan a training pipeline around a specific sensor.
Object labels use the terms your spec sets. Plant species, pot or tray types, growing media, tools, and a potting-outcome or task-completion label are Not stated. If your policy needs a label such as "seedling settled" or "pot filled," define it in the spec and the accept criteria. This page makes no head or camera pose, mapping or SLAM claim as a deliverable.
Delivery
Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. The format table below sets each against what its official documentation states. Potting and nursery episodes use the same schema as every other Firsthand collection, so a loader that reads another Firsthand dataset reads this one without changes.
Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch. Rejected items are recaptured at our cost. Billing is per validated hour, and every collection ships under a perpetual, buyer-owned commercial license.
The site does not state a number of episodes, a batch size or a total hour count for either row, so those are quoted against your spec and not assumed here.
Why it matters
Potting and transplanting are hand work with living plants. A person fills a pot, plants and waters, or lifts a seedling and replants it. A policy that is meant to learn this sequence needs to see how the hands move and when they touch the plant and the pot, not only the finished state of the bench.
First-person video suits that need because the view follows the worker, so the pot rim, the seedling and the hands stay in view. 3D hand pose and contact events add the finger-level detail that plain video leaves implicit, and action segments mark where each step starts and stops so a model can learn the order as well as the motion.
This page quotes no robot result, no recovery rate, no throughput figure and no benchmark. It also does not claim that any model has been trained on this data, and it makes no plant-health, yield, chemical, pesticide, fertilizer, safety or certification claim. The site states two catalog tasks and a capture and delivery method, and the value to a given policy is something a pilot can test against your own accept criteria.
Setting and privacy
For the capture mode both rows use, the site describes a staged working set recorded by a multiview rig while the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector. That is a staged set rather than a claim of recording unstaged real-time work, and it is the only capture mode this page states for potting and transplanting.
The site does not state whose bench that is, how many sites a collection uses, or which regions or cities are covered for either row. Elsewhere it states that Firsthand does not capture at a customer own facility, so this page makes no claim of capture there. Environment, access and schedule are agreed in the spec.
Every episode links to a signed contributor release through a documented consent chain, and the consent record is part of the delivery. Faces, plates and screens are detected and irreversibly blurred at ingest, and a reviewer confirms the result before anything ships. The anonymization record is delivered with the data.
That is the whole of the privacy wording the site states. It does not state a rule for data stored on a device, so none is claimed here, and raise it in the spec if it matters to you. This page also makes no plant-health, yield, chemical, pesticide, fertilizer, safety or certification claim.
Fast · on demand
The catalog lists both potting rows as Available on request. The site defines that status as scoped and recruited to spec when a buyer asks for it, so this is not a row where recording is already running. Its timeline is quoted against your spec before any capture begins.
The site publishes two per-batch speed figures. Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front. The site does not state which of the two applies to plant potting and nursery work, so the quote says.
On-demand top-ups run against the same spec and accept criteria after each training run. The site does not state a batch size or a later-batch turnaround for either row, so those are quoted against your spec.
The spec
You describe the potting or transplanting sequence your policy needs. We turn that into a written spec covering tasks, environments, capture tier, annotation depth and accept criteria, then quote reach, timeline and price before any capture begins.
A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Billing is per validated hour, a reject log ships with every batch, rejected items are recaptured at our cost, and every collection ships under a perpetual, buyer-owned commercial license.
Useful things to settle in the spec are the stages you want covered, the plant and container types, the growing medium, any label you want for step success, and the formats you want delivered. Each of those is Not stated by the site today, which is why the spec is where they are written down.
At a glance
Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.
What the site states
| Where it appears | What the site states | Used on this page as |
|---|---|---|
| Task catalog, Greenhouse, Nursery & Garden Centre environment | Pot plants: "Fill a pot, plant, and water," rated Easy and Available on request | The stated potting task |
| Task catalog, Greenhouse, Nursery & Garden Centre environment | Transplant seedlings: "Lift and replant seedlings," rated Medium and Available on request | The stated nursery transplant task |
| Environment examples line | "Greenhouse / grow-bench set: pots, trays, plants, shears, stakes, crates" | Context: both rows sit on a shared bench set |
| Task catalog, Farm & Field Operations environment | Plant and transplant seedlings using a hand trowel and seedling trays: "Take seedlings from trays, dig with a trowel and plant them at spacing along the row," rated Medium and listed as Active collection | A neighbouring, outdoor row-planting task; not part of this page task set |
| Capture mode description | A staged working set recorded by a multiview rig while the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector | How capture is described for both potting rows |
Catalog rows
| Task family | Catalog task and description | Skill | Status |
|---|---|---|---|
| Target task, potting | Pot plants: fill a pot, plant, and water | Easy | Available on request |
| Target task, nursery transplant | Transplant seedlings: lift and replant seedlings | Medium | Available on request |
| Neighbour, pruning | Prune with shears: cut stems at the node with shears | Medium | Available on request |
| Neighbour, sowing | Seed a tray: place seeds into tray cells | Medium | Available on request |
| Neighbour, grading and packing | Sort + grade produce and Pack produce crate: grade produce by size and quality, and pack graded produce into crates | Easy | Available on request |
Streams and labels
| Item | Status on this site | Why it matters for plant potting and nursery data |
|---|---|---|
| Head and wrist RGB, depth | Stated; ten streams synced under 2 ms | Keeps the pot, tray and hands on one timeline |
| 3D hand pose, per-joint visibility | Stated | Carries the finger detail of filling a pot and handling a seedling |
| Contact events on grasp and release | Stated | Marks when fingers meet a pot, a plant or a seedling |
| Action segments | Stated; frame-accurate | Separates filling, planting, watering, lifting and replanting |
| 200 Hz 6-DoF IMUs | Stated for the Firsthand capture rig; whether a given collection includes them is set in the spec | Motion signal for pipelines that use it |
| Plant species, pot or tray types, growing media | Not stated; the rows name pots, trays, plants and seedlings only | Defined in the spec |
| Number of pots, trays, episodes or hours | Not stated | Quoted against the spec |
| Task durations, throughput | Not stated | Defined in the spec if needed |
| Potting-outcome or success label | Not stated | Defined in the spec if needed |
| Number of sites, regions or cities | Not stated | Agreed in the spec |
Formats
| Format | What the official documentation states | Used for here |
|---|---|---|
| RLDS | A dataset is retrieved as a tf.data.Dataset of episodes, and each episode contains a dataset of steps (RLDS repository README) | Episode-based training loaders |
| LeRobot | LeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation) | LeRobot dataset format and tooling |
| WebDataset | Tar files in which files that belong together share a basename, with shards numbered like something-000000.tar (WebDataset README) | Sharded streaming for large training runs |
| HDF5 and zarr | Stated by Firsthand only | Array storage for custom pipelines |
| Rerun .rrd | Stated by Firsthand only | Multi-stream synchronized playback for review |
FAQ
Sources
Tell us the plants, containers and bench sequence your policy needs to handle. We will quote reach, timeline, and price against a written spec before any capture begins.