One row, two steps
The catalog describes the row as "Fill and hang a planted basket." Filling and planting is one step and hanging it is another, so a spec has to say whether one episode covers both or only one of them.
Now recruiting capture teams worldwide. Get paid to record first-person video of real work.
Apply to captureTask family
Why hanging baskets need their own spec
The catalog describes the row as "Fill and hang a planted basket." Filling and planting is one step and hanging it is another, so a spec has to say whether one episode covers both or only one of them.
Hands, the basket and the plants occupy the same small space during filling. Hand pose with a per-joint visibility flag marks the fingers that are hidden, which is the label that matters when the hands are inside the work.
The row’s capture setup is a multiview rig with handheld grippers, a staged working set whose demonstrations map onto a robot end effector. A request should say whether that, or a first-person rig, is what it needs.
The row is scoped and recruited to spec when a buyer asks for it. It is custom collection, with no off-the-shelf hanging basket dataset behind it.
Definition
Egocentric hanging basket planting data is recorded evidence of one person filling a basket, planting it and hanging it, collected by a paid, consented contributor who performs the task written in a skill spec. Each attempt is delivered as an episode with synchronized streams and labeled action segments. It is human capture. It is not robot or teleoperation data, and it is not a fixed corpus you download.
The site states the task in one row of its commercial task catalog. In the Greenhouse, Nursery & Garden Centre environment, the row "Fill hanging basket" reads: "Fill and hang a planted basket." It is an Easy row and its status is Available on request. The environment is described with the examples "Greenhouse / grow-bench set: pots, trays, plants, shears, stakes, crates". This page is built on that row and on the neighbouring greenhouse rows quoted below, and on nothing else the site says about baskets.
The word egocentric in the title needs a plain reading. Firsthand’s general offer is first-person capture, and the catalog lists a head-mounted phone for many rows. For this row the catalog lists something different: a multiview rig with handheld grippers. This page therefore describes the capture setup as the row states it, and treats first-person or stereo capture as a choice made in the skill spec, not as something the site promises here.
People reach this topic through hanging basket planting robot training data, an egocentric garden centre video dataset, a fill-and-hang planted basket dataset or custom nursery data collection. They describe one request from different angles. The work is the same: write the task down, collect it on demand and receive validated episodes.
Catalog row
One row covers it. "Fill hanging basket" sits under the Agriculture & Grounds sector in the Greenhouse, Nursery & Garden Centre environment. Its description is "Fill and hang a planted basket." Its skill rating is Easy, its capture setup is "Multiview rig + handheld grippers" and its status is "Available on request". The table below reproduces the row, and the rows beside it that this page refers to, as the catalog states them.
On the site, "Available on request" means the work is scoped and recruited to spec when a buyer asks for it. It does not mean hours are sitting in a library. This page claims no delivered hours for the row, and no off-the-shelf hanging basket dataset exists; the work is custom collection. The status is shown here exactly as the catalog lists it, and it is the same for every row in this environment.
The site names no basket type, no plant species, no growing medium, no bracket or hook and no hanging height. The words that appear are fill, hang, planted and basket, and this page uses only those. What a finished basket looks like, and where it is hung, is not stated. Those choices belong in the spec, and a Spec Pilot is the place to settle them.
Capture setup
The catalog states one capture setup for this row: "Multiview rig + handheld grippers". The site explains it as a staged working set recorded by a multiview rig while the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector. That is the description this page uses, and it is the only capture description this page makes for the row.
The site does not state a head-mounted phone for this row, and it states no stereo pair for it. A calibrated stereo pair is offered generally, and a head-mounted stereo rig is the instrumented tier of the general capture stack. If a program wants either for hanging baskets, it is agreed in the skill spec. The egocentric label in the title names the general first-person offer and the query people use; it is not a claim about this row’s rig.
The multiview setup is a sensible fit for a task with two phases, because synchronized third-person angles can show both the work at the bench and the hanging step from more than one side. That is an illustration of why a spec might ask for it, not a stated camera layout. A rig that records handheld grippers in the operator’s hands also lines up with the site’s stated reason for the setup: the demonstration maps onto a robot end effector. The site gives no camera count, resolution or frame rate specific to this row.
Episodes
Each attempt is delivered as one episode, and a two-part task needs a decision up front about what one attempt is. It could be filling and planting a basket, the hang step alone, one finished basket from empty to hung, or a run of several baskets. The site does not set an episode length, a number of baskets per episode or a number of episodes, so the skill spec does.
The cut matters because of one machine-checked rule. An episode is rejected if the manipulated object is out of frame for more than 15 percent of it. In this task the manipulated object changes: it is the basket and its contents at the bench, and the basket again as it is lifted and hung. The spec should say what counts as the manipulated object at each step so the rule is applied the same way across contributors.
A second rule applies to depth: an episode is also rejected if more than 35 percent of depth pixels are invalid in the manipulation region. The site says depth degrades on wet and reflective surfaces and ships per-frame confidence maps. It does not say how depth behaves on baskets or on planted foliage, so this page makes no accuracy claim for them.
Labels and delivery
Inside each episode, action segments divide the recording into start- and end-timestamped spans, each carrying start_ns, end_ns, verb and noun. For this task a segment can be one step as written in the skill spec, so a basket becomes a run of labeled steps, such as fill, plant and hang, with a noun for the item, rather than one long clip. Other standard fields include hand_joints and hand_visible for 3D hand pose, contact_events, objects and instance_masks, stored at the depth resolution of 848×480 so they line up with the depth stream.
Hand pose is delivered with a per-joint visibility flag for occluded fingers. That flag is the signal that matters when the hands are inside the basket among the plants. The site describes contact events as the moment the hand meets an object. It does not say which objects count in a hanging basket episode, so the spec settles what a contact event means for your task.
The site lists no label for the outcome of the basket. There is no stated fill-level, planting-quality or task-completion score, and no contact force reading. The catalog verbs describe what the contributor does, not a delivered measurement. The site states 6-DoF IMU data at 200 Hz from head- and wrist-mounted sensors, and nothing more about motion.
Delivery is in the format your stack already reads: RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, or raw streams with metadata. Readable converter source ships alongside the data so the schema can be retargeted to your own loader. The official documentation for three of these formats is linked in the sources below. Collections are billed per validated hour, and the license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default, with exclusivity available as a separate term.
Failure modes
Hand occlusion is the main one. While a basket is being filled and planted, the fingers, the plants and the basket occupy the same small space, and the hands go inside the work. The site’s answer is hand pose with a per-joint visibility flag, so a model can tell a hidden finger from a missing one, and multiview angles that see the hands from more than one side. The spec decides which angles matter for your task.
The second is the object leaving the frame. A basket is lifted, carried and hung, and the manipulated object can drop out of view or move to the edge of it. The 15 percent out-of-frame rule exists for that, and the episode is rejected rather than quietly accepted. Rejected items are recaptured at our cost, and only footage that clears the signed accept criteria is billed as a validated hour.
The third is ambiguity about what one object is. A planted basket is the basket plus what is in it, and a per-frame instance mask is only useful if the spec says what is one object. The site delivers per-frame instance masks where the spec calls for them, and it does not say how well they separate a basket from its plants, so this page claims nothing about it.
Why it matters
A fill-and-hang task is a useful shape of work because it chains two different kinds of manipulation in one short sequence: loading and arranging material in a container at a bench, and then lifting the finished container and placing it somewhere else. The site rates the row Easy, the same rating it gives to potting, produce packing and grading in the same environment. This page does not claim that any current robot performs the task.
First-person and multiview human video of the task sits at the base of the data pyramid the glossary explains, where volume is high and the gap to a robot body is widest. Human capture does not replace robot data, and this page does not claim that it does. The staged working set with handheld grippers is the site’s own way of narrowing that gap for rows like this one, because the demonstration is made with a tool that maps onto an end effector.
Privacy
Every contributor signs a written release before capture, and each delivered episode links to that record through consent artefact IDs in the batch data card. At ingest, automated detection finds faces, plates and screens and blurs them irreversibly, and speech is scrubbed of names, addresses and card numbers while ambient audio is kept. A human reviewer confirms that no un-consented person is identifiable in any frame, and footage that cannot be de-identified is discarded. An undocumented bystander is also one of the machine-checked reject criteria. The anonymization record is delivered with the data.
The site names no nursery, garden centre, grower, region or city for this row, and it lists capture at your own facility as not offered. This page therefore makes no claim that episodes are recorded at a particular site, and none that they are recorded at yours. Capture is run to your skill spec using the settings and contributors Firsthand arranges. The site states nothing specific about customers or staff who might be in a garden centre background, so this page makes no claim beyond the general process.
On handling safety, the site states no hanging, lifting or tool-safety protocol, no contributor safety protocol and no agricultural certification for this row, and this page does not describe one. If your program needs terms about the conditions under which the work is done, raise them when you scope it. None of this is legal advice, and the executed agreement controls.
Comparison
The table below sets this page against the neighbouring greenhouse and nursery pages on this site. Each row states the page’s main subject and the catalog rows it draws on, with the status as the catalog lists it. No delivered hours are claimed for any of them.
The short version: the potting page covers filling a pot, planting and watering, and replanting seedlings on the bench; the seed tray page covers sowing; the pruning and trellis page covers cutting and supporting stems; the staking and deadheading page covers clipping and trimming; the herb page covers bunching; the plant care page covers the wider run of gardening tasks. This page treats the basket, and the step of hanging it, as the subject. The plant care page lists the hanging basket row among many, and none of the other pages names it as a subject.
Speed and delivery
From signed spec to first validated batch, the site states a median of 48 hours where coverage is deep and three to four weeks where it is thin. It does not say whether the Greenhouse, Nursery & Garden Centre environment counts as deep or thin, so ask which timeline applies when you request the quote. Speed comes from a warm pipeline, not from cutting consent, review or anonymization.
The site also states program milestones: a pilot reaches its first delivery in two to three weeks, and a standing program reaches full rate in four to six weeks. Those assume capture coverage is already in place. After the first batch, on-demand top-ups run against the same accept criteria, so you can add settings or variations without rewriting the spec. The site does not state a turnaround for those later batches, so plan them in your quote.
The site does not publish a price list, a minimum order or a batch size for this row, so those are set in your quote. Collection is fast and on demand in the sense that you do not need a standing program: a focused brief is a normal starting point.
Off-the-shelf or custom
No. The site lists no off-the-shelf dataset for this task, and the catalog row is Available on request, so this is custom collection. The off-the-shelf catalog on this site covers other recordings; none of its entries is described as showing a planted basket being filled or hung, and this page does not borrow their figures.
The practical consequence is that nothing about this row is pre-recorded. Your spec defines the episode, the contributors are recruited to it, and the first validated batch is the first time the footage exists. A request for custom nursery data collection therefore starts from a written brief rather than from a catalog sample.
Not stated
Where this site does not state something, this page says "Not stated" rather than filling the gap. There is no basket type, no plant species, no growing medium, no bracket or hook type, no hanging height, no task duration, no site count, no region or city, no episode count, no planting-quality or completion label and no tool-safety guidance. Nothing here reports a robot result, a benchmark or a model improvement.
Counts of contributors, hours and tasks are set in your skill spec. A task outside the rows quoted on this page, such as a watering or labelling step the catalog does not name for this row, is settled in a Spec Pilot rather than assumed.
Getting started
Describe what one basket is, what filled and planted mean, where and how it is hung, and the variation or failure cases your pipeline is missing. That becomes a written skill spec, quoted for reach, timeline and price before any capture begins, and most programs run a Spec Pilot first, a small, fast first batch that proves the spec and the accept criteria on real footage before volume scales. The scoping checklist below maps the parts of a skill spec onto a basket request.
Three choices matter most. Name the step and the item rather than a broad activity, because that is what lets each fill and each hang become one action segment. Decide whether you want the capture setup the row states, a multiview rig with handheld grippers, or a first-person or stereo rig agreed in the spec. And name where the episode starts and stops, since the site does not set an episode length.
Capture setup
| Part | As stated on this site |
|---|---|
| Catalog capture setup for this row | Multiview rig + handheld grippers |
| What that setup means | A staged working set recorded by a multiview rig while the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector |
| Head-mounted or stereo capture for this row | Not stated for this row; agreed in the skill spec through the general offer |
| Streams in the general stack | Ten: 4K head camera, two wrist cameras, depth, IMU, 3D hand and body pose, instance segmentation, action labels |
| Sync | Hardware-triggered onto one PTP clock domain; aligned under 2 ms |
| Depth | Per-frame confidence maps are shipped; degrades on wet and reflective surfaces |
| IMU | 6-DoF at 200 Hz from head- and wrist-mounted sensors |
| Calibration | Twice per session; accepted only under the 0.28 px RMS reprojection gate |
| Masks | Per-frame instance masks where the spec calls for them, stored at 848×480 |
Every collection runs through the same seven-stage end-to-end custom collection pipeline.
Greenhouse rows
| Task (as listed) | Description (as listed) | Skill level | Capture setup | Status |
|---|---|---|---|---|
| Fill hanging basket | Fill and hang a planted basket. | Easy | Multiview rig + handheld grippers | Available on request |
| Pot plants | Fill a pot, plant, and water. | Easy | Multiview rig + handheld grippers | Available on request |
| Transplant seedlings | Lift and replant seedlings. | Medium | Multiview rig + handheld grippers | Available on request |
| Seed a tray | Place seeds into tray cells. | Medium | Multiview rig + handheld grippers | Available on request |
| Stake + clip plant | Stake and clip a stem for support. | Medium | Multiview rig + handheld grippers | Available on request |
| Trim + deadhead | Trim spent growth and deadhead. | Medium | Multiview rig + handheld grippers | Available on request |
Comparison
| Page | Main subject | Catalog rows it draws on | Status as listed |
|---|---|---|---|
| This page: egocentric hanging basket planting data | Filling, planting and hanging a basket | "Fill hanging basket" | Available on request |
| Egocentric plant potting and nursery data | Potting and transplanting on greenhouse and nursery benches | "Pot plants" and "Transplant seedlings" | Available on request |
| Egocentric seed tray sowing and transplanting data | Placing seeds into tray cells and replanting seedlings | "Seed a tray" and "Transplant seedlings" | Available on request |
| Egocentric pruning and trellis training data | Cutting, staking, clipping and weaving stems | "Prune with shears", "Stake + clip plant" and "Trellis training" | Available on request |
| Egocentric plant staking and deadheading data | Staking and clipping stems, trimming and deadheading spent growth | "Stake + clip plant" and "Trim + deadhead" | Available on request |
| Egocentric herb bunching and banding data | Gathering herbs into a bunch and banding it | "Bunch + band herbs" | Available on request |
| Egocentric plant care and gardening data | The wider run of watering, potting, hanging baskets, pruning, planting and harvesting | Several greenhouse rows, including "Fill hanging basket" | Available on request on the greenhouse rows |
Where it is named
| Where | Wording on the site | What it tells you |
|---|---|---|
| Commercial task catalog: Greenhouse, Nursery & Garden Centre | "Fill hanging basket": "Fill and hang a planted basket." | Easy row, available on request |
| Commercial task catalog: capture setup | "Multiview rig + handheld grippers" | A staged working set captured with handheld grippers |
| Commercial task catalog: environment examples | "Greenhouse / grow-bench set: pots, trays, plants, shears, stakes, crates" | Describes the setting by set, not by grower |
| Commercial task catalog: status | "Available on request": scoped and recruited to spec when a buyer asks for it | Custom collection, not a library |
| Egocentric plant care and gardening data page | Lists filling hanging baskets among the greenhouse and nursery rows and rates it Easy | The task is named there as one of many rows |
| Basket types, plant species, growing media, brackets or hooks, hanging height, task duration, site count, region, episode count, success label | Not stated | Settled in the skill spec; not claimed here |
| Lifting and hanging safety | Not stated | Not described on this page |
Streams and labels
| Stream or label | What it gives a hanging basket episode | Status |
|---|---|---|
| Multiview angles | Synchronized third-person views of the hands and the basket | The row’s stated capture setup |
| Depth with confidence maps | Scene geometry, with a confidence map to mask low-confidence regions | Delivered |
| 6-DoF IMU at 200 Hz | Head and wrist motion aligned to the video frame | Delivered |
| 3D hand pose with per-joint visibility flags | Hand detail through the filling; occluded fingers flagged. How it applies when the operator holds grippers is not stated | Delivered as a general stream |
| Contact events | The moment the hand meets an object | Delivered |
| Action segments (start_ns, end_ns, verb, noun) | One labeled span per step, such as fill, plant or hang, with the item as the noun | Delivered |
| Per-frame instance masks (848×480) | Masks where the spec calls for them | Delivered where specified |
| Consent artefact IDs and anonymization record | Provenance per episode | Delivered |
| Fill-level, planting-quality or completion label | Not listed | Not stated |
| Contact force or tactile readings | Not among the listed streams | Not stated |
| Robot or teleoperation data | Human demonstrations only | Not captured |
| Counts of contributors, hours, tasks and episodes | Set per program in the skill spec | Not stated |
Delivery formats
| Format | What the official documentation states | Official source |
|---|---|---|
| RLDS | An ecosystem of tools to store, retrieve and manipulate episodic data; a dataset is a set of episodes, each holding steps and metadata | RLDS repository (GitHub) |
| LeRobot | LeRobotDataset v3.0 stores many episodes per Parquet and MP4 file, with episode boundaries, lengths and tasks resolved through metadata | LeRobot dataset v3 docs (Hugging Face) |
| WebDataset | Tar files in which files that share a basename make up one training sample, split into numbered shards | WebDataset repository (GitHub) |
| HDF5, zarr, Rerun .rrd, raw streams with metadata | Listed as delivery options on this site; not documented on this page | Not stated here |
Scoping checklist
| Skill-spec part | What to name for a hanging basket request | Drawn from what the site states |
|---|---|---|
| Named skill | The verb and the noun for each step: fill a basket, plant it, hang it. Not "planting" | Catalog wording: "Fill and hang a planted basket." |
| Catalog row and capture setup | The row you mean, and whether you want its multiview rig with handheld grippers or a different rig agreed in the spec | The catalog lists "Multiview rig + handheld grippers" for this row |
| Geometry that must be visible | What must be in frame and for how long: both hands, the basket and the plants, and the basket as it is hung | Set in the skill spec |
| Condition budget in hours | Hours per condition cell, including basket set-ups, bench layouts and failure cases | Set per program in the skill spec |
| Reject rule | The conditions that fail an item, written first | Object out of frame for more than 15 percent of the episode; more than 35 percent invalid depth pixels in the manipulation region; an undocumented bystander |
| Acceptance test | One test that decides whether an attempt counts as complete | Your acceptance test is agreed in the spec |
| Episode boundary | Fill only, hang only, one basket from empty to hung, or a run of several | Set in the skill spec; the site does not state an episode length |
Example footage
One real clip already published on this site, shown as a format example: a first-person view with faces blurred. It does not show a nursery, a garden centre, a basket or planting, and it was not recorded with the row’s multiview rig and handheld grippers.
No hanging basket clip is published on the site, so this is labelled as a format example. Request a sample to see delivered files. See sample data outputs, request an egocentric data sample.
FAQ
Sources
Tell us what one basket is, what filled and planted mean, where and how it is hung, and the variation or failure cases your pipeline needs covered. We will turn it into a written skill spec and run a Spec Pilot before scaling to a full collection.