Now recruiting capture teams worldwide. Get paid to record first-person video of real work.

Apply to capture

Task family

Egocentric Retail Backroom Organization Data

Sorting stock onto labelled racks and bins, breaking down cartons, clearing the aisles and inspecting and sorting damaged goods in a store stockroom, captured first-person against a spec you write, for retail backroom robot training data and fast, on-demand custom retail data collection.
Catalog rows
Four: backroom organization and damaged-goods sorting
Status
Ready to deploy
First batch
Median 48 h where coverage is deep
License
Buyer-owned

Requirements

What does retail backroom data need?

01

A named task list

The catalog rows name sorting onto racks and bins, breaking down cartons, clearing aisles and sorting damaged goods, so a spec says which are in scope and in what order.

02

Stock, shelf and both hands in frame

A head-mounted view keeps both hands, the carton or item, and the rack or bin in view through each placement.

03

Hand pose through each placement

3D hand pose with per-joint visibility carries the finger detail of picking up an item, labelling a bin or dropping a damaged item into a returns bin.

04

Decisions and placements on the same clock

Frame-accurate action segments mark where a pick ends and a placement begins, aligned to video and depth.

05

Rights you can ship on

A perpetual, buyer-owned commercial license backed by a documented consent chain.

Why it matters

What is egocentric retail backroom organization data, and why does it need its own page?

Egocentric retail backroom organization data is real-world, first-person video of a person doing the work the catalog rows describe: sorting stock onto labelled racks and bins, breaking down cartons and clearing the aisles, and inspecting returned or damaged items and sorting them into the right bin. It is recorded from the operator viewpoint, with depth, 3D hand pose, contact events and frame-accurate action segments aligned on one hardware clock.

Retail backroom robot training data needs the decision behind each placement as well as the grasp, because stock is grouped by category and a damaged item goes to markdown, disposal or a returns bin. The site states no store, stock, process or loss detail for these rows, so this page says only what the rows say.

Setting

Which backroom tasks can be captured?

The site lists four rows for this topic in the Retail Store -- Back of House environment. Backroom Organization sorts stock onto labelled racks and bins, breaks down cartons and clears the aisles. Sort and organize backroom inventory using shelving racks and bins groups backroom stock by category, shelves it on racks and labels bins. Damaged-Goods Sorting inspects returned or damaged items, scans them and sorts them into markdown or disposal bins. Inspect and sort damaged goods using a handheld scanner and returns bins scans each damaged item, checks the condition and drops it into the right returns bin.

All four are rated Easy, use a head-mounted phone or multiview rig, and are listed as Ready to deploy. The environment describes the stockroom, receiving dock and backroom of supermarkets, apparel and general retail. A stockroom organization video dataset here means footage recorded to your spec for those rows. Tasks outside the list can be added to a spec.

Damaged goods and inventory

Does the data cover damaged-goods sorting and backroom inventory?

Yes for sorting. Two rows cover damaged goods: one ends in markdown or disposal bins and one in a returns bin after a handheld scan and a condition check. That makes egocentric damaged-goods sorting and backroom inventory data a matter of choosing which rows go into the spec, and the sequence between them.

Counting is a different job. The site lists no counting row in a store environment, and its backroom rows sort and shelve stock rather than count it. If your policy needs a count step, say so in the written spec; it is scoped as an added task with its own accept criteria. The site does not state stock types, carton sizes or weights, rack layouts or label formats, so those are agreed in the spec and checked on a Spec Pilot.

Adjacent rows

What else is in the back-of-house environment?

The environment holds ten rows in total, all rated Easy and listed as Ready to deploy. Six sit beside the four above: Cart & Basket Retrieval, Price Tagging & Signage, Retail Stocking Back of House, Shelf Restocking & Facing, tagging and pricing merchandise with a pricing gun and label sheets, and unpacking and stocking shelves with a box cutter and stocking cart.

This page does not claim those six. A spec can pair backroom organization with a restocking row when your policy has to carry a carton from the rack to the shelf; the second table lists the rows side by side.

Neighbouring pages

How is this different from returns, inventory counting, sorting and grocery put-away data?

The returns processing page covers returns rows in a warehouse, a retail floor set and the front of house: opening returned parcels, inspecting, scanning and routing items. The inventory counting page covers two counting rows and says the store backroom rows sort stock rather than count it. The sorting task page is a task family across many sectors and lists the backroom rows among them. The grocery put-away page covers putting groceries away in a kitchen.

This page is the dedicated one for the store backroom: organizing stock on racks and bins and sorting damaged goods there. The third table sets the pages side by side.

Capture setup

How is a retail backroom captured from a first-person view?

A head-mounted phone records the first-person view of real work on site, and a multiview rig adds synchronized third-person angles when the spec asks for them. A wrist-mounted camera is available alongside the head camera for close-range detail. A stereo head rig is also offered where depth from a calibrated pair matters; the MCAP hub page describes it.

The site does not state a camera count, resolution or frame rate for these rows, the number of workers per site, or the location of the capture. Environment, access and schedule are agreed in the spec, and the site names no retailer, store or worker.

Streams and labels

What does each backroom episode contain?

Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact and grasp events, and frame-accurate action segments. Hand pose tracks the grip on a carton or item, contact events mark when fingers meet stock or a bin, and action segments mark each step of a sort.

Object labels use the terms your spec sets. Item categories, scanner models, a task-completion label, force or tactile data and the markdown, disposal or returns rules are Not stated. They are defined in the spec if your policy needs them, and no safety, shrink, loss-prevention or compliance claim is made.

Delivery

How is backroom data labeled and delivered?

Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd, and MCAP is offered for stereo capture. The format table below sets each against what its official documentation states. The episode schema is the same as every other Firsthand collection, so a loader that reads another Firsthand dataset reads this one without changes.

Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch.

Privacy

How is contributor privacy handled?

Every episode links to a signed contributor release through a documented consent chain, and the consent record is part of the delivery. Faces, plates and screens are detected and irreversibly blurred at ingest, and a reviewer confirms the result before anything ships. The anonymization record is delivered with the data.

The site does not state a separate rule for other text in a stockroom, such as shelf labels, cartons or scanner displays, so this page does not claim it is blurred. Raise it in the spec if it matters.

Fast · on demand

How fast can a custom retail backroom dataset be collected?

Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck. The site names retail handling as an example of deep coverage but does not state coverage depth for the back-of-house environment itself, so the timeline is quoted against your spec before capture begins. The backroom rows are ready to deploy on a signed spec.

Custom retail data collection runs as custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs. On-demand top-ups run against the same spec and accept criteria after each training run. The site does not state a batch size or later-batch turnaround, so those are quoted against your spec.

The spec

How do you start a pilot?

You describe the backroom work, bins and sequence your policy needs. We turn that into a written spec covering tasks, environments, capture tier, annotation depth and accept criteria, then quote reach, timeline and price before any capture begins.

A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Billing is per validated hour, a reject log ships with every batch, rejected items are recaptured at our cost, and every collection ships under a perpetual, buyer-owned commercial license.

At a glance

What you get.

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

Catalog rows

Which catalog rows cover backroom organization and damaged goods?

The four rows on this site that name backroom organization or damaged-goods sorting, with the catalog description, skill rating, capture mode and status as listed. All are in Retail Store -- Back of House.
Catalog taskDescriptionSkillCaptureStatus
Backroom OrganizationSort stock onto labelled racks and bins, break down cartons and clear the aislesEasyPhone (head-mounted) / multiview rigReady to deploy
Sort and organize backroom inventory using shelving racks and binsGroup backroom stock by category, shelve it on racks and label binsEasyPhone (head-mounted) / multiview rigReady to deploy
Damaged-Goods SortingInspect returned or damaged items, scan them and sort them into markdown or disposal binsEasyPhone (head-mounted) / multiview rigReady to deploy
Inspect and sort damaged goods using a handheld scanner and returns binsScan each damaged item, check the condition and drop it into the right returns binEasyPhone (head-mounted) / multiview rigReady to deploy

Adjacent rows

Which other rows sit in the same environment?

The six other rows in Retail Store -- Back of House, as the catalog lists them. They are not the subject of this page.
Catalog taskDescriptionSkill and status
Cart & Basket RetrievalGather carts and baskets from the floor and car park and return them to the entranceEasy; Ready to deploy
Price Tagging & SignagePrint price labels, tag merchandise with a pricing gun and place shelf signageEasy; Ready to deploy
Retail Stocking Back of HouseMove cartons from the backroom to the floor and stock shelves and displaysEasy; Ready to deploy
Shelf Restocking & FacingRefill shelves from cartons and pull products to the front edge with labels facing outEasy; Ready to deploy
Tag and price merchandise using a pricing gun and label sheetsLoad the pricing gun, tag each item and apply labels from sheets to packagingEasy; Ready to deploy
Unpack and stock shelves using a box cutter and stocking cartCut open cartons, load the stocking cart and fill shelves in the aisleEasy; Ready to deploy

Neighbouring pages

How does this page differ from nearby pages?

What each page covers, as the catalog and those pages state it.
PageWhat it coversRelation to backroom organization
Egocentric retail backroom organization data (this page)Backroom organization and damaged-goods rows in Retail Store -- Back of HouseThe subject of this page
Returns processing dataReturns rows in a warehouse, a retail floor set and the front of houseReturns work outside the store backroom
Inventory counting dataTwo counting rows; says the store backroom rows sort stock rather than count itCounting, which the backroom rows do not cover
Sorting task dataA task family across many sectors, with the backroom rows listed among themThe broad sorting view rather than the store backroom
Grocery put-away dataPutting groceries away and unloading into kitchen cupboardsA home kitchen rather than a store backroom

Streams and labels

What does each episode carry, and what is not stated?

Streams and labels the site states for Firsthand custom collections, and backroom fields the site does not state.
ItemStatus on this siteWhy it matters for the backroom
Head and wrist RGB, depthStated; ten streams synced under 2 msKeeps the item, the rack and the hands on one timeline
3D hand pose, per-joint visibilityStatedCarries the grip on a carton, an item or a bin label
Contact and grasp eventsStatedMarks when fingers meet stock, a bin or a scanner
Action segmentsStated; frame-accurateSeparates picking, placing, labelling and sorting a damaged item
Item categories, carton sizes and weights, rack layouts, label formatsNot statedDefined in the spec
Scanner models, markdown, disposal and returns rulesNot statedDefined in the spec
Number of sites or workers, capture locationNot statedDefined in the spec
Force or tactile data, task-completion label, throughputNot statedDefined in the spec if needed

Formats

Which formats carry retail backroom data?

Delivery formats stated on the site, set against what each format official documentation states where the documentation was read.
FormatWhat the official documentation statesUsed for here
RLDSA dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README)Episode-based training loaders
LeRobotLeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation)LeRobot dataset format and tooling
WebDatasetTar files in which files that belong together share a basename, split into numbered shards (WebDataset README)Sharded streaming for large training runs
HDF5 and zarrStated by Firsthand onlyArray storage for custom pipelines
Rerun .rrdStated by Firsthand onlyMulti-stream synchronized playback for review
MCAPStated by Firsthand only; offered for stereo captureStereo delivery; see the MCAP hub page

Example footage

What does egocentric stereo footage look like?

One real clip already published on this site. It is a format and rig example: a head-mounted stereo capture with hands in frame. It does not show backroom work or any task from this page.

egocentric_stereo_sample.mp4 · head-mounted stereo · hands in frame · 1920 × 1080 web preview · rig example

No retail backroom clip is published on the site, so this is the nearest stereo clip. Request a sample to see delivered files. See stereo sample page, stereo + wrist-cam example videos, egocentric stereo data in MCAP, request an egocentric data sample.

FAQ

Retail backroom robot training data, answered.

What is egocentric retail backroom organization data?
Real-world, first-person video of a person sorting stock onto labelled racks and bins, grouping and shelving backroom stock, and inspecting and sorting damaged goods, captured against a written spec with 3D hand pose, depth and action segments.
Which backroom tasks does the site state?
Four catalog rows in Retail Store -- Back of House: Backroom Organization, sorting and organizing backroom inventory on racks and bins, Damaged-Goods Sorting, and sorting damaged goods with a handheld scanner and returns bins. All are rated Easy and listed as Ready to deploy.
Does this data include inventory counting?
Not as a backroom row. The backroom rows sort and shelve stock rather than count it. If your policy needs a count step, say so in the written spec and it is scoped as an added task.
Does the site state safety, shrink, loss-prevention or retailer detail?
No. Stock types, carton sizes, rack layouts, scanner models, markdown and disposal rules, safety, shrink, loss prevention and retailer names are Not stated. They are defined in the written spec if your policy needs them.
How fast can a custom retail backroom dataset be collected?
Where coverage is deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks. The site does not state coverage depth for the back-of-house environment, so the timeline is quoted against your spec.
How do you start a pilot, and who owns the data?
Describe the backroom work and sequence you need. We write a spec and quote against it, and a Spec Pilot proves the accept criteria before you scale. The buyer owns the dataset under a perpetual commercial license.

Sources

Where are the delivery formats documented?

Request a custom retail backroom dataset.

Tell us the backroom work, bins and sequence your policy needs to handle. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.