Six apparel rows, named exactly
"Fitting room reset", "Garment rail sizing" and "Merchandising and facing" in Retail Store -- Front of House; "Reset fitting room", "Hang + size-order rail" and "Fold + stack apparel" in Retail Floor Set.
Fitting room and apparel merchandising
Requirements
"Fitting room reset", "Garment rail sizing" and "Merchandising and facing" in Retail Store -- Front of House; "Reset fitting room", "Hang + size-order rail" and "Fold + stack apparel" in Retail Floor Set.
Hand pose, contact events and per-frame instance masks are recorded on one clock, with a visibility flag on each joint.
The catalog states no brand, garment type, size scheme, planogram tool or sales result. Those would be written into the spec, not assumed.
Consent, anonymization and the license are stated below. Faces, plates and screens are blurred. This page makes no certification claim.
Definition
Egocentric fitting room and apparel merchandising data is first-person video of an associate handling garments and retail displays, recorded from their own point of view with synchronized sensor streams alongside. The camera sits on the head, close to what a robot’s onboard camera would see, so the frames show what the hands do with the hanger, the garment and the shelf. The same idea sits behind any apparel retail robot training data or fitting room reset video dataset request, applied here as a custom collection scoped to your tasks.
The data is human capture: a paid, consented contributor wears the rig and performs a task from a written skill spec. It is not robot or teleoperation data. It is also not fixed-camera store footage, because the viewpoint is the person doing the work.
Tasks
The task catalog lists six rows. Three sit in Retail Store -- Front of House, in the Retail & Consumer Goods sector, which the catalog illustrates with a clothing store, an electronics shop, a furniture showroom, sporting goods, a bookstore and a department store: "Fitting room reset", "Garment rail sizing" and "Merchandising and facing". Three sit in Retail Floor Set, illustrated with shelving, a checkout, a garment rail and a pack bench: "Reset fitting room", "Hang + size-order rail" and "Fold + stack apparel". The rows table below gives each description, skill level and status.
The "Merchandising and facing" row speaks of products, not garments. It is counted here as a store-floor display task, and the page does not claim it is specific to apparel.
Capture
No. The three Front of House rows use a head-mounted phone with a multiview rig. The three Retail Floor Set rows use a multiview rig with handheld grippers instead. The first-person view of real work comes from the head-mounted phone, and the multiview rig adds synchronized third-person angles when the spec asks for them.
The site states no garment categories, size ranges, rail lengths, store formats, store chains or facility names for these rows.
Adjacent rows
Several rows sit next to these without being part of them. Laundry folding and ironing are garment-handling tasks with their own pages. "Price-tag items" attaches price tags or labels and has its own page. Returns processing, which can involve garments, is covered by the returns page. Generic restocking rows fill shelves from cartons or a cart. This page does not count any of them as fitting room or apparel merchandising rows.
Coverage limits
No. No catalog row names helping a customer try on or choose a size, answering fitting-room requests, working in planogram or inventory software, tracking sales, or loss prevention. The coverage table below sets each of these against what the catalog actually lists. Anything else is written into the skill spec, and feasibility is confirmed when it is quoted.
Episodes
Each attempt is delivered as one episode. On this site the standard episode carries action segments, 3D hand pose for both hands with a per-joint visibility flag, contact events that mark when a hand meets an item, an objects list, one task instruction, and per-frame instance masks stored at the depth resolution of 848×480.
For apparel work, an object in the list might be a garment, a hanger, a rail or a shelf product, as written in the skill spec.
Labels and delivery
Action segments divide an episode into start- and end-timestamped spans, each carrying start_ns, end_ns, verb and noun. For apparel work, a segment might be one garment rehung, one hanger spaced or one fold completed, as written in the skill spec.
Validation runs against signed accept criteria written into the spec before capture, and a reject log ships with each batch. A human reviewer checks every episode. Only footage that clears the criteria is billed as a validated hour.
Delivery is in the format your stack already reads: RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, or raw streams with metadata. The license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default. The executed agreement controls.
Why it is hard
Garments are soft, so a hand closes on them and the cloth changes shape. A hanger has to meet a rail, a stack has to stay square, and a rail has to be read for size and style before the next garment is placed. The hands are often partly hidden by the cloth they hold. That is why hand pose carries a per-joint visibility flag, why contact events mark when the hand meets the item, and why masks are recorded per frame. The challenge table below maps each difficulty to the stream or label this site states.
Capture and privacy
The catalog describes the head-mounted phone as recording the first-person view of real work. The site also states that Firsthand does not capture at a customer’s own facility.
Every contributor signs a written release, and each delivered episode links to it through consent artefact IDs. At ingest, automated detection finds faces, plates and screens and blurs them irreversibly, and speech is scrubbed of names, addresses and card numbers. A human reviewer confirms that no un-consented person is identifiable in any frame, and the anonymization record ships with the data.
The site states no rule about where a camera may point near a fitting room. Any such constraint is written into the spec. Certifications are not stated for these environments, and this page makes no such claim.
Speed
From signed spec to first validated batch, the published timeline is a median of 48 hours where coverage is deep and three to four weeks where it is thin and contributors need to be recruited first. All six rows are marked Available on request, so each starts from the spec rather than from an already prepared setup.
Getting started
Describe the task and its order, the garments or products involved, where each one ends up, what counts as a finished step, and the failure or variation cases your pipeline is missing. If you need something beyond the six rows, such as helping a shopper or working in a planogram tool, say so up front. That becomes a written skill spec, quoted for reach, timeline and price before any capture begins.
Most programs begin with a Spec Pilot, a small, fast first batch that proves the spec and the accept criteria on real footage before volume scales. Collections are billed per validated hour.
Capture setup
| Part | As stated on this site |
|---|---|
| Capture mode (Front of House rows) | Head-mounted phone for the first-person view of real work; a multiview rig adds synchronized third-person angles when the spec asks for them |
| Capture mode (Retail Floor Set rows) | Multiview rig with handheld grippers |
| Streams | Ten: 4K head camera, two wrist cameras, depth, IMU, 3D hand and body pose, instance segmentation, action labels |
| Sync | Hardware-triggered onto one PTP clock domain; aligned under 2 ms |
| Hand pose | 21 joints per hand, 3D, in metres in the head-camera frame; per-joint visibility flag |
| Which tier applies to a given program | Not stated; confirmed in the skill spec |
Every collection runs through the same seven-stage end-to-end custom collection pipeline.
Apparel rows
| Task | Environment | What the catalog states | Skill | Capture | Status |
|---|---|---|---|---|---|
| Fitting room reset | Retail Store -- Front of House | Collect garments left in fitting rooms, rehang them and return them to the floor | Easy | Phone (head-mounted) / multiview rig | Available on request |
| Garment rail sizing | Retail Store -- Front of House | Sort garments on the rail by size and style and space the hangers evenly | Easy | Phone (head-mounted) / multiview rig | Available on request |
| Merchandising and facing | Retail Store -- Front of House | Arrange products on shelves and displays to the planogram and face them forward | Medium | Phone (head-mounted) / multiview rig | Available on request |
| Reset fitting room | Retail Floor Set (shelving, checkout, rail, pack bench) | Re-hang and tidy a fitting room | Easy | Multiview rig + handheld grippers | Available on request |
| Hang + size-order rail | Retail Floor Set (shelving, checkout, rail, pack bench) | Hang garments in size order | Easy | Multiview rig + handheld grippers | Available on request |
| Fold + stack apparel | Retail Floor Set (shelving, checkout, rail, pack bench) | Fold garments and build a stack | Medium | Multiview rig + handheld grippers | Available on request |
Coverage
| Sub-task | In the catalog? | Detail |
|---|---|---|
| Collecting garments left in a fitting room | Yes, one row | "Fitting room reset" |
| Re-hanging and tidying a fitting room | Yes, one row | "Reset fitting room" |
| Sorting a rail by size and style, spacing hangers | Yes, one row | "Garment rail sizing" |
| Hanging garments in size order | Yes, one row | "Hang + size-order rail" |
| Folding garments and building a stack | Yes, one row | "Fold + stack apparel" |
| Arranging products to the planogram and facing them | Yes, one row | "Merchandising and facing"; the row names products, not garments |
| Laundry folding and ironing | Adjacent rows | Garment-handling tasks with their own pages, not counted here |
| Attaching price tags or labels | Adjacent row | "Price-tag items", covered by the price tagging page |
| Restocking shelves and returns processing | Adjacent rows | Not counted as fitting room or apparel merchandising |
| Helping a shopper try on or choose a size | No row | Not named in any row |
| Planogram or inventory software, sales tracking, loss prevention | No row | Not named in any row |
Capture challenges
| Challenge | What goes wrong | Stated stream or label |
|---|---|---|
| Cloth covers the fingers | The garment hides the hand it is held in | 3D hand pose with per-joint visibility flags; reject if the object is out of frame for more than 15% of an episode |
| Hanger meets rail or hand meets garment | The moment of contact is hard to place in a long clip | Contact events and per-frame instance masks |
| Building a stack or spacing hangers | The result is a sequence of small steps, not one event | Action segments with verb and noun; not stated: no stack or spacing quality label is listed |
| Reading size and style on a rail | A tag or a cut is small at a distance | 4K head camera and depth are listed streams; not stated: no size or style label is listed |
| Shopper or screen in frame | A bystander or a display can appear | Faces, plates and screens blurred irreversibly at ingest; speech scrubbed of names, addresses and card numbers; human review for any identifiable un-consented person |
| Fabric weight and stiffness | Effort and drape are not visible in video | Not stated: force and tactile readings are not among the listed streams |
Delivered vs not stated
| Item | Status | Detail |
|---|---|---|
| Action segments | Delivered | start_ns, end_ns, verb, noun, one per step |
| 3D hand pose | Delivered | 21 joints per hand; per-joint visibility flag for occluded fingers |
| Contact events | Delivered | The moment a hand meets an item |
| Per-frame instance masks | Delivered | Stored at 848×480 |
| Task instruction | Delivered | One per episode; no richer language data is stated |
| Consent and anonymization records | Delivered | Consent artefact IDs per episode; anonymization record shipped with the data |
| Garment types, size schemes and fabrics | Not stated | Agreed in the skill spec |
| Planogram software and inventory systems | Not stated | No system is named |
| Brands, store chains, facility names, worker counts, sales uplift and loss-prevention results | Not stated | No such detail is listed |
| Number of sites, episodes and hours | Not stated | Set per program in the skill spec |
| Result-quality labels | Not stated | No such label is listed |
FAQ
Sources
Tell us the garments or products, where each one ends up, and the steps your model needs to see. We will quote reach, timeline and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.