Fitting room and apparel merchandising

Egocentric Fitting Room and Apparel Merchandising Data

Collecting garments left in a fitting room, rehanging them, sorting a rail by size and style, folding a stack and facing products forward: apparel retail is a run of small, repetitive hand tasks on soft goods. We collect custom egocentric video of it on demand, to a written skill spec, with synchronized streams, hand pose, action segments, anonymization and a buyer-owned license.
Setting
Retail Floor Set and Retail Store -- Front of House, in the Retail & Consumer Goods sector
Apparel rows
Six, rated Easy or Medium; all Available on request
First batch
Median 48 h in deep-coverage settings
License
Perpetual, buyer-owned

Requirements

What does an apparel capture need that a general retail clip does not?

01

Six apparel rows, named exactly

"Fitting room reset", "Garment rail sizing" and "Merchandising and facing" in Retail Store -- Front of House; "Reset fitting room", "Hang + size-order rail" and "Fold + stack apparel" in Retail Floor Set.

02

The hands and the garment in view together

Hand pose, contact events and per-frame instance masks are recorded on one clock, with a visibility flag on each joint.

03

Gaps stated, not filled

The catalog states no brand, garment type, size scheme, planogram tool or sales result. Those would be written into the spec, not assumed.

04

Privacy stated plainly

Consent, anonymization and the license are stated below. Faces, plates and screens are blurred. This page makes no certification claim.

Definition

What is egocentric fitting room and apparel merchandising data?

Egocentric fitting room and apparel merchandising data is first-person video of an associate handling garments and retail displays, recorded from their own point of view with synchronized sensor streams alongside. The camera sits on the head, close to what a robot’s onboard camera would see, so the frames show what the hands do with the hanger, the garment and the shelf. The same idea sits behind any apparel retail robot training data or fitting room reset video dataset request, applied here as a custom collection scoped to your tasks.

The data is human capture: a paid, consented contributor wears the rig and performs a task from a written skill spec. It is not robot or teleoperation data. It is also not fixed-camera store footage, because the viewpoint is the person doing the work.

Tasks

Which apparel and merchandising tasks are in the catalog?

The task catalog lists six rows. Three sit in Retail Store -- Front of House, in the Retail & Consumer Goods sector, which the catalog illustrates with a clothing store, an electronics shop, a furniture showroom, sporting goods, a bookstore and a department store: "Fitting room reset", "Garment rail sizing" and "Merchandising and facing". Three sit in Retail Floor Set, illustrated with shelving, a checkout, a garment rail and a pack bench: "Reset fitting room", "Hang + size-order rail" and "Fold + stack apparel". The rows table below gives each description, skill level and status.

The "Merchandising and facing" row speaks of products, not garments. It is counted here as a store-floor display task, and the page does not claim it is specific to apparel.

Capture

Do the six apparel rows use the same capture setup?

No. The three Front of House rows use a head-mounted phone with a multiview rig. The three Retail Floor Set rows use a multiview rig with handheld grippers instead. The first-person view of real work comes from the head-mounted phone, and the multiview rig adds synchronized third-person angles when the spec asks for them.

The site states no garment categories, size ranges, rail lengths, store formats, store chains or facility names for these rows.

Adjacent rows

Which nearby rows are not counted as fitting room or apparel merchandising?

Several rows sit next to these without being part of them. Laundry folding and ironing are garment-handling tasks with their own pages. "Price-tag items" attaches price tags or labels and has its own page. Returns processing, which can involve garments, is covered by the returns page. Generic restocking rows fill shelves from cartons or a cart. This page does not count any of them as fitting room or apparel merchandising rows.

Coverage limits

Does the catalog cover customer service, sizing advice, planogram software or loss prevention?

No. No catalog row names helping a customer try on or choose a size, answering fitting-room requests, working in planogram or inventory software, tracking sales, or loss prevention. The coverage table below sets each of these against what the catalog actually lists. Anything else is written into the skill spec, and feasibility is confirmed when it is quoted.

Episodes

What does each episode contain?

Each attempt is delivered as one episode. On this site the standard episode carries action segments, 3D hand pose for both hands with a per-joint visibility flag, contact events that mark when a hand meets an item, an objects list, one task instruction, and per-frame instance masks stored at the depth resolution of 848×480.

For apparel work, an object in the list might be a garment, a hanger, a rail or a shelf product, as written in the skill spec.

Labels and delivery

How is the data labeled and delivered?

Action segments divide an episode into start- and end-timestamped spans, each carrying start_ns, end_ns, verb and noun. For apparel work, a segment might be one garment rehung, one hanger spaced or one fold completed, as written in the skill spec.

Validation runs against signed accept criteria written into the spec before capture, and a reject log ships with each batch. A human reviewer checks every episode. Only footage that clears the criteria is billed as a validated hour.

Delivery is in the format your stack already reads: RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, or raw streams with metadata. The license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default. The executed agreement controls.

Why it is hard

Why is apparel handling hard for robot learning?

Garments are soft, so a hand closes on them and the cloth changes shape. A hanger has to meet a rail, a stack has to stay square, and a rail has to be read for size and style before the next garment is placed. The hands are often partly hidden by the cloth they hold. That is why hand pose carries a per-joint visibility flag, why contact events mark when the hand meets the item, and why masks are recorded per frame. The challenge table below maps each difficulty to the stream or label this site states.

Capture and privacy

Where is it captured and how are people protected?

The catalog describes the head-mounted phone as recording the first-person view of real work. The site also states that Firsthand does not capture at a customer’s own facility.

Every contributor signs a written release, and each delivered episode links to it through consent artefact IDs. At ingest, automated detection finds faces, plates and screens and blurs them irreversibly, and speech is scrubbed of names, addresses and card numbers. A human reviewer confirms that no un-consented person is identifiable in any frame, and the anonymization record ships with the data.

The site states no rule about where a camera may point near a fitting room. Any such constraint is written into the spec. Certifications are not stated for these environments, and this page makes no such claim.

Speed

How fast can a custom apparel dataset be collected?

From signed spec to first validated batch, the published timeline is a median of 48 hours where coverage is deep and three to four weeks where it is thin and contributors need to be recruited first. All six rows are marked Available on request, so each starts from the spec rather than from an already prepared setup.

Getting started

How do you start a fitting room and apparel pilot?

Describe the task and its order, the garments or products involved, where each one ends up, what counts as a finished step, and the failure or variation cases your pipeline is missing. If you need something beyond the six rows, such as helping a shopper or working in a planogram tool, say so up front. That becomes a written skill spec, quoted for reach, timeline and price before any capture begins.

Most programs begin with a Spec Pilot, a small, fast first batch that proves the spec and the accept criteria on real footage before volume scales. Collections are billed per validated hour.

Capture setup

What is the capture setup for a fitting room and apparel collection?

The capture setup as stated on this site. Counts of sites, contributors, episodes and hours are set in the skill spec.
PartAs stated on this site
Capture mode (Front of House rows)Head-mounted phone for the first-person view of real work; a multiview rig adds synchronized third-person angles when the spec asks for them
Capture mode (Retail Floor Set rows)Multiview rig with handheld grippers
StreamsTen: 4K head camera, two wrist cameras, depth, IMU, 3D hand and body pose, instance segmentation, action labels
SyncHardware-triggered onto one PTP clock domain; aligned under 2 ms
Hand pose21 joints per hand, 3D, in metres in the head-camera frame; per-joint visibility flag
Which tier applies to a given programNot stated; confirmed in the skill spec

Every collection runs through the same seven-stage end-to-end custom collection pipeline.

Apparel rows

Stated task × environment × what the catalog says × skill × status

The six catalog rows about fitting rooms, garment rails, apparel and facing, as the task catalog states them, with the capture setup each row lists.
TaskEnvironmentWhat the catalog statesSkillCaptureStatus
Fitting room resetRetail Store -- Front of HouseCollect garments left in fitting rooms, rehang them and return them to the floorEasyPhone (head-mounted) / multiview rigAvailable on request
Garment rail sizingRetail Store -- Front of HouseSort garments on the rail by size and style and space the hangers evenlyEasyPhone (head-mounted) / multiview rigAvailable on request
Merchandising and facingRetail Store -- Front of HouseArrange products on shelves and displays to the planogram and face them forwardMediumPhone (head-mounted) / multiview rigAvailable on request
Reset fitting roomRetail Floor Set (shelving, checkout, rail, pack bench)Re-hang and tidy a fitting roomEasyMultiview rig + handheld grippersAvailable on request
Hang + size-order railRetail Floor Set (shelving, checkout, rail, pack bench)Hang garments in size orderEasyMultiview rig + handheld grippersAvailable on request
Fold + stack apparelRetail Floor Set (shelving, checkout, rail, pack bench)Fold garments and build a stackMediumMultiview rig + handheld grippersAvailable on request

Coverage

Apparel sub-task × in the catalog? × how this page treats it

Each sub-task set against the catalog. Where there is no row, the page says so instead of claiming it.
Sub-taskIn the catalog?Detail
Collecting garments left in a fitting roomYes, one row"Fitting room reset"
Re-hanging and tidying a fitting roomYes, one row"Reset fitting room"
Sorting a rail by size and style, spacing hangersYes, one row"Garment rail sizing"
Hanging garments in size orderYes, one row"Hang + size-order rail"
Folding garments and building a stackYes, one row"Fold + stack apparel"
Arranging products to the planogram and facing themYes, one row"Merchandising and facing"; the row names products, not garments
Laundry folding and ironingAdjacent rowsGarment-handling tasks with their own pages, not counted here
Attaching price tags or labelsAdjacent row"Price-tag items", covered by the price tagging page
Restocking shelves and returns processingAdjacent rowsNot counted as fitting room or apparel merchandising
Helping a shopper try on or choose a sizeNo rowNot named in any row
Planogram or inventory software, sales tracking, loss preventionNo rowNot named in any row

Capture challenges

Apparel challenge × what goes wrong × stream or label that addresses it

Each apparel capture challenge mapped to a stream or label this site already states. Where nothing is stated, the row says so.
ChallengeWhat goes wrongStated stream or label
Cloth covers the fingersThe garment hides the hand it is held in3D hand pose with per-joint visibility flags; reject if the object is out of frame for more than 15% of an episode
Hanger meets rail or hand meets garmentThe moment of contact is hard to place in a long clipContact events and per-frame instance masks
Building a stack or spacing hangersThe result is a sequence of small steps, not one eventAction segments with verb and noun; not stated: no stack or spacing quality label is listed
Reading size and style on a railA tag or a cut is small at a distance4K head camera and depth are listed streams; not stated: no size or style label is listed
Shopper or screen in frameA bystander or a display can appearFaces, plates and screens blurred irreversibly at ingest; speech scrubbed of names, addresses and card numbers; human review for any identifiable un-consented person
Fabric weight and stiffnessEffort and drape are not visible in videoNot stated: force and tactile readings are not among the listed streams

Delivered vs not stated

What is delivered and what is not stated

Delivered items are stated elsewhere on this site. Items marked not stated are not promised on this page.
ItemStatusDetail
Action segmentsDeliveredstart_ns, end_ns, verb, noun, one per step
3D hand poseDelivered21 joints per hand; per-joint visibility flag for occluded fingers
Contact eventsDeliveredThe moment a hand meets an item
Per-frame instance masksDeliveredStored at 848×480
Task instructionDeliveredOne per episode; no richer language data is stated
Consent and anonymization recordsDeliveredConsent artefact IDs per episode; anonymization record shipped with the data
Garment types, size schemes and fabricsNot statedAgreed in the skill spec
Planogram software and inventory systemsNot statedNo system is named
Brands, store chains, facility names, worker counts, sales uplift and loss-prevention resultsNot statedNo such detail is listed
Number of sites, episodes and hoursNot statedSet per program in the skill spec
Result-quality labelsNot statedNo such label is listed

FAQ

Apparel retail robot training data, answered.

What is egocentric fitting room and apparel merchandising data?
Custom first-person video of paid, consented contributors resetting fitting rooms, sizing and hanging garments, folding apparel and facing products, captured to a written skill spec.
Which apparel tasks are in the catalog?
Six rows: "Fitting room reset", "Garment rail sizing" and "Merchandising and facing" in Retail Store -- Front of House, and "Reset fitting room", "Hang + size-order rail" and "Fold + stack apparel" in Retail Floor Set. All six are Available on request.
Does the catalog include helping shoppers, planogram software or loss prevention?
No. None of these is a named row. They would be written into the skill spec, and feasibility is confirmed when the spec is quoted.
Is this a custom retail data collection or a ready-made dataset?
It is a custom collection: you write a skill spec, we quote reach, timeline and price against it, and capture runs to your accept criteria.
How are shoppers and staff protected?
Contributors sign a release and each episode links to it. Faces, plates and screens are blurred irreversibly at ingest, and speech is scrubbed of names, addresses and card numbers.
How fast can a fast, on-demand apparel dataset arrive?
A median of a median of 48 hours from signed spec to first validated batch where coverage is deep, and three to four weeks where it is thin.
Who owns the data and in which formats does it arrive?
The buyer owns it under a perpetual, non-exclusive commercial license by default. Formats include RLDS, LeRobot, WebDataset, HDF5, zarr and Rerun .rrd.

Sources

Where are the delivery formats for apparel retail data documented?

Request a custom fitting room and apparel dataset.

Tell us the garments or products, where each one ends up, and the steps your model needs to see. We will quote reach, timeline and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.