Depth of the cloth and the machine
The site states that a stereo pair at human-eye spacing makes depth recoverable from every frame pair, so the fabric, the sewing machine, the shears or cutting machine and the hands sit in the same frame.
Now recruiting capture teams worldwide. Get paid to record first-person video of real work.
Apply to captureTask family
Why stereo and MCAP here
The site states that a stereo pair at human-eye spacing makes depth recoverable from every frame pair, so the fabric, the sewing machine, the shears or cutting machine and the hands sit in the same frame.
Fabric is guided by fingers that are often behind or under the material. 3D hand pose carries a per-joint visibility flag, so a finger hidden under a seam is flagged as hidden rather than silently guessed, and per-frame instance masks mark the objects.
Laying out, patterning, cutting, feeding and joining are different steps in a chain. Streams are hardware-triggered onto one clock with a 2.0 ms cross-stream ceiling, and action segments carry start, end, verb and noun as the skill spec defines them.
MCAP stores multiple channels of timestamped, pre-serialized data, so a stereo pair, hand pose and IMU can share one file on one log-time axis. Which streams go in the file is set in the skill spec.
Definition
It is first-person video of a person doing garment production work, recorded from their own point of view with two calibrated cameras and with hand pose and sensor streams alongside. The tasks are the rows the site’s catalog lists in Textile & Apparel Production. Stereo describes the capture, and MCAP describes the container. They are separate choices.
The site does not state that stereo is already running on these rows. The catalog lists a head-mounted phone or a multiview rig as the capture setup, and a stereo pair is a capture choice agreed in the skill spec and confirmed on a Spec Pilot. The data is human capture by paid, consented contributors, not robot or teleoperation data. Firsthand is not affiliated with Foxglove or the MCAP maintainers.
Catalog rows
Four, all in Textile & Apparel Production under Manufacturing & Workshops. The catalog lists examples for the environment such as a garment factory, a sewing workshop, a fabric cutting facility, a textile mill and fashion manufacturing. "Garment sewing" is described as feeding fabric pieces through an industrial sewing machine to join seams and attach parts, and is rated Hard. "Fabric cutting" is described as laying out fabric, placing patterns and cutting pieces with shears or a cutting machine, and is rated Medium.
"Finishing and pressing" is described as pressing seams and finished garments on an industrial iron or press and folding or hanging them, and is rated Easy. "Textile mill operation" is described as loading yarn or fabric onto mill machines, monitoring runs and clearing faults, and is rated Medium. All four list a head-mounted phone or a multiview rig as the capture setup, and all four are Available on request.
Available on request is the status the catalog gives, and this page does not claim any active or completed collection for these rows. The site says nothing further about it, so what it means for a given order is confirmed when you request the quote. This page names only the tools and steps that appear in the rows: an industrial sewing machine, shears, a cutting machine, an industrial iron or press, mill machines, fabric pieces, seams, patterns, yarn and faults. The first table below reproduces the rows as the catalog states them.
Difference
The egocentric garment production page covers the same four rows as first-person capture and says nothing about stereo or MCAP. The egocentric sewing and textile handling page is wider: it covers a textile arts and stitching studio, the apparel production setting, leathercraft rows and a cloth bench, and its capture-stack section describes a head-mounted stereo rig as the instrumented tier. It has no MCAP treatment.
This page is the stereo and MCAP treatment of the Textile & Apparel Production rows, centred on garment sewing and fabric cutting. It does not repeat the studio, leathercraft or cloth bench rows, and the stereo commercial laundry and linen page covers laundry and linen rows in a different environment. The comparison table below sets the pages side by side.
Why stereo
Garment work is about where the hands, the cloth and the tool are relative to one another: whether the pieces are aligned at the needle, whether the pattern sits on the fabric, whether the shears or cutting machine are on the marked line. Cloth also has no fixed shape, and it changes shape from frame to frame. A stereo pair recovers depth from the calibrated frame pair rather than from a standalone depth sensor, so the cloth, the tool and the hands share a frame.
The site gives no depth accuracy figure and no label for an aligned seam, a placed pattern or a cut line, so whether those are resolvable in depth is Not stated. It does not state how a stereo pair behaves on fabric, thread or a moving needle either, and it says depth degrades on wet and reflective surfaces without saying anything about cloth. Which facilities a given program uses is agreed in the spec. Capture at your own facility is listed as not offered.
Capture setup
The site describes two stereo setups and does not say which one a garment order uses. The hard-environments stack is a global-shutter 4K/60 head camera with a 120° lens, two 1080p/60 wrist cameras, a depth sensor at 848×480 and 30 fps, and 200 Hz 6-DoF IMUs. The off-the-shelf stereo head rig, dataset 06, is dual fisheye cameras at 1080p per eye, a 62 mm baseline, per-unit calibration, a 9-axis IMU and hand-tracking output.
Which rig, resolution and streams a garment order uses is Not stated on the site, and the third table below sets what is stated beside what is not. Intrinsics and extrinsics are re-solved at the start and end of every session, and streams are hardware-triggered onto one clock with a 2.0 ms cross-stream ceiling. The catalog states that a multiview rig adds synchronized third-person angles when the spec asks for them, which a spec can use for a cutting table or a machine the head camera sees only in part, and wrist cameras give a closer view of the hands.
MCAP
MCAP is an open source container file format for multimodal log data, supporting multiple channels of timestamped pre-serialized data. It is serialization-agnostic, so messages can be Protobuf, DDS (CDR), ROS, JSON and more. Its design is row-oriented and append-only, it stores schemas alongside the data, and it offers an optional index plus optional LZ4 or Zstandard chunk compression.
Reader and writer libraries exist for C++, Go, Python, Rust, Swift and TypeScript, and the mcap CLI can inspect, merge and split files. The foxglove/mcap repository is MIT-licensed; that is the MCAP project’s licence, not the licence of a Firsthand delivery. The MCAP hub page and the glossary entry cover the format in full.
Streams
Firsthand offers MCAP delivery, and dataset 06 is stated as shipping as MCAP. For garment work the site states hand pose, a stereo-derived depth stream, IMU, contact events, action segments and per-frame instance masks elsewhere. What it does not state is which of those are channels in an MCAP file, how they are named, what encoding they use or at what rate.
No topic name, message schema or rate is stated on this page, and none should be assumed. Name the streams that matter in the skill spec and confirm them on a Spec Pilot batch. The fourth table below sets each stream beside what the site states about it.
Failure modes
Soft material is the first risk. Cloth has no fixed shape, so the object being tracked changes between frames. The site ships per-frame instance masks rather than propagated ones for deformable objects, and it lists no seam, stitch-length, thread-tension, needle-position, pattern-placement or cut-accuracy label, so what counts as a joined seam or a finished cut is written into the spec up front.
Hands are the second. One hand guides the cloth while the other holds a piece or a tool, and fingers are hidden under or behind the material. The visibility flag on each joint is the answer the site gives, and contact events mark when a hand meets an item. A spec can also ask for wrist views, so a grip the head camera loses is still recorded.
Calibration is the third, because stereo depth is only as good as the rectification behind it: calibration is measured at the start and end of every session under a 0.28 px RMS gate. An episode is also rejected when the manipulated object is out of frame for more than 15 percent of it or an undocumented bystander appears, and a reject log ships with every batch. Force and tactile readings are not among the listed streams.
Privacy
For every delivered episode the site states that faces, plates and screens are blurred irreversibly, and that footage that cannot be de-identified is discarded. Who may be in frame, and how garments or patterns belonging to a facility are handled, is agreed in the spec.
The site states no garment type, production-rate, throughput, accuracy, safety or certification claim for any of these rows, so this page describes none.
Scale
Off-the-shelf covers what is already in stock: the stereo category lists the stereo datasets and hand-tracking video, and only dataset 06 is stated as MCAP. This page does not claim off-the-shelf coverage of the garment rows. Custom collection covers the rest: custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.
Where coverage is deep, the median time from signed spec to first validated batch is a median of 48 hours; where it is thin, turnaround runs three to four weeks. The site does not say which speed applies to a stereo garment order, and the rows are Available on request, so ask when you request the quote. Collections are billed per validated hour.
Ordering
Describe the stations and their order, the fabric pieces, patterns and tools and their start state, what counts as a finished step, and the variation your pipeline is missing. Then name the streams you want in the file, the topic naming and message encoding your reader expects, whether calibration ships inside the file or beside it, and whether MCAP is the only delivery or sits beside RLDS, LeRobot or WebDataset.
Most programs begin with a Spec Pilot, a small first batch that proves the spec and accept criteria on real footage before you scale. The fifth table below shows what each spec element decides.
At a glance
Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.
Catalog rows
| Task (as listed) | Description (as listed) | Environment | Skill | Capture setup | Status |
|---|---|---|---|---|---|
| Garment sewing | Feed fabric pieces through an industrial sewing machine to join seams and attach parts. | Textile & Apparel Production | Hard | Phone (head-mounted) / multiview rig | Available on request |
| Fabric cutting | Lay out fabric, place patterns and cut pieces with shears or a cutting machine. | Textile & Apparel Production | Medium | Phone (head-mounted) / multiview rig | Available on request |
| Finishing and pressing | Press seams and finished garments on an industrial iron or press and fold or hang them. | Textile & Apparel Production | Easy | Phone (head-mounted) / multiview rig | Available on request |
| Textile mill operation | Load yarn or fabric onto mill machines, monitor runs and clear faults. | Textile & Apparel Production | Medium | Phone (head-mounted) / multiview rig | Available on request |
Compared pages
| Page | Rows it covers | Treatment of the garment sewing and fabric cutting rows |
|---|---|---|
| This page: stereo garment sewing and fabric cutting data | The four Textile & Apparel Production rows, centred on garment sewing and fabric cutting | Stereo pair and MCAP delivery, stream map and failure modes for these rows only |
| Egocentric garment production data | The same four Textile & Apparel Production rows | Egocentric catalog treatment; no stereo or MCAP treatment |
| Egocentric sewing and textile handling data | Studio, apparel production, leathercraft and cloth bench rows | Wider egocentric treatment; its capture-stack section describes a head-mounted stereo rig; no MCAP treatment |
| Stereo commercial laundry and linen data | Commercial laundry and linen rows | Not covered; stereo and MCAP, but a different environment |
Stated vs not stated
| Item | What the site states | For a garment order |
|---|---|---|
| Catalog capture setup | Phone (head-mounted) / multiview rig on all four rows | A stereo pair is a spec choice; not stated on the rows |
| Stereo head rig (dataset 06) | Dual fisheye, 1080p per eye, 62 mm baseline, per-unit calibration, 9-axis IMU, hand-tracking output; shipped as MCAP | Whether a garment order uses it: Not stated |
| Hard-environments stack | 4K/60 head camera, 120° lens; two 1080p/60 wrist cameras; depth 848×480 at 30 fps; 200 Hz 6-DoF IMU | Whether a garment order uses it: Not stated |
| Objects, hands and masks | Per-frame instance masks stored at 848×480; per-joint visibility flag on hand pose; contact events | Stated; stereo behaviour on fabric and thread is Not stated |
| Calibration | Measured every session and shipped with the episode; 0.28 px RMS reprojection gate | Stated |
| Synchronization | Hardware-triggered onto one clock; 2.0 ms cross-stream ceiling | Stated |
| Hand pose | 21 joints per hand with a per-joint visibility flag | Stated |
| Row status | All four rows are Available on request | No active or completed collection is claimed on this page |
| Garment types, fabric types, seam or cut labels, stitch length, thread tension, production rates, throughput, accuracy, safety, certification, force data or results | Not stated; the rows say fabric pieces, seams, parts, patterns, shears, a cutting machine, an industrial sewing machine, an industrial iron or press, yarn and mill machines only | Agreed in the skill spec, or not claimed on this page |
| MCAP topics, schemas, rates | Not stated | Agreed in the skill spec |
Stream map
| Stream or item | What the site states | In an MCAP delivery, as the site states it |
|---|---|---|
| Stereo pair | Dual fisheye, 1080p per eye, 62 mm baseline (dataset 06) | Dataset 06 is stated as shipped as MCAP; channel layout not stated |
| Depth with confidence maps | Recovered from the calibrated stereo pair; confidence map masks low-confidence regions | Not stated |
| Hand pose | 21 joints per hand with a per-joint visibility flag | Channel layout and joint order not stated |
| IMU | 9-axis (dataset 06); 6-DoF at 200 Hz (hard-environments stack) | Channel layout and rate not stated |
| Contact events, action segments, instance masks | Listed in the site’s episode schema; masks stored at 848×480 | Not stated |
| Task instruction | One per episode | Not stated |
| Calibration | Measured every session and shipped with the episode | Placement in the file not stated |
| Topic names, schemas, encoding, rates | Not stated | Agreed in the skill spec |
Skill spec
| Spec element | What it decides | Where it shows up |
|---|---|---|
| Stations and order | What one step is: lay out, place pattern, cut, feed, join, press, fold or hang | Episode boundaries and action segments; set per program |
| Which row | Garment sewing, fabric cutting, finishing and pressing or textile mill operation | Set per program; sewing is Hard, cutting and mill operation are Medium, pressing is Easy |
| Fabric, patterns and start state | Which pieces and tools, and how they begin | Set per program; the site states no seam or cut label |
| Episode boundary | One step, one piece or a full chain of stations | Set per program; the site does not state an episode length |
| Rig and streams | Stereo pair, wrist views, hand pose, IMU and any others | The channels you can read; confirm on the Spec Pilot |
| MCAP topics and encoding | What your reader expects | Set per program |
| Calibration delivery | Inside the file or beside it | Set per program |
| Delivery format | How the data is packaged | MCAP alone, or beside RLDS, LeRobot, WebDataset, HDF5 or zarr |
| Accept criteria | What passes QA | Reject log per batch |
| Privacy | How people and items in frame are protected | Faces, plates and screens blurred at ingest |
| License | Who owns the dataset | Perpetual, irrevocable, buyer-owned, non-exclusive by default |
Example footage
Two real clips already published on this site. The first is a household chores clip of an operator carrying a cordless vacuum down a staircase into a living room, a first-person hands-on clip hosted on the site. The second is a format and rig example: a head-mounted stereo capture with hands in frame. Neither shows sewing, fabric cutting or any garment work.
No garment sewing or fabric cutting clip is published on the site, so these are labelled as format and rig examples. Request a sample to see delivered files. See stereo sample page, stereo + wrist-cam example videos, request an egocentric data sample.
FAQ
Sources
Tell us the stations and their order, the fabric, patterns and tools and their start states, the setting, the streams you want in the file and whether MCAP sits alone or beside a training format. We will quote reach, timeline and price against a written spec.