Depth of the surface and the tool
The site states that a stereo pair at human-eye spacing makes depth recoverable from every frame pair, so the seat, the mat, the trim, the vacuum and the brush sit in the same frame as the hands.
Now recruiting capture teams worldwide. Get paid to record first-person video of real work.
Apply to captureTask family
Why stereo and MCAP here
The site states that a stereo pair at human-eye spacing makes depth recoverable from every frame pair, so the seat, the mat, the trim, the vacuum and the brush sit in the same frame as the hands.
A vacuum tool or a detailing brush is gripped and guided by the hands. 3D hand pose carries a per-joint visibility flag, so a finger hidden behind the tool is flagged as hidden rather than silently guessed.
The site states that a multiview rig adds a second angle when the cabin blocks the first-person view, and the catalog lists a head-mounted phone or a multiview rig as the capture setup on both rows.
MCAP stores multiple channels of timestamped, pre-serialized data, so a stereo pair, hand pose and IMU can share one file on one log-time axis. Which streams go in the file is set in the skill spec.
Definition
It is first-person video of a person cleaning the inside of a vehicle, recorded from their own point of view with two calibrated cameras and with hand pose and sensor streams alongside. The tasks are the two interior rows the site’s catalog lists in Car Wash & Detailing: vacuuming and cleaning vehicle interiors, seats, mats and trim, and vacuuming, wiping and conditioning interiors with a shop vacuum and detailing brushes. Stereo describes the capture, and MCAP describes the container. They are separate choices.
The site does not state that stereo is already running on these rows. The catalog lists a head-mounted phone or a multiview rig as the capture setup, and a stereo pair is a capture choice agreed in the skill spec and confirmed on a Spec Pilot. The data is human capture by paid, consented contributors, not robot or teleoperation data. Firsthand is not affiliated with Foxglove or the MCAP maintainers.
Catalog rows
Two, both in the Car Wash & Detailing environment under the Automotive & Transport sector, both rated Easy and both listed as Active collection. "Car Interior Vacuuming" is described as vacuuming and cleaning vehicle interiors, seats, mats and trim. "Vacuum, wipe, and condition vehicle interiors using a shop vacuum and detailing brushes." is listed against an automotive detailing shop with wash bays, polishing stations and detailing supplies. The environment lists car wash bays, a detailing shop and polishing stations as its examples.
Both rows list a head-mounted phone or a multiview rig as the capture setup. The first table below reproduces them as the catalog states them. This page names only the tools, surfaces and steps that appear in those rows: a shop vacuum, detailing brushes, vehicle interiors, seats, mats and trim, and vacuuming, cleaning, wiping and conditioning. Related vacuuming rows in other environments are context only and are not counted here.
Difference
The egocentric car washing and detailing page covers the whole Car Wash & Detailing vocabulary, including exterior washing, polishing and wheel and tire dressing, as first-person capture with ten streams. The stereo car detailing and polishing page is the stereo and MCAP treatment of the three exterior rows and does not repeat the interior rows. The egocentric vacuuming page spans four rows across offices, corridors and vehicle interiors, and the stereo vacuuming and surface sanitizing page covers the office vacuuming row and a sanitizing row, not the vehicle rows.
This page is the stereo and MCAP treatment of just the two interior rows. It does not repeat the exterior, wheel or office rows. The comparison table below sets the pages side by side.
Interior work
The catalog names three kinds of work and three kinds of surface. The work is vacuuming and cleaning, and vacuuming, wiping and conditioning. The surfaces are seats, mats and trim. The tools are a shop vacuum and detailing brushes. A spec should name which of these an order covers, because vacuuming a mat, brushing trim and wiping a seat are different sequences with different hand positions.
The site states no episode length, no number of passes and no definition of a finished interior, so those are set per program. Name what one episode is, whether one surface, one pass or one full interior, and what counts as complete, and confirm both on a Spec Pilot. The fifth table below shows what each spec element decides.
Why stereo
The cabin is a small space where the tool, the surface and both hands share a few inches of frame. A stereo pair recovers depth from the calibrated frame pair rather than from a standalone depth sensor, so the surface and the tool share a frame with the hands. The site gives no depth accuracy figure and no label for how clean a surface is, so whether a seat, a mat or trim resolves in depth is Not stated.
The hard-environments page states that stereo keeps working outdoors where active depth sensors struggle, and that many programs capture both and sync them on one clock. The catalog lists car wash bays, a detailing shop and polishing stations as the examples, but the site does not say where any batch is captured, so the setting is agreed in the spec.
Capture setup
The site describes two stereo setups and does not say which one an interior order uses. The hard-environments stack is a global-shutter 4K/60 head camera with a 120° lens, two 1080p/60 wrist cameras, a depth sensor at 848×480 and 30 fps, and 200 Hz 6-DoF IMUs. The off-the-shelf stereo head rig, dataset 06, is dual fisheye cameras at 1080p per eye, a 62 mm baseline, per-unit calibration, a 9-axis IMU and hand-tracking output.
Which rig, resolution and streams an interior order uses is Not stated on the site, and the third table below sets what is stated beside what is not. Intrinsics and extrinsics are re-solved at the start and end of every session, and streams are hardware-triggered onto one clock with a 2.0 ms cross-stream ceiling.
MCAP
MCAP is an open source container file format for multimodal log data, supporting multiple channels of timestamped pre-serialized data. It is serialization-agnostic, so messages can be Protobuf, DDS (CDR), ROS, JSON and more. Its design is row-oriented and append-only, it stores schemas alongside the data, and it offers an optional index plus optional LZ4 or Zstandard chunk compression.
Reader and writer libraries exist for C++, Go, Python, Rust, Swift and TypeScript, and the mcap CLI can inspect, merge and split files. The foxglove/mcap repository is MIT-licensed; that is the MCAP project’s licence, not the licence of a Firsthand delivery. The MCAP hub page and the glossary entry cover the format in full.
Streams
Firsthand offers MCAP delivery, and dataset 06 is stated as shipping as MCAP. For interior work the site states hand pose, a stereo-derived depth stream, IMU, contact events, action segments and per-frame instance masks elsewhere. What it does not state is which of those are channels in an MCAP file, how they are named, what encoding they use or at what rate.
No topic name, message schema or rate is stated on this page, and none should be assumed. Name the streams that matter in the skill spec and confirm them on a Spec Pilot batch. The fourth table below sets each stream beside what the site states about it.
Failure modes
Hands are the first risk. A vacuum tool or a brush is gripped and guided by the hands, so the contact point is often hidden. The visibility flag on each joint is the answer the site gives, and contact events mark when a hand or tool meets an item. A spec can also ask for wrist views, so a grip the head camera loses is still recorded.
The cabin is the second. The site states that a multiview rig adds a second angle when the cabin blocks the first-person view, so a spec for interior work should say whether a second angle is wanted. Depth is the third: the site says depth degrades on wet and reflective surfaces and masks low-confidence regions with per-frame confidence maps, and an episode is rejected when more than 35 percent of depth pixels in the manipulation region are invalid. It states nothing about depth on seats, mats or trim, so this page promises no figure.
Calibration is the fourth, because stereo depth is only as good as the rectification behind it: calibration is measured at the start and end of every session under a 0.28 px RMS gate. An episode is also rejected when the manipulated object is out of frame for more than 15 percent of it or an undocumented bystander appears, and a reject log ships with every batch.
Privacy
A detailing shop is a shared space, so bystanders matter, and a vehicle can carry a plate. For every delivered episode the site states that faces, plates and screens are detected and irreversibly blurred at ingest, that a reviewer confirms the result before anything ships, and that footage that cannot be de-identified is discarded. The anonymization record is delivered with the data, and every episode links to a signed contributor release through a documented consent chain.
The site states no contributor safety protocol, no guidance on cleaning products or chemicals, no cleanliness result and no certification for either interior row, so this page describes none. Capture at your own facility is listed as not offered.
Scale
Off-the-shelf covers what is already in stock: the stereo category lists the stereo datasets and hand-tracking video, and only dataset 06 is stated as MCAP. This page does not claim off-the-shelf coverage of the interior rows, so this is custom collection: custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.
Where coverage is deep, the median time from signed spec to first validated batch is a median of 48 hours; where it is thin, turnaround runs three to four weeks. The site does not say which applies to these rows, so ask when you request the quote. Collections are billed per validated hour, and no delivered hours are claimed for either row.
Ordering
Describe the tool, the surfaces, the setting and the steps in order, what counts as one completed pass, and the variation your pipeline is missing. Then name the streams you want in the file, the topic naming and message encoding your reader expects, whether calibration ships inside the file or beside it, and whether MCAP is the only delivery or sits beside RLDS, LeRobot or WebDataset.
Most programs begin with a Spec Pilot, a small first batch that proves the spec and accept criteria on real footage before you scale. The fifth table below shows what each spec element decides.
At a glance
Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.
Catalog rows
| Task (as listed) | Description (as listed) | Environment | Skill | Capture setup | Status |
|---|---|---|---|---|---|
| Car Interior Vacuuming | Vacuuming and cleaning vehicle interiors, seats, mats and trim. | Car Wash & Detailing | Easy | Phone (head-mounted) / multiview rig | Active collection |
| Vacuum, wipe, and condition vehicle interiors using a shop vacuum and detailing brushes. | Automotive detailing shop with wash bays, polishing stations, and detailing supplies. | Car Wash & Detailing | Easy | Phone (head-mounted) / multiview rig | Active collection |
Compared pages
| Page | Rows it covers | Treatment of the interior rows |
|---|---|---|
| This page: stereo car interior vacuuming and detailing data | The two vehicle interior rows, both Easy and Active collection | Stereo pair and MCAP delivery, stream map and failure modes for these rows only |
| Egocentric car washing and detailing data | The Car Wash & Detailing vocabulary, including exterior washing, polishing and wheel and tire dressing | Egocentric catalog treatment, ten streams; no stereo or MCAP treatment |
| Stereo car detailing and polishing data | Three exterior rows: the polisher row, the wash, clay and dry row and Car Drying & Buffing | Not covered |
| Egocentric vacuuming data | Four vacuuming rows across offices, corridors and vehicle interiors; three Active collection and one Ready to deploy | Covered as two of four rows, with egocentric catalog treatment |
| Stereo vacuuming and surface sanitizing data | The office vacuuming row and a sanitizing row | Not covered |
Stated vs not stated
| Item | What the site states | For an interior order |
|---|---|---|
| Catalog capture setup | Phone (head-mounted) / multiview rig on both rows | A stereo pair is a spec choice; not stated on the rows |
| Multiview rig in a cabin | Adds a second angle when the cabin blocks the first-person view | Stated; whether an order uses it is set in the spec |
| Stereo head rig (dataset 06) | Dual fisheye, 1080p per eye, 62 mm baseline, per-unit calibration, 9-axis IMU, hand-tracking output; shipped as MCAP | Whether an interior order uses it: Not stated |
| Hard-environments stack | 4K/60 head camera, 120° lens; two 1080p/60 wrist cameras; depth 848×480 at 30 fps; 200 Hz 6-DoF IMU | Whether an interior order uses it: Not stated |
| Depth on wet and reflective surfaces | Degrades; per-frame confidence maps mask low-confidence regions | Stated; behaviour on seats, mats and trim is Not stated |
| Calibration | Measured every session and shipped with the episode; 0.28 px RMS reprojection gate | Stated |
| Synchronization | Hardware-triggered onto one clock; 2.0 ms cross-stream ceiling | Stated |
| Hand pose | 21 joints per hand with a per-joint visibility flag | Stated |
| Vehicle model, upholstery or material, cleaning product, vacuum or brush brand, suction or force data, cleanliness results, safety or certification | Not stated; the rows say a shop vacuum, detailing brushes, seats, mats and trim only | Agreed in the skill spec, or not claimed on this page |
| MCAP topics, schemas, rates | Not stated | Agreed in the skill spec |
Stream map
| Stream or item | What the site states | In an MCAP delivery, as the site states it |
|---|---|---|
| Stereo pair | Dual fisheye, 1080p per eye, 62 mm baseline (dataset 06) | Dataset 06 is stated as shipped as MCAP; channel layout not stated |
| Depth with confidence maps | Recovered from the calibrated stereo pair; confidence map masks low-confidence regions | Not stated |
| Hand pose | 21 joints per hand with a per-joint visibility flag | Channel layout and joint order not stated |
| IMU | 9-axis (dataset 06); 6-DoF at 200 Hz (hard-environments stack) | Channel layout and rate not stated |
| Contact events, action segments, instance masks | Listed in the site’s episode schema; masks stored at 848×480 | Not stated |
| Task instruction | One per episode | Not stated |
| Calibration | Measured every session and shipped with the episode | Placement in the file not stated |
| Topic names, schemas, encoding, rates | Not stated | Agreed in the skill spec |
Skill spec
| Spec element | What it decides | Where it shows up |
|---|---|---|
| Step and order | What one step is: vacuum, clean, wipe or condition | Episode boundaries and action segments; set per program |
| Which row | "Car Interior Vacuuming" or the shop vacuum and detailing brushes row | Set per program; both are Easy |
| Surface | Seats, mats or trim, as the rows name them | Set per program |
| Episode boundary | One surface, one pass or one full interior | Set per program; the site does not state an episode length |
| Rig and streams | Stereo pair, second angle, wrist views, hand pose, IMU and any others | The channels you can read; confirm on the Spec Pilot |
| MCAP topics and encoding | What your reader expects | Set per program |
| Calibration delivery | Inside the file or beside it | Set per program |
| Delivery format | How the data is packaged | MCAP alone, or beside RLDS, LeRobot, WebDataset, HDF5 or zarr |
| Accept criteria | What passes QA | Reject log per batch |
| Privacy | How people in frame are protected | Faces, plates and screens blurred at ingest |
| License | Who owns the dataset | Perpetual, irrevocable, buyer-owned, non-exclusive by default |
Example footage
Two real clips already published on this site. The first is a household chores clip of an operator carrying a cordless vacuum down a staircase into a living room, a first-person hands-on clip hosted on the site. The second is a format and rig example: a head-mounted stereo capture with hands in frame. Neither shows a vehicle interior or car detailing.
No car interior vacuuming or detailing clip is published on the site, so these are labelled as format and rig examples. Request a sample to see delivered files. See stereo sample page, stereo + wrist-cam example videos, request an egocentric data sample.
FAQ
Sources
Tell us the tool, the surfaces, the setting, the steps and their order, the streams you want in the file and whether MCAP sits alone or beside a training format. We will quote reach, timeline and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.