Depth across the device, the tool and the hand
The site states that a stereo pair at human-eye spacing makes depth recoverable from every frame pair, so the open device, the tool and the fingers that handle it sit in one frame.
Now recruiting capture teams worldwide. Get paid to record first-person video of real work.
Apply to captureTask family
Why stereo and MCAP here
The site states that a stereo pair at human-eye spacing makes depth recoverable from every frame pair, so the open device, the tool and the fingers that handle it sit in one frame.
3D hand pose carries a per-joint visibility flag, so a finger hidden behind a casing, a lifted cover or a tool is flagged as hidden rather than silently guessed, and contact events mark when a hand takes hold of a part or a tool.
The Device Repair row names diagnosing and repairing, and the neighbouring Electronics repair row names opening the device, diagnosing the fault, replacing the screen, battery or board and testing. Streams are hardware-triggered onto one clock with a 2.0 ms cross-stream ceiling, and action segments carry start, end, verb and noun as the skill spec defines them.
MCAP stores multiple channels of timestamped, pre-serialized data, so a stereo pair, hand pose and IMU can share one file on one log-time axis. Which streams go in the file is set in the skill spec.
Definition
It is first-person video of a person doing device repair work: diagnosing and repairing phones, laptops, tablets and consumer electronics at a repair counter. It is recorded from their own point of view with two calibrated cameras, with hand pose and sensor streams alongside. Stereo describes the capture, and MCAP describes the container. They are separate choices.
The site does not state that stereo is already running on this row. The catalog lists a head-mounted phone or a multiview rig as its capture setup, so a stereo pair is a capture choice agreed in the skill spec and confirmed on a Spec Pilot. The data is human capture by paid, consented contributors, not robot or teleoperation data. The site does not state device models, repair outcomes, turnaround or a diagnosis label, so this page promises none. Firsthand is not affiliated with Foxglove or the MCAP maintainers.
Catalog row
One, in the Electronics & Device Repair Shop environment of the Repair Services sector. It is named "Device Repair", rated Hard, and described as "Diagnosing and repairing phones, laptops, tablets and consumer electronics." The example the catalog gives for the environment is a phone, laptop and consumer electronics repair counter. It lists a head-mounted phone or a multiview rig as the capture setup, and its status is Active collection, which the site describes as recording running now.
The site says nothing about delivered hours or delivered stereo footage for this row, so this page claims none. The row names only categories of device: phones, laptops, tablets and consumer electronics. It names no tool, brand or model. A neighbouring row in the Repair Shop environment, "Electronics repair" (Hard, Available on request), reads "Open the device, diagnose the fault, replace the screen, battery or board and test." This page uses it only to describe the steps a repair spec can name, and the first table below reproduces both rows as the catalog states them.
Difference
The egocentric electronics and device repair page covers the Device Repair row and its neighbours with egocentric catalog treatment and has no stereo or MCAP treatment. The stereo soldering and circuit board assembly page gives stereo and MCAP treatment to two board rows, and the stereo e-waste disassembly and sorting page does the same for one teardown row. Neither stereo page names a fault, a diagnosis or a replacement.
This page is the stereo and MCAP treatment of the Device Repair row, with its own stream map and failure modes. The comparison table below sets the pages side by side, with each row status stated as the live catalog lists it.
Why stereo
Repair is about where a part is, what the hand does to reach it and how the device changes as it is opened: a cover lifted, a part eased out, a replacement seated. A stereo pair recovers depth from the calibrated frame pair rather than from a standalone depth sensor, so the device, the tool and the hands share a frame. The site gives no depth accuracy figure for this row and no diagnosis, fault or repair-outcome label, so what a buyer does with that depth is their pipeline question.
A stereo pair adds depth, not a verdict on the repair. The site states 1080p per eye for dataset 06 and gives no figure for how well small parts such as screws or connectors resolve, so that is Not stated and a spec should check it on a Spec Pilot. The site states that Firsthand does not capture at a customer’s own facility and names no repair shop.
Hand pose
The site states 3D hand pose of 21 joints per hand with a per-joint visibility flag, and contact and grasp events that mark when fingers meet a tool or an item. It also states that fine manipulation happens at the fingertip and that wrist-level capture loses that signal. In this row that is the fingers lifting a cover, easing out a part and seating a replacement.
The site does not say how finely hand pose resolves very small parts, and it does not say whether the casing, the part or the tool counts as the object for contact events, so settle both in the spec. Wrist cameras give a closer view of the hands, and a multiview rig adds synchronized third-person angles when the spec asks for them.
Capture setup
The site describes two stereo setups and does not say which one a device repair order uses. The hard-environments stack is a global-shutter 4K/60 head camera with a 120° lens, two 1080p/60 wrist cameras, a depth sensor at 848×480 and 30 fps, and 200 Hz 6-DoF IMUs. The off-the-shelf stereo head rig, dataset 06, is dual fisheye cameras at 1080p per eye, a 62 mm baseline, per-unit calibration, a 9-axis IMU and hand-tracking output.
Which rig, resolution and streams a device repair order uses is Not stated on the site, and the third table below sets what is stated beside what is not. Intrinsics and extrinsics are re-solved at the start and end of every session, and streams are hardware-triggered onto one clock with a 2.0 ms cross-stream ceiling. Counter layout, lighting, tools, magnification and camera clearance are Not stated, so any requirement is settled in the spec.
MCAP
MCAP is an open source container file format for multimodal log data, supporting multiple channels of timestamped pre-serialized data. It is serialization-agnostic, so messages can be Protobuf, DDS (CDR), ROS, JSON and more. Its design is row-oriented and append-only, it stores schemas alongside the data, and it offers an optional index plus optional LZ4 or Zstandard chunk compression.
Reader and writer libraries exist for C++, Go, Python, Rust, Swift and TypeScript, and the mcap CLI can inspect, merge and split files. The foxglove/mcap repository is MIT-licensed; that is the MCAP project licence, not the licence of a Firsthand delivery. The MCAP hub page and the glossary entry cover the format in full.
Streams
Firsthand offers MCAP delivery, and dataset 06 is stated as shipping as MCAP. For this row the site states hand pose, a stereo-derived depth stream with confidence maps, IMU, contact events, action segments and per-frame instance masks elsewhere. What it does not state is which of those are channels in an MCAP file, how they are named, what encoding they use or at what rate.
No topic name, message schema or rate is stated on this page, and none should be assumed. Name the streams that matter in the skill spec and confirm them on a Spec Pilot batch. The fourth table below sets each stream beside what the site states about it.
Failure modes
Hand occlusion is the first risk. A casing, a lifted cover or a tool can hide the fingers that hold a part. The visibility flag on each joint is the answer the site gives, contact events mark when a hand takes hold of a part or a tool, and a spec can ask for wrist views or a second angle so a grip the head camera loses is still recorded. An episode is rejected when the manipulated object is out of frame for more than 15 percent of it.
Reflective screens and glossy casings are the second. The site describes glossy or dark surfaces and small parts held close to the lens as places where a single camera loses information, and it states that depth degrades on wet and reflective surfaces and ships per-frame confidence maps so a buyer can mask rather than guess. How a stereo pair behaves on a phone screen or a glossy casing is Not stated. An episode is rejected when more than 35 percent of depth pixels in the manipulation region are invalid.
Close working distance is the third. Distance-invalid pixels beyond the depth sensor reliable range are flagged rather than interpolated, but the site does not state how depth behaves at the close range of a repair counter, so raise it in the spec if your policy relies on it. Small parts and fine fingertip manipulation are the fourth: the site gives no figure for how finely hand pose resolves very small parts, so that is Not stated and should be checked on a Spec Pilot.
Sequence and calibration close the list. The row names diagnosing and repairing without splitting them into stages, so a spec naming each step and where it starts and ends gives a sequence that can be sliced by step, while a spec saying “repair the device” gives one long action segment. Stereo depth is only as good as the rectification behind it: calibration is measured at the start and end of every session under a 0.28 px RMS gate. An episode is also rejected when an undocumented bystander appears, and a reject log ships with every batch. Device brands or models, repair success or turnaround rates, throughput, repair-shop or customer names, tool brands and ESD or safety certifications are Not stated and are not claimed here.
Privacy
For every delivered episode the site states that faces, plates and screens are blurred irreversibly, and that footage that cannot be de-identified is discarded. The anonymization record ships with the data, and an undocumented bystander is a stated reject criterion.
The site does not state a rule specific to a repair counter, customer data stored on a device, a data wipe before repair, or serial numbers and labels on a casing, so this page makes no such claim. Settle it in the spec.
Scale
The October 2026 off-the-shelf catalog lists ~324,800 hours across 18 datasets, of which stereo is ~64,800 hours across 9 datasets. One listed dataset, M3, is mono: about 50,000 hours of smartphone RGB video whose environment is labelled “Electronics and components: handling, assembly and repair”. Being mono, it has no stereo pair, and the site does not state that it contains device repair task video. The site lists no off-the-shelf stereo device repair dataset.
Stereo device repair in MCAP is therefore custom repair shop data collection: custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs. Where coverage is deep, the median time from signed spec to first validated batch is a median of 48 hours; where it is thin, turnaround runs three to four weeks. The site does not say which speed applies to a stereo device repair order, so the timeline is quoted against your spec. Collections are billed per validated hour, and rejected episodes and recaptures are never billed.
Ordering
Describe the steps and where each starts and ends: diagnosing, opening, replacing a part and testing. Name the device categories you expect to see, whether an episode covers one repair or a longer stretch of work, what counts as a reject and the variation your pipeline is missing. Then name the streams you want in the file, the topic naming and message encoding your reader expects, whether calibration ships inside the file or beside it, and whether MCAP is the only delivery or sits beside RLDS, LeRobot or WebDataset.
Most programs begin with a Spec Pilot, a small first batch that proves the spec and accept criteria on real footage before you scale. The fifth table below shows what each spec element decides.
At a glance
Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.
Catalog row
| Task (as listed) | Description (as listed) | Environment | Skill | Capture setup | Status |
|---|---|---|---|---|---|
| Device Repair | Diagnosing and repairing phones, laptops, tablets and consumer electronics. | Electronics & Device Repair Shop | Hard | Phone (head-mounted) / multiview rig | Active collection |
| Electronics repair (neighbouring row) | Open the device, diagnose the fault, replace the screen, battery or board and test. | Repair Shop (appliance, bicycle, shoe, watch, furniture) | Hard | Phone (head-mounted) / multiview rig | Available on request |
Compared pages
| Page | What it covers | Row status as listed | Treatment of device repair |
|---|---|---|---|
| This page: stereo electronics and device repair data | The Device Repair row in Electronics & Device Repair Shop | Active collection | Stereo pair and MCAP delivery, stream map and failure modes for this row |
| Egocentric electronics and device repair data | The Device Repair row plus the Electronics repair, Appliance repair and Watch repair rows and neighbouring electronics rows | Active collection on Device Repair; Available on request on the others | Egocentric catalog treatment; no stereo or MCAP treatment |
| Stereo soldering and circuit board assembly data | Two rows in Electronics Manufacturing & E-Waste: Circuit board assembly (Medium) and Component soldering (Hard) | Available on request on both | Not covered; stereo and MCAP treatment of board work, no diagnosis or replacement row |
| Stereo e-waste disassembly and sorting data | One row in Electronics Manufacturing & E-Waste: E-waste disassembly and sorting (Medium) | Available on request | Not covered; stereo and MCAP treatment of device teardown and sorting, no repair row |
| Egocentric stereo data in MCAP | The stereo and MCAP hub across tasks | Not applicable | General stereo and MCAP treatment; not specific to repair |
Stated vs not stated
| Item | What the site states | For a device repair order |
|---|---|---|
| Catalog capture setup | Phone (head-mounted) / multiview rig on the Device Repair row | A stereo pair is a spec choice; not stated on the row |
| Stereo head rig (dataset 06) | Dual fisheye, 1080p per eye, 62 mm baseline, per-unit calibration, 9-axis IMU, hand-tracking output; shipped as MCAP | Whether a device repair order uses it: Not stated |
| Hard-environments stack | 4K/60 head camera, 120° lens; two 1080p/60 wrist cameras; depth 848×480 at 30 fps; 200 Hz 6-DoF IMU | Whether a device repair order uses it: Not stated |
| Objects, hands and masks | Per-frame instance masks stored at 848×480; per-joint visibility flag on hand pose; contact events | Stated; whether the casing, the part or the tool counts as the object is Not stated |
| Depth on reflective surfaces | Depth degrades on wet and reflective surfaces; per-frame confidence maps ship so a buyer can mask | Behavior on a screen or glossy casing: Not stated |
| Depth at close range | Distance-invalid pixels beyond the sensor reliable range are flagged, not interpolated | Behavior at the close range of a repair counter: Not stated |
| Hand pose on very small parts | No figure for how finely hand pose resolves very small parts | Not stated; check on a Spec Pilot |
| Calibration | Measured every session and shipped with the episode; 0.28 px RMS reprojection gate | Stated |
| Synchronization | Hardware-triggered onto one clock; 2.0 ms cross-stream ceiling | Stated |
| Row status | Device Repair is Active collection | No volume, hours or delivered stereo footage is claimed on this page |
| Device brands or models, repair success or turnaround rates, throughput | Not stated | Not claimed on this page; set in the spec |
| Repair-shop or customer names; tool brands; ESD or safety certifications | Not stated | Not claimed on this page |
| MCAP topics, schemas, rates | Not stated | Agreed in the skill spec |
Stream map
| Stream or item | What the site states | In an MCAP delivery, as the site states it |
|---|---|---|
| Stereo pair | Dual fisheye, 1080p per eye, 62 mm baseline (dataset 06) | Dataset 06 is stated as shipped as MCAP; channel layout not stated |
| Depth with confidence maps | Recovered from the calibrated stereo pair; confidence map masks low-confidence regions | Not stated |
| Hand pose | 21 joints per hand with a per-joint visibility flag | Channel layout and joint order not stated |
| IMU | 9-axis (dataset 06); 6-DoF at 200 Hz (hard-environments stack) | Channel layout and rate not stated |
| Contact events, action segments, instance masks | Listed in the site episode schema; masks stored at 848×480 | Not stated |
| Task instruction | One per episode | Not stated |
| Calibration | Measured every session and shipped with the episode | Placement in the file not stated |
| Topic names, schemas, encoding, rates | Not stated | Agreed in the skill spec |
Skill spec
| Spec element | What it decides | Where it shows up |
|---|---|---|
| Which row | Device Repair, or the neighbouring Electronics repair steps | Set per program; Device Repair is Hard and Active collection |
| Steps and order | What one step is: diagnose, open, replace a part, test | Episode boundaries and action segments; set per program |
| Episode scope | One repair or a longer stretch of work | Set per program; the site does not state an episode length for this row |
| Rig and streams | Stereo pair, wrist views, a second angle, hand pose, IMU and any others | The channels you can read; confirm on the Spec Pilot |
| Object definition | Whether the casing, the part or the tool counts as the object | Contact events; set per program |
| Surface and distance checks | Whether a Spec Pilot should check depth on screens, glossy casings and at close range | Set per program; the site states no figure |
| MCAP topics and encoding | What your reader expects | Set per program |
| Delivery format | How the data is packaged | MCAP alone, or beside RLDS, LeRobot, WebDataset, HDF5 or zarr |
| Accept criteria | What passes QA, including what counts as a reject | Reject log per batch |
| Privacy | How people, plates and screens in frame are protected | Faces, plates and screens blurred at ingest |
| License | Who owns the dataset | Perpetual, irrevocable, buyer-owned, non-exclusive by default |
Example footage
One real clip already published on this site, shown as a format and rig example: a head-mounted stereo capture with hands in frame. It does not show device repair work.
No device repair clip is published on the site, so this is labelled as a format and rig example. Request a sample to see delivered files. See stereo sample page, stereo + wrist-cam example videos, request an egocentric data sample.
FAQ
Sources
Tell us the steps and where each starts and ends, the device categories you expect to see, whether an episode covers one repair or a longer stretch of work, the streams you want in the file and whether MCAP sits alone or beside a training format. We will quote reach, timeline and price against a written spec.