Stereo Layout Marking and Taping Data

It is first-person video of a person laying out and marking work, or taping and masking a surface, recorded from their own point of view with two calibrated cameras and with hand pose and sensor streams alongside. The tasks are the ones the site’s catalog lists for measuring, marking and layout, for drywall taping and mudding, and for masking edges in painting. Stereo describes the capture, and MCAP describes the container. They are separate choices.

The site does not state that stereo is already running on these rows. The catalog lists a head-mounted phone or a multiview rig as the capture setup, and a stereo pair is a capture choice agreed in the skill spec and confirmed on a Spec Pilot. The data is human capture by paid, consented contributors, not robot or teleoperation data. Firsthand is not affiliated with Foxglove or the MCAP maintainers.

The egocentric measuring and marking page covers nineteen rows across ten environments, with their labels and what is not stated, and the egocentric drywall and wall finishing page covers the two drywall rows. This page does not repeat them. It covers the two choices layered on top of a subset of the same rows: a calibrated stereo pair for depth, and MCAP as the delivery container.

The rows are the same and the claims are as limited. This page states no measured value, unit, tolerance, accuracy, finish-quality or force figure, because the site states none, and it states no safety or certification position for any of these environments. The finishing side of the same work, sanding, mudding coats and painting, is covered on the stereo surface finishing page.

Eleven rows count. Eight are measuring, marking and layout rows: Cut and shape wood panels, Measure and cut lumber, Carpentry, Mark and lay out sheet metal, Part Layout & Marking, Hang a fixture, Measure, mark, cut, and Arrange and align tables and chairs. Two are drywall taping rows, Drywall Hanging, Taping & Mudding and Hang and tape drywall panels using a screw gun and taping knife. One is a masking row, Painting & Priming, whose description opens with masking edges. The first table below reproduces each as the catalog states it.

Statuses range from Ready to deploy and Active collection to Available on request, and Hang a fixture and Measure, mark, cut are recorded with a multiview rig and handheld grippers instead. The site states no tape-measure model, tool, unit, panel size or tolerance for any row.

Tape means three different things in the catalog, and only some count here. Drywall taping is a row: tape the joints and apply compound, or tape and mud the seams with a taping knife. A tape for measuring appears in the lumber row, which measures and marks lumber with a tape before cutting it to length. Masking edges before painting is the opening step of the painting row.

Packing and sealing tape is a different task. Logistics and packing rows that tape a carton shut are not counted here, and neither is any row where the site says nothing about tape. This page claims no taping of anything beyond the rows quoted in the first table.

Layout and taping are about the state of a surface: where a line sits, whether a joint is covered, whether an edge is masked. A stereo pair recovers depth from the calibrated frame pair rather than from a standalone depth sensor, so the form of the stud, panel or wall sits in the same frame as the hands. The site gives no depth accuracy figure and no measured-value label, so whether a pencil line or a tape edge is resolvable in depth is Not stated.

The hard-environments page states that stereo keeps working outdoors where active depth sensors struggle, and that many programs capture both and sync them on one clock. Whether a layout or taping setting is a room, a workshop or a site exterior is not something every row states, so that is agreed in the spec.

The site describes two stereo setups and does not say which one a layout or taping order uses. The hard-environments stack is a global-shutter 4K/60 head camera with a 120° lens, two 1080p/60 wrist cameras, a depth sensor at 848×480 and 30 fps, and 200 Hz 6-DoF IMUs. The off-the-shelf stereo head rig, dataset 06, is dual fisheye cameras at 1080p per eye, a 62 mm baseline, per-unit calibration, a 9-axis IMU and hand-tracking output.

Which rig, resolution and streams a layout or taping order uses is Not stated on the site, and the second table below sets what is stated beside what is not. Intrinsics and extrinsics are re-solved at the start and end of every session, and streams are hardware-triggered onto one clock with a 2.0 ms cross-stream ceiling.

MCAP is an open source container file format for multimodal log data, supporting multiple channels of timestamped pre-serialized data. It is serialization-agnostic, so messages can be Protobuf, DDS (CDR), ROS, JSON and more. Its design is row-oriented and append-only, it stores schemas alongside the data, and it offers an optional index plus optional LZ4 or Zstandard chunk compression.

Reader and writer libraries exist for C++, Go, Python, Rust, Swift and TypeScript, and the mcap CLI can inspect, merge and split files. The foxglove/mcap repository is MIT-licensed; that is the MCAP project’s licence, not the licence of a Firsthand delivery. The MCAP hub page and the glossary entry cover the format in full.

Firsthand offers MCAP delivery, and dataset 06 is stated as shipping as MCAP. For layout and taping work the site states hand pose, a stereo-derived depth stream, IMU, contact events, action segments and per-frame instance masks elsewhere. What it does not state is which of those are channels in an MCAP file, how they are named, what encoding they use or at what rate.

No topic name, message schema or rate is stated on this page, and none should be assumed. Name the streams that matter in the skill spec and confirm them on a Spec Pilot batch. The third table below sets each stream beside what the site states about it.

Hands are the first risk. A square, a pencil, a tape or a taping knife sits against the surface and the fingers wrap it, so the contact point is often hidden. The visibility flag on each joint is the answer the site gives, and contact events mark when a hand meets the item. A spec can also ask for wrist views, so a grip the head camera loses is still recorded.

Depth is the second. The site says depth degrades on wet and reflective surfaces and masks low-confidence regions with per-frame confidence maps, and an episode is rejected when more than 35 percent of depth pixels in the manipulation region are invalid. Fresh joint compound is a wet surface, but the site does not say how depth behaves on it, so this page promises no figure.

Calibration is the third, because stereo depth is only as good as the rectification behind it: calibration is measured at the start and end of every session under a 0.28 px RMS gate. An episode is also rejected when the manipulated object is out of frame for more than 15 percent of it or an undocumented bystander appears, and a reject log ships with every batch. The site lists no measured-value, accuracy, finish-quality or force label.

Off-the-shelf covers what is already in stock: the stereo category lists the stereo datasets and hand-tracking video, and only dataset 06 is stated as MCAP. This page does not claim off-the-shelf coverage of the measuring, marking, taping or masking rows. Custom collection covers the rest: custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.

Where coverage is deep, the median time from signed spec to first validated batch is a median of 48 hours; where it is thin, turnaround runs three to four weeks. The site does not say which applies to these rows, so ask when you request the quote. Collections are billed per validated hour, and capture at your own facility is listed as not offered.

Describe the measuring, marking, taping or masking steps and their order, what counts as a completed step, the surface and the setting, and the variation your pipeline is missing. Then name the streams you want in the file, the topic naming and message encoding your reader expects, whether calibration ships inside the file or beside it, and whether MCAP is the only delivery or sits beside RLDS, LeRobot or WebDataset.

Most programs begin with a Spec Pilot, a small first batch that proves the spec and accept criteria on real footage before you scale. The fourth table below shows what each spec element decides.