Now recruiting capture teams worldwide. Get paid to record first-person video of real work.

Apply to capture

Mural painting

Stereo Mural Painting Data

Sketching an outline on a wall, covering large areas, then working the details with a roller or brush is a job where the tool keeps covering the fingers that hold it and the surface is far larger than any one frame. This page covers the stereo and container side of mural painting robot training data for the one catalog row that names this work: what a calibrated stereo pair adds to stereo wall mural painting video, what MCAP is according to its own documentation, and what the site does not state. We run custom art studio data collection fast and on demand against a spec you write, as an egocentric large-format painting dataset when the spec names it, delivered as MCAP, as custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.
Catalog row
"Mural work"; Medium; Available on request
Environment
Art Studio (painting, sculpture, printmaking)
Container
MCAP (.mcap), open source
License
Perpetual, buyer-owned

Why stereo and MCAP here

What do a stereo pair and an MCAP file add to wall mural painting video?

01

Depth for a surface larger than the frame

The site states that a stereo pair at human-eye spacing makes depth recoverable from every frame pair, so the roller or brush, the hands and the wall sit in one frame. The site gives no depth accuracy figure for this row and does not say how depth behaves on a painted wall.

02

Fingers hidden behind the tool, flagged not guessed

The site states that fingers disappear behind objects and that the hands occlude the work. 3D hand pose carries a per-joint visibility flag, so a finger behind a roller handle or a brush is marked as hidden rather than silently filled in.

03

Three stages as separate steps

The row words the job as an outline, then large areas, then details. Action segments carry start_ns, end_ns, verb and noun, so each stage can be a labeled span. Which verbs and nouns are used is set in the skill spec.

04

Several streams in one container

MCAP stores multiple channels of timestamped, pre-serialized data, so a stereo pair, hand pose and IMU can share one file on one log-time axis. Which streams go in the file is set in the skill spec.

Definition

What is stereo mural painting data?

It is first-person video of a person painting a wall, recorded with two calibrated cameras, with hand pose and sensor streams alongside. People reach it through several phrasings: mural painting robot training data, stereo wall mural painting video, an egocentric large-format painting dataset, or custom art studio data collection at scale. They describe one request from different angles. Stereo describes the capture, and MCAP describes the container. They are separate choices.

The site does not state that stereo is already running on this row. The catalog lists a head-mounted phone or a multiview rig as the capture setup, so a stereo pair is a capture choice agreed in the skill spec and confirmed on a Spec Pilot. The data is human capture by paid, consented contributors, not robot or teleoperation data, so using it for a specific robot still needs your own retargeting step. Firsthand is not affiliated with Foxglove or the MCAP maintainers.

Catalog row

Which catalog row does this page rely on, and what is its status?

One, listed in lib/commercial-catalog-data.ts under the Art Studio (painting, sculpture, printmaking) environment in the Creative Workshops & Crafts sector, whose examples line reads "Artist studio, canvas painting, sculpting, mural work, printmaking". "Mural work" is described as "Sketch the outline on the wall and paint large areas and details with rollers and brushes." It is rated Medium and listed as Available on request, with the capture setup "Phone (head-mounted) / multiview rig".

The site defines Available on request as work that a spec starts, rather than a running capture stream a spec can join. That is a statement about the catalog row, not a promise of a delivery date. The site states no delivered hours and no delivered stereo footage for this row, so this page claims none. The first table below reproduces the row beside the three other Art Studio rows.

Difference

How is this different from the egocentric mural, stereo art studio and stereo painting and coating pages?

This page is the stereo and MCAP treatment of the single Mural work row. The egocentric mural painting page covers the same row as first-person video and does not have stereo as its subject; it remains the page for the first-person framing. The stereo art studio painting and sculpting page covers all four Art Studio rows with stereo and MCAP as its subject, so mural work is one row of four there.

The stereo painting and coating page is stereo too, but it counts four finishing-trade rows, such as painting and priming interior walls, and leaves canvas and mural work out. The egocentric arts and crafts page covers the four studio rows in first person. The second table below sets the pages side by side with their status as the site lists it.

Capture setup

What capture setup does the row list, and where does stereo come in?

The catalog lists "Phone (head-mounted) / multiview rig" for the Mural work row. The site does not state a stereo pair for it. Stereo applies through the site’s general stereo offer: a stereo pair is a capture choice agreed in the skill spec and confirmed on a Spec Pilot. The catalog does not say which of its two modes applies to a batch, and the site names no place where capture runs, so the setting is agreed in the spec.

The site describes two stereo setups and does not say which one an order for this row uses. The hard-environments stack is a global-shutter 4K/60 head camera with a 120° lens, two 1080p/60 wrist cameras, a depth sensor at 848×480 and 30 fps, and 200 Hz 6-DoF IMUs. The off-the-shelf stereo head rig, dataset 06, is dual fisheye cameras at 1080p per eye, a 62 mm baseline, per-unit calibration, a 9-axis IMU and hand-tracking output. Camera count, resolution and frame rate for mural work are Not stated.

Why stereo

Why capture wall painting in stereo?

A mural is close work on a large surface. The tool is in the hands for the whole task, and the wall it works on is far bigger than the frame. A stereo pair recovers depth from the calibrated frame pair rather than from a standalone depth sensor, so the geometry of the tool, the hands and the wall sits in the same capture that shows the fingers working.

The site does not state wall sizes, surface types, stroke widths or what a finished mural looks like, so this page makes no claim about them. A stereo pair adds depth, not a verdict on whether a wall is well painted. The site lists no completion or quality label for this row, and none is claimed.

Steps

Which steps of the Mural work row can a stereo spec label?

The row gives a natural cut: sketch the outline on the wall, paint large areas, then paint details, with rollers and brushes. A spec that says "paint the wall" gives one long action segment. A spec that names the outline, the large areas and the details gives a sequence you can slice by stage. Whether each is its own segment, and whether one stage or a whole wall is one episode, is a spec decision, not a default. The site does not set an episode length or a step count.

The site names no stroke, coat, pass count or finishing step, so a spec that needs them sets them. Contact events can mark when a hand or a tool meets the wall or each other, where the spec asks for them.

Large surfaces

What changes when the surface is larger than the frame?

The wearer has to move along the wall, so the view changes across an episode. The sensors include an IMU that records that motion, but the site states no head-motion figure for the row and no wall dimensions, so how much of a wall one episode covers is Not stated. A multiview rig can add synchronized third-person angles, which show where the wearer stands relative to the wall in a way a head view alone does not.

Fresh paint can read as a wet surface, and the site states that depth degrades on wet and reflective surfaces, with per-frame confidence maps masking low-confidence regions. How depth behaves on a given paint or wall is Not stated, so a Spec Pilot checks it on real footage.

Occlusion

What do the roller, the brush and the hands do to visibility?

A roller or brush covers the fingers that hold it, and a closing hand hides joints. The site states that the hands occlude the work and that fingers disappear behind objects. That is why each hand joint carries a visibility flag, why contact events mark when the hand or a tool meets a surface, and why instance masks are recorded per frame.

The site states no tool counts or sizes for this row, so how often a tool leaves the view is Not stated. The site says two-handed fine motion is where occlusion bites, and a spec that needs a clear view of a detail step should name that step, ask for wrist views or a multiview angle, and confirm it on a Spec Pilot.

Not stated

What does the site not state about mural work?

Paint types, roller and brush models or counts, wall or surface types and sizes, artworks, piece counts, task times, error rates, force or tactile data and what a correct or finished mural means are Not stated. No artist, studio, client or brand is named for the row, and none is used here. They are set in the written spec, and this page claims none of them.

A lighting setup for the row is Not stated. Where a program needs a specific layout, lighting or background, that goes into the spec and is checked on a Spec Pilot.

Safety and privacy

What does the site say about safety, consent and privacy?

Working-at-height and paint-fume safety are Not stated on the site. It states no contributor safety protocol, injury-prevention guidance or certification for the mural row, so this page describes none and gives no safety instructions. Who performs the work and under what conditions is something to raise when you scope the order.

For every delivered episode the site states that faces, plates and screens are detected and irreversibly blurred at ingest, that a reviewer confirms the result before anything ships, and that footage that cannot be de-identified is discarded. The anonymization record ships with the data, an undocumented bystander is a stated reject criterion, and every episode links to a signed contributor release through a documented consent chain. This is not legal advice, and the executed agreement controls.

MCAP

What is MCAP, per its own documentation?

MCAP is an open source container file format for multimodal log data, supporting multiple channels of timestamped pre-serialized data. It is serialization-agnostic, so messages can be Protobuf, DDS (CDR), ROS, JSON and more. Its design is row-oriented and append-only, it stores schemas alongside the data, and it offers an optional index plus optional LZ4 or Zstandard chunk compression.

Reader and writer libraries exist for C++, Go, Python, Rust, Swift and TypeScript, and the mcap CLI can inspect, merge and split files. The foxglove/mcap repository is MIT-licensed; that is the MCAP project licence, not the licence of a Firsthand delivery. The MCAP hub page and the glossary entry cover the format in full.

Streams

Which streams can ship in an MCAP delivery of mural painting data?

Firsthand offers MCAP delivery, and dataset 06 is stated as shipping as MCAP. For this row the site states hand pose, a stereo-derived depth stream with confidence maps, IMU, contact events, action segments, per-frame instance masks and one task instruction per episode elsewhere. What it does not state is which of those are channels in an MCAP file, how they are named, what encoding they use or at what rate.

No topic name, message schema or rate is stated on this page, and none should be assumed. Name the streams that matter in the skill spec and confirm them on a Spec Pilot batch. The fourth table below sets each stream beside what the site states about it.

Failure modes

What goes wrong when you record a mural in stereo, and what does QA reject?

Hand occlusion by the roller or brush is the first risk, handled by the visibility flag above. Head motion along a large surface is the second, and how much it affects a stereo pair is Not stated. Calibration is measured at the start and end of every session under a 0.28 px RMS gate, and an episode is rejected for a sync breach beyond the ceiling for more than three consecutive frames, for the manipulated object out of frame for more than 15 percent of the episode, for an undocumented bystander or for a mismatch against the named skill spec.

For a wall, what counts as the manipulated object, the tool, the painted area or the wall itself, is a spec decision, and it decides how the out-of-frame rule applies. A reject log ships with every batch, and rejected items are recaptured at the provider’s cost. The fifth table below lists the failure modes beside what the site states.

Scale

How do off-the-shelf coverage and custom collection combine for mural painting?

The October 2026 off-the-shelf catalog lists ~324,800 hours across 18 datasets, of which stereo is ~64,800 hours across 9 datasets. The site names no mural or wall painting dataset among them, so this work is custom collection, not an off-the-shelf purchase. The off-the-shelf stereo and hand-tracking video can still show the format before you write a spec.

It is custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs. Where coverage is deep, the median time from signed spec to first validated batch is a median of 48 hours; where it is thin, turnaround runs three to four weeks. The site does not say which applies to the Mural work row, so the timeline is quoted against your spec. Collections are billed per validated hour, and rejected episodes and recaptures are never billed.

Ordering

How do you order a stereo mural painting dataset?

Describe the three stages and where each starts and ends: the outline, the large areas and the details. Say whether an episode covers one stage or a whole wall, what counts as the object and as a reject, the setting and lighting, and the privacy rule for the studio. Then name the streams you want in the file, the topic naming and encoding your reader expects, and whether MCAP sits beside RLDS, LeRobot or WebDataset.

Most programs begin with a Spec Pilot, a small first batch that proves the spec and accept criteria on real footage before you scale. The sixth table below shows what each spec element decides.

At a glance

What you get.

Catalog row: Mural work
"Mural work" (Art Studio (painting, sculpture, printmaking), Creative Workshops & Crafts); Medium; Available on request
Catalog description
"Sketch the outline on the wall and paint large areas and details with rollers and brushes."
Catalog capture setup
Phone (head-mounted) / multiview rig. The site states no stereo pair for this row, so a stereo pair is agreed in the skill spec through the general stereo offer
Stereo head rig (06)
Dual fisheye, 1080p per eye, 62 mm baseline, per-unit calibration, 9-axis IMU, hand-tracking output; shipped as MCAP
Hand pose
21 joints per hand with a per-joint visibility flag
Sync
Hardware-triggered onto one clock; 2.0 ms cross-stream ceiling
Paint, tool models, wall sizes, surfaces, artworks, task times, error rates
Not stated; agreed in the skill spec
Working-at-height and paint-fume safety, consent and privacy of the studio
Not stated beyond the privacy steps listed below; nothing here is safety guidance
MCAP topics, schemas, rates
Not stated on the site; agreed in the skill spec
License
Perpetual, irrevocable, buyer-owned, non-exclusive by default

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

Catalog row

Which catalog row covers mural painting, and what is its status?

The Mural work row comes first, followed by the three other Art Studio rows for context, reproduced as lib/commercial-catalog-data.ts states them. Only Mural work is the subject of this page.
Task (as listed)Description (as listed)EnvironmentSkillCapture setupStatus
Mural workSketch the outline on the wall and paint large areas and details with rollers and brushes.Art Studio (painting, sculpture, printmaking)MediumPhone (head-mounted) / multiview rigAvailable on request
Canvas painting (context only)Mix paint on a palette and apply it to canvas with brushes and knives.Art Studio (painting, sculpture, printmaking)MediumPhone (head-mounted) / multiview rigAvailable on request
Printmaking (context only)Ink the plate or screen, position paper and pull prints through the press.Art Studio (painting, sculpture, printmaking)HardPhone (head-mounted) / multiview rigAvailable on request
Sculpting (context only)Shape clay, stone or wood with hands and tools into a three-dimensional form.Art Studio (painting, sculpture, printmaking)HardPhone (head-mounted) / multiview rigAvailable on request

Compared pages

How does this page differ from the egocentric mural, stereo art studio and stereo painting and coating pages?

Each page and what it covers. Statuses are as the site lists them; none of these pages is claimed to hold delivered hours here.
PageCaptureWhat it coversRow status as listedRelation to this page
This page: stereo mural painting dataStereo pair through the general offer; MCAP deliveryOne row: Mural workAvailable on request (Medium)Mural work as the main topic, in stereo
Egocentric mural painting dataEgocentric; phone or multiview rig as listedOne row: Mural workAvailable on request (Medium)Not stereo as its subject; the first-person page for the same row
Stereo art studio painting and sculpting dataStereo, agreed in the spec; MCAP focusFour Art Studio rows: Canvas painting, Mural work, Printmaking, SculptingAll four Available on requestThe whole studio in stereo; mural work is one row of four there
Egocentric arts and crafts dataEgocentric, not stereoThe same four Art Studio rowsAll four Available on requestThe studio family in first person; mural is one row of four
Stereo painting and coating dataStereo, agreed in the specFour trade rows: Painting & Priming, interior walls with rollers and brushes, Roll + cut-in paint, Staining & FinishingReady to deploy, Active collection, Available on request, Ready to deployStereo, but finishing trades; canvas and mural work are not counted
Egocentric stereo data in MCAPThe stereo and MCAP hub across tasksNot applicableNot applicableGeneral stereo and MCAP treatment; not specific to mural work

Stated vs not stated

What the site states about stereo capture for mural painting

Left to right: the item, what the site states, and what that means for a mural order. “Not stated” means the site does not say.
ItemWhat the site statesFor a mural order
Catalog capture setupPhone (head-mounted) / multiview rig on the Mural work rowNo stereo pair is stated for this row; a stereo pair is a spec choice through the general stereo offer
Stereo head rig (dataset 06)Dual fisheye, 1080p per eye, 62 mm baseline, per-unit calibration, 9-axis IMU, hand-tracking output; shipped as MCAPWhether an order uses it: Not stated
Hard-environments stack4K/60 head camera, 120° lens; two 1080p/60 wrist cameras; depth 848×480 at 30 fps; 200 Hz 6-DoF IMUWhether an order uses it: Not stated
Hands, contacts and masksPer-joint visibility flag on hand pose; contact events; per-frame instance masks stored at 848×480Stated; what counts as the object is set in the spec
Hand occlusionThe hands occlude the work and fingers disappear behind objects; visibility flags and instance masks address itStated; how often a roller or brush hides the fingers is Not stated
Depth on wet and reflective surfacesDepth degrades on wet and reflective surfaces; confidence maps mask low-confidence regionsStated; behaviour on a painted wall is Not stated
CalibrationMeasured every session and shipped with the episode; 0.28 px RMS reprojection gateStated
SynchronizationHardware-triggered onto one clock; 2.0 ms cross-stream ceilingStated
Row statusMural work is Available on requestNo volume, hours or delivered stereo footage is claimed on this page
Paint, tools, wall type and size, lightingNot statedNot claimed; set in the spec
Working-at-height and paint-fume safetyNot stated; no contributor safety protocol, injury-prevention guidance or certification for the rowNot claimed; no safety instructions are given
Task time, error rate, finished-wall qualityNot statedNot claimed on this page
MCAP topics, schemas, ratesNot statedAgreed in the skill spec

Stream map

Streams for mural painting data and what the site states about an MCAP file

Left to right: the stream or item, what the site states about it, and what the site states about it in MCAP. “Not stated” means the site does not say.
Stream or itemWhat the site statesIn an MCAP delivery, as the site states it
Stereo pairDual fisheye, 1080p per eye, 62 mm baseline (dataset 06)Dataset 06 is stated as shipped as MCAP; channel layout not stated
Depth with confidence mapsRecovered from the calibrated stereo pair; confidence map masks low-confidence regionsNot stated
Hand pose21 joints per hand with a per-joint visibility flagChannel layout and joint order not stated
IMU9-axis (dataset 06); 6-DoF at 200 Hz (hard-environments stack)Channel layout and rate not stated
Contact events, action segments, instance masksListed in the site episode schema; masks stored at 848×480Not stated
Task instructionOne per episodeNot stated
CalibrationMeasured every session and shipped with the episodePlacement in the file not stated
Topic names, schemas, encoding, ratesNot statedAgreed in the skill spec

Failure modes and QA

What goes wrong in mural painting capture, and what QA does about it

Left to right: the failure mode, what the site states, and what a buyer sees. “Not stated” means the site does not say.
Failure modeWhat the site statesWhat a buyer sees
Fingers hidden behind a roller or brushPer-joint visibility flag on hand pose; wrist views and a multiview angle available in the specA hidden joint flagged as hidden, not guessed
Tool or painted area out of framePer-frame instance masks; episode rejected when the object is out of frame for more than 15 percent of itReject log per batch; what the object is gets set in the spec
Head motion along a large surfaceAn IMU is among the sensors; no head-motion figure is statedHow often it affects a pair: Not stated; set in the spec
Wet paint and reflective surfacesDepth degrades on wet and reflective surfaces; confidence maps mask low-confidence regionsConfidence maps ship with depth; behaviour on a given paint is Not stated
Thin detail linesMetric depth on sub-centimetre parts is flagged rather than interpolatedWhether a detail line counts: Not stated; test on a Spec Pilot
Invalid depth in the manipulation regionEpisode rejected when more than 35 percent of depth pixels are invalidReject log per batch
Bystander in frameFaces, plates and screens blurred and reviewer-confirmed; undocumented bystander rejected; footage that cannot be de-identified is discardedReject log per batch; anonymization record ships with the data
Calibration driftSolved at the start and end of every session; 0.28 px RMS gateCalibration shipped with the episode
Sync breachRejected beyond the 2.0 ms ceiling for more than three consecutive framesReject log per batch
Spec mismatchRejected for a mismatch against the named skill specReject log per batch

Skill spec

What the skill spec fixes for a stereo mural painting order

Spec element and where a buyer can see it in the delivery. “Set per program” means the site states no fixed value.
Spec elementWhat it decidesWhere it shows up
RowMural work, worded as the catalog words itSet per program; Available on request as listed
Steps and orderWhat one step is: the outline, the large areas or the detailsEpisode boundaries and action segments; set per program
Episode scopeOne stage or a whole wallSet per program; the site does not state an episode length
Object definitionWhether the tool, the painted area or the wall counts as the objectContact events and the out-of-frame reject rule; set per program
Rig and streamsStereo pair, multiview angles, wrist views, hand pose, IMU and any othersThe channels you can read; confirm on the Spec Pilot
Setting and lightingWhere capture runs and how the studio is litSet per program; the site states no lighting setup for this row
MCAP topics and encodingWhat your reader expectsSet per program
Delivery formatHow the data is packagedMCAP alone, or beside RLDS, LeRobot, WebDataset, HDF5 or zarr
Accept criteriaWhat passes QA, including what counts as a rejectReject log per batch
PrivacyHow people, screens and signage in frame are handledFaces, plates and screens blurred at ingest; other items agreed in the spec
LicenseWho owns the datasetPerpetual, irrevocable, buyer-owned, non-exclusive by default

Example footage

What does egocentric stereo capture look like?

One real clip already published on this site, shown as a format and rig example: a head-mounted stereo capture with hands in frame. It does not show mural painting, wall painting or any art studio task.

egocentric_stereo_sample.mp4 · head-mounted stereo · hands in frame · 1920 × 1080 web preview · rig example, not a mural painting clip

No mural or art studio clip is published on the site, so this is labelled as a format and rig example. Request a sample to see delivered files. See stereo sample page, stereo + wrist-cam example videos, request an egocentric data sample.

FAQ

Stereo mural painting data, answered.

What is stereo mural painting data?
First-person video from two calibrated cameras of a person sketching an outline on a wall and painting large areas and details with rollers and brushes, with depth and hand pose alongside.
Which catalog row covers it, and what is its status?
One, under Art Studio: "Mural work", described as "Sketch the outline on the wall and paint large areas and details with rollers and brushes." It is rated Medium and Available on request. This page claims no delivered hours.
Is stereo already captured on this row?
Not stated. The catalog lists a head-mounted phone with a multiview rig for the row. A stereo pair is agreed in the skill spec through the general stereo offer and confirmed on a Spec Pilot.
How is this different from the egocentric mural and stereo art studio pages?
The egocentric mural page covers the same row as first-person video that is not stereo as its subject. The stereo art studio page covers all four studio rows, so mural work is one of four there. This page is stereo capture of the mural row, with MCAP delivery.
Is there an off-the-shelf mural painting dataset?
No listed dataset names mural work or wall painting. Stereo mural painting data is custom collection, at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.
Does the data include paint types, wall sizes or safety guidance?
Not stated. The site lists no paint types, tool models, wall sizes, cycle times or error rates, and gives no working-at-height or paint-fume safety guidance, so none is claimed. These are set in the spec.
How does it handle a roller or brush covering the fingers?
Hand pose carries a per-joint visibility flag, so hidden joints are marked as hidden rather than guessed, and a spec can add wrist views or a multiview angle.
Can it be delivered as MCAP, and what is in the file?
Yes. Firsthand offers MCAP delivery. Topic names, message schemas and rates are Not stated on the site and are agreed in the skill spec.

Sources

Where is MCAP documented?

Request a custom stereo mural painting dataset delivered as MCAP.

Tell us the three stages and where each starts and ends, whether an episode covers one stage or a whole wall, what counts as the object, the setting and lighting, the privacy rule for the studio, the streams you want in the file and whether MCAP sits beside RLDS, LeRobot or WebDataset. We will quote reach, timeline and price against a written spec, with a first validated batch proven on a Spec Pilot.