Masonry and plastering

Egocentric Masonry and Plastering Task Data

Mixing, pouring, screeding and finishing concrete are ordered steps done with hand tools. We collect custom egocentric video of the concrete work the site’s catalog lists, on demand, to a written skill spec, with synchronized streams, hand pose, action segments, anonymization and a buyer-owned license. Bricklaying and plastering rows are not in the catalog.
Tasks
One concrete work row; no bricklaying or plastering rows
Streams
Ten, synced under 2 ms
First batch
Median 48 h in deep-coverage settings
License
Perpetual, buyer-owned

Requirements

What does concrete finishing capture need that a generic clip does not?

01

Both hands, the tool and the surface in view

The concrete row names shovels, floats and trowels. First-person capture keeps hands, tool and surface in frame, and 3D hand pose carries a per-joint visibility flag, so a hidden finger is flagged, not guessed.

02

A spec that names the step

Name the verb and noun, such as mixing, pouring, screeding or finishing, and where each step starts and ends, so each becomes a labeled segment.

03

Contact tracked through the step

Hand pose for both hands plus contact events marking when a hand meets the item carries the sequence that a clip of someone standing near a pour does not.

04

Reject rules written before capture

Items are rejected for an object out of frame too long, invalid depth, or an undocumented bystander. Thresholds are agreed in the spec.

Definition

What is egocentric masonry and plastering task data?

Egocentric masonry and plastering task data is first-person video of a person doing hand-tool trade work, recorded from the contributor’s own point of view with synchronized sensor streams. The head-mounted camera sits close to what a robot’s onboard camera would see, so frames show what hands and tools are doing to the material. On this site it is a custom collection: you name the task and setting, and capture runs to a written skill spec.

One caveat first, because the title is a search phrase and not a catalog heading. The task catalog has no row for bricklaying, blockwork, mortar, plastering or rendering. It has one row that states concrete work. This page covers that row as written and adds nothing to it. The data is human capture by paid, consented contributors, not robot or teleoperation data, and not a fixed corpus you download.

Phrasings such as masonry robot training data, a plastering video dataset, egocentric bricklayer data or custom construction task data collection all lead to the same method: write the task down, collect it on demand, and receive validated episodes. Whether a bricklaying or plastering task can be briefed is a scoping question for a Spec Pilot, not an existing offering.

Concrete tasks

Which masonry-adjacent tasks can be captured?

Two catalog rows mention concrete, reproduced exactly in the first table below. "Concrete work" sits in the Heavy Industry & Fabrication environment (Manufacturing & Workshops sector): "Mix, pour, screed and finish concrete into forms using shovels, floats and trowels." It is rated Hard, lists "Phone (head-mounted) / multiview rig", and is Available on request.

"Construction General Skilled Trades" sits in Active Construction Site (Construction & Trades): "Skilled trade work on active sites including framing, concrete and structural tasks." It is rated Hard and Ready to deploy. It is a general trades row naming concrete among other work, not a masonry or plastering row, so this page uses it only as context and makes no structural claim.

Statuses are defined plainly. Available on request means scoped and recruited to spec when a buyer asks. Ready to deploy means contributors and site access are set up and capture starts once a spec is signed. Heavy Industry & Fabrication holds five rows, all Hard and all Available on request: concrete work, glass manufacturing, metal fabrication, operating heavy machinery controls and welding.

The catalog is not a ceiling on what can be briefed; a step outside it is a skill-spec question for a Spec Pilot. The site does not describe a pour size, form type, surface, setting or task duration for the concrete row.

Not in the catalog

What about bricklaying, blockwork, stonework and plastering?

We checked the catalog for bricklaying, blockwork, mortar, plastering, rendering and stucco; none appears in a task name, description or example. The only mentions of stone are a sculpting row and a jewellery stone-setting row, which are different tasks. The examples for Active Construction Site (carpentry, electrical installation, plumbing, drywall, tiling, painting) and Heavy Industry & Fabrication (metal fabrication, woodworking, glass manufacturing, a concrete plant, a welding workshop) include neither trade.

Drywall and tiling have their own pages; they are different tasks and this page does not stand in for them. A buyer needing bricklaying or plastering would describe the steps, tools and setting, and the quote would state whether and how it can be captured.

Episode contents

What does each episode contain?

Each attempt is one episode. For the instrumented tier the site describes a head-mounted stereo rig recording first-person RGB, metric depth recovered from the calibrated stereo rig, and 6-DoF IMU data at 200 Hz from head- and wrist-mounted sensors. The wider stack is ten streams: a 4K head camera, two wrist cameras, depth, IMU, 3D hand and body pose, instance segmentation and action labels, hardware-aligned under 2 ms. Which tier a program uses is set in the skill spec.

Hand pose covers both hands as 21 joints each in 3D, with a per-joint visibility flag for occluded fingers; a closed grip on a float handle hides some. The flag marks what was not visible instead of presenting a guess as a measurement. Contact events mark when a hand meets the item.

Streams share one PTP clock domain, and an episode is accepted only if RMS reprojection stays under 0.28 px. The site lists no force or tactile stream and no measurement of the finished surface for these rows.

Labels and delivery

How is the data labeled and delivered?

Action segments divide each episode into spans carrying start_ns, end_ns, verb and noun. Here a segment can be one step as written in the spec, such as mixing, pouring, screeding or finishing, so one concrete job becomes a sequence of labeled steps. Other fields are hand_joints, hand_visible, contact_events, objects and, where the spec calls for them, per-frame instance masks at 848×480 to match the depth stream.

Delivery is in RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, or raw streams with metadata; official repositories are linked in the sources. The site lists no label for finish quality: nothing states whether a surface is level, smooth or cured.

Why it matters

Why does hand-tool trade data matter for construction robots?

The GR00T N1 paper describes a data pyramid. In its words: "large quantities of web data and human videos lay the base of the pyramid; synthetic data generated with physics simulations and/or augmented by off-the-shelf neural models form the middle layer, and real-world data collected on the physical robot hardware complete the top." First-person human video of concrete work would belong to the human-video base. Human capture does not replace robot data.

Of the human video datasets it used, the paper says: "These do not include explicit action labels but contain extensive sequences of human-object interactions." That describes those datasets, not this one: a Firsthand episode carries labeled action segments, hand pose and contact events. No model named here was trained on Firsthand data, and this page claims no robot performs concrete work and no model improves from this data.

Settings and privacy

Where is it captured and how is privacy protected?

The concrete row sits in Heavy Industry & Fabrication, whose examples include a concrete plant; the general trades row sits in Active Construction Site. Both list a head-mounted phone, which records the first-person view of real work on site, or a multiview rig, which adds synchronized third-person angles when the spec asks. The site does not say whether a concrete batch is captured at a plant, a construction site or a workshop, so that is agreed in the spec. It names no plant, contractor or venue.

Every contributor signs a written release, and each episode links to that record through consent artefact IDs in the batch data card. At ingest, faces, plates and screens are detected and blurred irreversibly, and speech is scrubbed of names, addresses and card numbers. A human reviewer confirms no un-consented person is identifiable, and footage that cannot be de-identified is discarded. The anonymization record ships with the data.

The site states nothing about safety, compliance, certification, building codes or trade licensing for these rows, and this page makes no such claim. The executed agreement controls.

Delivery and speed

How fast can a custom concrete dataset be collected?

From signed spec to first validated batch, the site states a median of 48 hours where coverage is deep and three to four weeks where it is thin. It does not say which applies to the concrete row, which is Available on request, so the timeline is settled in your quote. On-demand top-ups run against the same accept criteria; no turnaround is stated for them.

Validation runs against signed accept criteria. Among others, an episode is rejected when the manipulated object is out of frame for more than 15 percent of it, when more than 35 percent of depth pixels in the manipulation region are invalid, or when an undocumented bystander appears. A human reviewer then checks each episode against the spec. A reject log ships with each batch, only cleared footage is billed as a validated hour, and rejects are recaptured at the provider’s cost.

The license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default, with exclusivity as a separate term. The site publishes no price list, minimum order or batch size for this task family.

Getting started

How do you start a pilot?

Describe the steps, the setting and the variation cases your pipeline is missing. That becomes a written skill spec, quoted for reach, timeline and price before capture, and most programs run a Spec Pilot first: a small, fast batch that proves the spec and accept criteria on real footage. A published sample recording is on the sample data outputs page.

Name the step and item using catalog wording such as "screed and finish concrete into forms", name the setting and capture tier, and write the reject rule and acceptance test first.

Not stated

What does the site not state about masonry and plastering?

Where this site does not state something, this page says "Not stated" rather than filling the gap; the final table lists the gaps. Counts of episodes, hours, sites and contributors are set in your skill spec. The tradeoff to plan for is the embodiment gap between a human hand and a robot end-effector, which retargeting or pairing with robot data has to close.

Capture and delivered fields

What is captured and delivered for a concrete work episode?

The capture setup and delivered fields as stated on this site, applied to the concrete row. Counts of episodes, sites, contributors and hours are set in the skill spec.
PartAs stated on this site
Data typeHuman first-person capture by paid, consented contributors; not robot or teleoperation data
Instrumented rigHead-mounted stereo rig; first-person RGB; metric depth from the calibrated stereo rig
StreamsTen: 4K head camera, two wrist cameras, depth, IMU, 3D hand and body pose, instance segmentation, action labels
SyncHardware-triggered onto one PTP clock domain; aligned under 2 ms
IMU6-DoF at 200 Hz, head- and wrist-mounted
Hand pose21 joints per hand in 3D, with a per-joint visibility flag (hand_joints, hand_visible)
Contact eventsMarks when a hand meets the item (contact_events)
Action segmentsstart_ns, end_ns, verb and noun per step (action_segments)
Language fieldOne task instruction per episode
CalibrationTwice per session; 0.28 px RMS reprojection gate
Catalog capture setupPhone (head-mounted) / multiview rig, listed for both rows

Every collection runs through the same seven-stage end-to-end custom collection pipeline.

Task rows

Which catalog rows mention concrete, and what is captured?

The two catalog rows that mention concrete, reproduced as the catalog states them. Only the first is a concrete finishing row; the second is a general trades row. No row lists bricklaying or plastering.
Task (as listed)Description (as listed)EnvironmentSkill levelCapture setupStatus
Concrete workMix, pour, screed and finish concrete into forms using shovels, floats and trowels.Heavy Industry & FabricationHardPhone (head-mounted) / multiview rigAvailable on request
Construction General Skilled TradesSkilled trade work on active sites including framing, concrete and structural tasks.Active Construction SiteHardPhone (head-mounted) / multiview rigReady to deploy

Not stated

What does the site not state for masonry and plastering?

Each item is something a buyer may ask about and the site does not state, so this page does not either.
ItemWhat the site states
Bricklaying, blockwork, stonework, mortar, plastering, renderingNot stated; no such row is listed
Pour size, form type, surface, indoor or outdoor settingNot stated
Plant, construction site or workshop for the concrete rowNot stated; set in the skill spec
Level, smooth or cured-surface labels; force or tactile streamNot stated; not among the delivered fields
Safety, compliance, building codes, certification or licensingNot stated
Turnaround for the concrete row specificallyNot stated; the site states a median of 48 hours where coverage is deep
Price list, minimum order, batch sizeNot stated; set in your quote

FAQ

Egocentric masonry and plastering task data, answered.

What is egocentric masonry and plastering task data?
Custom first-person video of hand-tool trade work, captured by paid, consented contributors to a written skill spec. The one listed row is concrete work, delivered with synchronized streams, hand pose, contact events, action segments and consent and anonymization records.
Which masonry or plastering tasks does Firsthand list?
One row: "Concrete work" (Heavy Industry & Fabrication, Hard, Available on request): "Mix, pour, screed and finish concrete into forms using shovels, floats and trowels." A general trades row also names concrete. Anything else is settled in a Spec Pilot.
Do you have a bricklaying or plastering row?
No. The catalog has no bricklaying, blockwork, mortar, plastering or rendering row. A buyer who needs one describes the steps, tools and setting, and the quote states whether and how it can be captured.
Is the data recorded at a plant, a job site or a staged set?
Not stated for the concrete row. A head-mounted phone records the first-person view of real work on site, and a multiview rig adds third-person angles when the spec asks. The setting is agreed in the spec.
Do you provide labels for finish quality, such as level or smooth surfaces?
Not stated. Delivered fields are action segments, 3D hand pose with visibility flags, contact events, objects and instance masks where the spec calls for them. No finish-quality label or force stream is listed.
How fast can a first batch be delivered?
A median of 48 hours from signed spec where coverage is deep, and three to four weeks where it is thin. The site does not state which applies to the concrete row, so that is settled in your quote.
Who owns the data, and which formats are offered?
The buyer, under a perpetual, irrevocable, worldwide, non-exclusive commercial license by default; exclusivity is a separate term. Formats: RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, or raw streams with metadata.

Sources

Where are these capture claims documented?

Request a custom masonry or concrete task dataset.

Tell us the steps, the settings and the variation cases your model needs to see. We will quote reach, timeline and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.