Plumbing and pipe fitting

Egocentric Plumbing and Pipe Fitting Video Data

Cut the pipe, join the fitting, swap the fixture, feed the auger down the drain and test for leaks: plumbing is two-handed work in tight spaces, done with hand tools, where the hands are often half hidden. We collect custom egocentric video of plumbing and pipe fitting on demand, to a written skill spec, with synchronized streams, 3D hand pose, contact events, action segments, anonymization and a buyer-owned license.
Tasks
Ten plumbing and pipe rows, as the catalog lists them
Streams
Ten, synced under 2 ms
First batch
Median 48 h in deep-coverage settings
License
Perpetual, buyer-owned

Requirements

What does plumbing need that a generic tool-use clip does not?

01

Sequence and verification

The catalog describes plumbing as a sequence that ends in a check: cut, join and install pipes and fixtures, then test for leaks; remove the old fixture, fit the new one and check for leaks; clear the blockage and check the line with a light. The value is in the order of the steps and in how each job is confirmed.

02

Hands partly hidden

Under a sink or behind a fixture, a hand is often half out of view. First-person capture keeps the hands in frame, and the two wrist cameras add a closer view. 3D hand pose carries a per-joint visibility flag, so a finger hidden behind a pipe or a wrench is flagged rather than guessed.

Definition

What is egocentric plumbing and pipe fitting video data?

It is first-person video of a person doing plumbing or pipe work, recorded from a head-mounted camera, with two wrist cameras for a closer view of the hands. The contributor is a paid, consented person following a written skill spec, not an actor and not a robot.

The point of the data is what the hands do with pipe, fittings and hand tools: gripping, turning, seating, clamping, feeding. It is labeled so each step can be sliced out. Where the site states nothing, a table says "Not stated" and the answer lives in the spec or the quote.

Task coverage

Which plumbing and pipe-fitting tasks can be captured?

The task catalog names ten rows that are explicitly about plumbing or pipe work. Four cover fixtures and general plumbing: "Plumbing", "Plumbing repair call", "Plumbing Fixture Installation" and "Remove and install plumbing fixtures using pipe wrenches and sealant tape". Two cover drains: "Drain Snaking & Clearing" and "Snake and clear drain lines using a drain auger and inspection light".

The other four are "Water Heater Replacement", "Shut-off valve + gauge check", and two pipe rows from a metal workshop, "Pipe Cutting & Fitting" and "Cut and fit steel pipe using a bandsaw and pipe clamps". Statuses vary: Ready to deploy, Active collection or Available on request, and the catalog does not define any of them further, so ask which applies to your row. The second table lists neighbouring rows that touch pipes or drains but are not plumbing rows.

Settings and rigs

Where is plumbing data captured, and on what rig?

The catalog ties these rows to five environments. Active Construction Site lists plumbing among its trades. Trade Service Calls is described as a plumber, electrician or HVAC crew on service calls at client sites. On-Site Home Repair is described as a professional plumber, electrician, HVAC technician or handyman working in a client’s home. Trades Workshop Bench and Metal Fabrication & Welding Workshop cover the bench and pipe-shop rows.

Most rows list a head-mounted phone or multiview rig. The shut-off valve row lists a multiview rig plus handheld grippers. The site does not otherwise state where capture happens or who hosts it, so the spec settles location and access.

Episode contents

What does each plumbing episode contain?

An episode is one contributor performing one task from the skill spec, recorded with ten hardware-synchronized streams that line up within 2 ms. The site documents a canonical episode schema, and every delivery format is a view of it.

Hand pose is stored as 21 joints per hand in metres in the head frame, with a visibility flag for each joint. Contact events record when a hand meets an object. The site does not say whether a pipe, a fitting or a wrench counts as the object, so settle it in the spec.

Action segments carry a start, an end, a verb and a noun from a taxonomy the site states as 97 verbs and 512 nouns, human-reviewed. Every episode links to its contributor’s signed release by a consent artefact ID, and each batch ships with a data card.

Labeling

How is plumbing data labeled?

The unit of labeling is the action segment. A spec that says "replace the fixture" gives you one long segment. A spec that names remove, fit, seal and test gives you a sequence you can slice by step.

Every episode is machine-checked, then reviewed by a human against its skill spec, and rejected episodes are recaptured at our cost. The site states no label for pipe material, joint type, leak result or task success, and no force, torque or tactile reading, so ask for any such label at the start.

Privacy

How is privacy handled when capturing in homes and job sites?

Only what the site already states applies. Every contributor signs a written release, and each episode links to it. Faces and screens are detected and blurred irreversibly, a human reviewer confirms that no un-consented person is identifiable, and footage with bystanders who cannot be de-identified is discarded rather than shipped.

The site does not state how a household or other people on a job site are handled beyond that general rule, so settle it in the spec before capture. This is not legal advice, and the executed agreement controls.

Delivery

How is plumbing data delivered, and who owns it?

Data is delivered in RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, or as raw streams with metadata, with the episode schema as the canonical layout. QA runs once, against the canonical episode, before any format is cut. The formats table sets the site’s delivery next to each maintainer’s own documentation, linked under Sources.

The license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default, with exclusivity available as a separate term and the executed order form governing.

Speed

How fast can a custom plumbing dataset be collected?

The site states one published timeline: from a signed spec to a first validated batch, a median of 48 hours where coverage is already deep, and typically three to four weeks where it is thin because operators have to be staffed. The site does not say which applies to the plumbing rows and promises nothing faster, so ask when you request the quote.

Collection is on demand, so a focused brief, such as one fixture swap from shut-off to leak check, is a normal starting point.

Getting started

How do you start a pilot?

Start with the free sample pack to check the loader and label quality, then move to a Spec Pilot: a small, fast first batch against the written spec that proves the fill rate and reject rate on your conditions before you scale.

A good plumbing brief names the setting, the sequence of steps, how each step starts and ends, what counts as a reject and the privacy rule for the space. The site’s skill-spec guide walks through that structure. Then request a custom dataset.

Capture setup

What is the capture setup for a plumbing collection?

The capture setup as stated on this site, applied to plumbing. Counts of contributors and hours are set in the skill spec.
PartAs stated on this site
Head cameraGlobal-shutter 4K at 60 fps with a 120 degree lens
Wrist camerasTwo wrist-mounted cameras at 1080p and 60 fps
DepthDepth sensor at 848×480 and 30 fps, with per-frame confidence maps
IMU6-DoF at 200 Hz
SyncTen streams, hardware-triggered onto one PTP clock domain and aligned under 2 ms
CalibrationRe-solved with a checkerboard target at the start and end of every session; accepted only under the 0.28 px RMS reprojection gate
Catalog capture setupHead-mounted phone or multiview rig for most plumbing rows; multiview rig plus handheld grippers for the shut-off valve row
Pipe materials and diameters, fitting and joint types, tool modelsNot stated

Every collection runs through the same seven-stage end-to-end custom collection pipeline.

Task catalog

Which plumbing and pipe rows does the catalog name?

The ten catalog rows that are explicitly about plumbing or pipe work, reproduced as the catalog states them.
Task (as listed)Description (as listed)EnvironmentSkill levelStatus
PlumbingCut, join and install pipes and fixtures on site and test for leaks.Active Construction SiteHardActive collection
Plumbing repair callLocate the leak or blockage, replace fittings or seals and test the water flow.On-Site Home RepairHardAvailable on request
Drain Snaking & ClearingFeed a drain auger into the line, work through the blockage and flush the drain.Trade Service Calls (Plumbing / HVAC / Electrical)MediumReady to deploy
Plumbing Fixture InstallationRemove the old fixture, fit the new tap, toilet or sink with wrenches and sealant and test.Trade Service Calls (Plumbing / HVAC / Electrical)HardReady to deploy
Remove and install plumbing fixtures using pipe wrenches and sealant tapeDisconnect old fixtures with pipe wrenches, fit new ones with sealant tape and check for leaks.Trade Service Calls (Plumbing / HVAC / Electrical)HardReady to deploy
Snake and clear drain lines using a drain auger and inspection lightFeed the drain auger into the pipe, clear the blockage and check the line with a light.Trade Service Calls (Plumbing / HVAC / Electrical)MediumReady to deploy
Water Heater ReplacementDrain and disconnect the old heater, position the new unit, connect water and power and test.Trade Service Calls (Plumbing / HVAC / Electrical)HardReady to deploy
Shut-off valve + gauge checkOperate a shut-off valve and read the gauge.Trades Workshop BenchMediumAvailable on request
Pipe Cutting & FittingCut pipe to length, bevel the ends and fit and clamp sections ready for welding.Metal Fabrication & Welding WorkshopMediumReady to deploy
Cut and fit steel pipe using a bandsaw and pipe clampsMeasure and mark steel pipe, cut it on the bandsaw and fit sections in clamps.Metal Fabrication & Welding WorkshopMediumReady to deploy

Neighbouring rows

Which catalog rows sit next to plumbing?

Rows that touch pipes or drains but are not plumbing rows, reproduced as the catalog states them. They are listed for context.
Task (as listed)Description (as listed)EnvironmentStatus
Drain Clearing & CleanupClear blocked drains with a plunger or auger and clean up the surrounding area.Commercial Cleaning & JanitorialReady to deploy
Assemble and repair irrigation lines using PVC fittings and a pipe cutterCut PVC pipe to length, fit connectors and replace broken sections in the irrigation line.Farm & Field OperationsActive collection
IrrigationMove and connect irrigation lines, open valves and check water reaches each row.Farm & Field OperationsActive collection

Episode fields

What fields does a plumbing episode carry?

Episode fields as documented in the site’s episode schema, and what each is useful for in a plumbing task.
FieldAs documentedUse for plumbing
hand_joints21 joints per hand, in metres, head frameHow each hand grips, turns and seats a part
hand_visibleBoolean visibility flag per jointWhich fingers are hidden behind a pipe or wrench
contact_eventsTimestamp, hand, object ID and kindWhen a hand meets a pipe, fitting or tool
instance_masksTracked object IDs per frame at 848×480Which object is which across frames
action_segmentsstart_ns, end_ns, verb, nounOne labeled span per plumbing step
depth_mm and depth_confMetric depth with a per-pixel confidence mapWhere depth can be trusted near a fitting
Pipe material, joint type, leak result or success label, force, torque or tactileNot statedNot stated

Delivery formats

Which formats are delivered, and what does each format’s own documentation say?

The delivery formats the site lists. The third column is taken only from the official pages linked under Sources.
FormatDelivered by FirsthandMaintainer documentation
RLDSTFDS-compatible tfrecord shards, one skill line per directoryStores episodic data; a dataset is a tf.data.Dataset of episodes, each containing a dataset of steps
LeRobotParquet plus an mp4 per camera, in the Hugging Face datasets layoutSynchronized MP4 videos or images for vision, plus Parquet files
WebDatasetListed as a delivery formatTar files in which files sharing a basename make up one training sample
HDF5, zarr and Rerun .rrdListed as delivery formatsNot described on this page

Not stated

What does the site not state about plumbing?

Details a buyer may ask about and where the answer lives.
TopicOn this siteWhere it is settled
Pipe materials and diameters, fitting and joint typesNot statedWritten skill spec
Tool models and brandsNot statedWritten skill spec
Torque values, water pressure, force or tactile dataNot statedNot offered as a stated stream
Leak-test results or task-completion labelsNot statedScoped in the spec
Trade licensing or code-compliance certificationsNot statedNot offered as a stated claim
Throughput, and which timeline applies to these rowsNot statedQuote
Household members or other people in frameNot stated beyond the general bystander ruleSkill spec
Robot actions or teleoperation dataNot stated; Firsthand captures humans, not robotsYour own retargeting step

FAQ

Egocentric plumbing and pipe fitting video data, answered.

What is egocentric plumbing and pipe fitting video data?
Custom first-person video of people cutting, joining and installing pipe, replacing fixtures and clearing drains, captured by paid, consented contributors to a written skill spec, with synchronized streams, 3D hand pose, contact events and action segments.
Which plumbing and pipe-fitting tasks does Firsthand list?
Ten catalog rows: Plumbing, Plumbing repair call, Plumbing Fixture Installation, a pipe-wrench fixture row, Drain Snaking & Clearing, a drain-auger row, Water Heater Replacement, Shut-off valve + gauge check and two pipe cutting and fitting rows. Statuses are Ready to deploy, Active collection or Available on request.
What streams and labels come with a plumbing episode?
Ten hardware-synchronized streams aligned under 2 ms, 3D hand pose for both hands, contact events and action segments with a start, an end, a verb and a noun. No pipe material, leak result, torque, force or tactile reading is stated.
How is privacy handled in homes and on job sites?
Every contributor signs a written release, and faces and screens are blurred irreversibly, with a reviewer confirming no un-consented person is identifiable. Footage with bystanders who cannot be de-identified is discarded. How a household is handled is settled in the spec.
How fast can a custom plumbing dataset be collected?
From a signed spec to a first validated batch, a median of 48 hours where coverage is deep and three to four weeks where it is thin. The site does not say which applies to these rows, so ask when you request the quote.
Do you capture robot or teleoperation data for plumbing?
No. Firsthand captures humans, not robots. Episodes carry human hand pose and human action labels, so using them for a specific robot means your own retargeting step.
Who owns the data?
The license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default, with exclusivity as a separate term. The executed order form governs.

Sources

Where are the delivery formats on this page documented?

Request a custom plumbing and pipe fitting dataset.

Tell us the setting, the steps and the privacy rule your model needs to see. We will quote reach, timeline and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.