Egocentric Measuring and Marking Task Video Data

Egocentric measuring and marking video data is first-person video of a person measuring a piece, marking where to cut, drill or fix it, or laying out positions, recorded from their own point of view with synchronized sensor streams alongside. The camera sits on the head, close to what a robot’s onboard camera would see at a bench, so the frames show how the hands hold the reference, place the mark and move on to the next step. Teams searching for measuring task robot training data, a tape measure video dataset or egocentric measure-and-mark data are usually looking for this.

On this site the data is human capture: a paid, consented contributor wears the rig and performs a task from a written skill spec. It is not robot or teleoperation data, and it is not a fixed corpus you download. It is custom trades task data collection, scoped to your tasks. This page is a different subject from woodworking and carpentry data and from construction and trades data, which cover whole jobs, from tool use data, which centres on handling tools, and from visual inspection data, where the aim is to find defects rather than to measure and mark.

The task catalog names measuring, marking or layout steps in ten environments, nineteen rows in all. Ten of them are workpiece rows. The Carpentry & Furniture Workshop lists one that measures and marks panels before cutting them on the table saw, rated Hard, and one that marks, drills and fits hinges, handles and slides. The Metal Fabrication & Welding Workshop lists three, all rated Medium: measuring and marking steel pipe before cutting it, measuring and scribing sheet metal with a square, and transferring dimensions from drawings to metal stock.

The Active Construction Site lists three, all Active collection: "Carpentry", which measures, cuts and nails or screws framing, sheathing and trim; measuring and cutting insulation batts; and measuring and marking lumber with a tape before cutting it to length. The Trades Workshop Bench lists two, "Hang a fixture", which levels, marks and screw-mounts a fixture, and "Measure, mark, cut", which measures, marks a line and saws to it. Both are rated Medium and Available on request, and both are recorded with a multiview rig and handheld grippers rather than a head-mounted phone.

Nine more rows involve measuring or layout in other settings. Event Venue lists reading a layout plan and aligning tables and chairs, rated Easy. The Textile Arts & Stitching Studio lists laying out fabric and placing patterns, and measuring, pinning and hemming. The Plastic & Light-Assembly Manufacturer lists two inspection rows that measure parts on the line. Four rows measure materials: batter ingredients in a working kitchen set, liquids in a pharmacy and laboratory, and tube fills and reagent pours to a mark in a wet lab bench.

The first table below lists every row. Rows where tape means packing or sealing tape, inspection rows with no measuring step, and a medication dispensing row that centres on reading a prescription are left out. The catalog states no measuring tool model, unit or tolerance for any row, so this page states none.

Each attempt is delivered as one episode. On this site the standard episode carries action segments, 3D hand pose for both hands with a per-joint visibility flag, contact events that mark when a hand meets an object, an objects list, and per-frame instance masks stored at the depth resolution of 848×480. The capture setup table below lists the streams and sync figures the site states for the instrumented tier: ten streams hardware-triggered onto one PTP clock domain and aligned under 2 ms, 6-DoF IMU data at 200 Hz, and calibration twice per session.

The catalog lists a head-mounted phone with a multiview rig for fourteen of these rows, and a multiview rig with handheld grippers for the other five, while the ten-stream stack is the instrumented tier. Which applies to a measuring program is not stated and is confirmed in the skill spec. Force and tactile readings are not among the listed streams.

Action segments divide an episode into start- and end-timestamped spans, each carrying start_ns, end_ns, verb and noun. For measure-and-mark work, a segment might be one measurement, one mark, one check with a square or a level, or one cut to the line, as written in the skill spec. Where one completed step starts and ends is a spec decision, not a default.

Validation runs against signed accept criteria written into the spec before capture, and a reject log ships with each batch. Episodes are machine-checked against stated reject criteria, including a sync breach, calibration drift, the manipulated object out of frame for more than 15 percent of the episode, an undocumented bystander, and a mismatch against the named skill spec, and a human reviewer then checks each episode. Only footage that clears the criteria is billed as a validated hour, and rejected items are recaptured at our cost.

Delivery is in the format your stack already reads: RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, or raw streams with metadata, with readable converter source alongside. The license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default, with exclusivity available as a separate term. The executed agreement controls.

Measure-and-mark work is a sequence of small moves that each depend on the last. One hand often holds a reference while the other places the mark, so the fingers cover the very spot that matters, which is why hand pose carries a per-joint visibility flag, contact events mark when the hand meets the object and masks are recorded per frame. A model also has to learn the order of measure, mark and act, not one motion. Reading a value off a scale or judging that a line is in the right place is a judgment, and the site states no measured-value or accuracy label. The second table below maps each challenge to the stream or label this site states, and says so where nothing is stated.

A robot foundation model paper on arXiv organizes its training data as a pyramid, with large quantities of web data and human videos at the base, synthetic data in the middle and real robot data at the top. The same paper says human videos have no explicit action labels, so it learns latent actions to label them. That is robot-model research, not Firsthand data, and Firsthand has no relationship with its authors.

The catalog describes the head-mounted phone as recording the first-person view of real work on site. The site also states that Firsthand does not capture at a customer’s own facility. For the five handheld-gripper rows, the site describes the mode as a staged working set recorded while the operator uses the grippers. For the other rows, whether a program uses a working site or a staged set is not stated, and neither is the venue type. Both are agreed in the skill spec before capture begins.

Every contributor signs a written release, and each delivered episode links to it through consent artefact IDs in the batch data card. The consent chain has six checkpoints, and a break at any one discards the footage. At ingest, automated detection finds faces, plates and screens and blurs them irreversibly. Speech is scrubbed of names, addresses and card numbers, while ambient audio is kept. A human reviewer confirms that no un-consented person is identifiable in any frame, footage that cannot be de-identified is discarded, and the anonymization record ships with the data.

The site states no safety, calibration-of-tools or certification practice for these environments, so this page makes no such claim.

From signed spec to first validated batch, the published timeline is a median of 48 hours where coverage is deep and three to four weeks where it is thin and contributors need to be recruited first. Four rows are Active collection, where recording is running now and a spec can join an existing capture stream. Eight are Ready to deploy, with contributors and site access set up. Seven are Available on request, scoped and recruited to spec. The range that applies is confirmed when the spec is quoted.

Describe the measuring and marking tasks and their order, what counts as a completed measure, mark or check, who may be in frame, and the variation cases your pipeline is missing. That becomes a written skill spec, quoted for reach, timeline and price before any capture begins. Our skill spec guide walks through how to write one.

Most programs begin with a Spec Pilot, a small, fast first batch that proves the spec and the accept criteria on real footage before volume scales. Collections are billed per validated hour. Counts of sites, contributors, episodes and hours are set in the skill spec, since the site does not state them for these environments.