Two catalog rows, both rated Hard
The catalog lists Dental Prosthesis Manufacturing and Surgical Instrument Technician under this environment. Both are rated Hard, so the spec names the steps you need.
Dental lab and medical device workshop
Requirements
The catalog lists Dental Prosthesis Manufacturing and Surgical Instrument Technician under this environment. Both are rated Hard, so the spec names the steps you need.
A head-mounted view keeps both hands and the work in frame. Hand pose, contact events and per-frame instance masks are recorded on one clock, with a visibility flag on each joint.
What counts as a finished prosthesis or a completed instrument set is written into the spec up front. The site lists no quality or success label to define it afterwards.
Consent, anonymization and the license are stated below. No regulatory, sterilization or patient-data claim is made, because the site states none here.
Definition
Egocentric dental lab and medical device workshop video data is first-person video of a person doing bench work, recorded from their own point of view with synchronized sensor streams alongside. The camera sits on the head, close to what a robot’s onboard camera would see at a workbench, so the frames show what the hands are doing to the part rather than a distant view of a room. The same idea sits behind any dental lab robot training data request, applied here as a custom collection scoped to your tasks.
On this site the data is human capture: a paid, consented contributor wears the rig and performs a task from a written skill spec. It is not robot or teleoperation data. This page is different from the Dental Clinic environment, whose catalog examples are chairside work such as instrument handling, tray setup and post-procedure cleaning, and from the electronics assembly page, which covers bench assembly of electronic parts.
Tasks
The task catalog lists a Dental Lab & Medical Device Workshop environment under Healthcare & Life Sciences. Its examples are a dental laboratory, sterile processing and medical device assembly. It has two task rows. Dental Prosthesis Manufacturing is described as fabricating crowns, dentures and dental appliances in a dental laboratory. Surgical Instrument Technician is described as handling, cleaning, sterilizing and assembling surgical instrument sets.
Both rows are rated Hard and recorded with a head-mounted phone and a multiview rig. Both are Available on request, which means the work is scoped and recruited to spec when a buyer asks for it, rather than running as an open capture stream today.
The catalog does not break these rows into sub-steps. Model trimming, wax-up, casting, finishing and polishing are not named anywhere on the site, so this page does not name them either. Which steps a program needs is a skill-spec decision. The site also states no equipment models, materials, lab types or sizes, or cycle times.
Episodes
Each attempt is delivered as one episode. On this site the standard episode carries action segments, 3D hand pose for both hands with a per-joint visibility flag, contact events that mark when a hand meets an item, an objects list, and per-frame instance masks stored at the depth resolution of 848×480. The capture setup table below lists the streams and sync figures the site states for the instrumented tier: ten streams hardware-triggered onto one PTP clock domain and aligned under 2 ms, 6-DoF IMU data at 200 Hz, and calibration twice per session.
The catalog lists a head-mounted phone with a multiview rig for these two rows, while the ten-stream stack is the instrumented tier. Which applies to a dental lab program is not stated and is confirmed in the skill spec. Force and tactile readings are not among the listed streams.
Labels and delivery
Action segments divide an episode into start- and end-timestamped spans, each carrying start_ns, end_ns, verb and noun. For bench work, a segment might be one step of a prosthesis or one handling pass over an instrument set, as written in the skill spec.
Validation runs against signed accept criteria written into the spec before capture, and a reject log ships with each batch. Episodes are machine-checked against stated reject criteria, including a sync breach, calibration drift, the manipulated object out of frame for more than 15 percent of the episode, an undocumented bystander, and a mismatch against the named skill spec, and a human reviewer then checks each episode. Only footage that clears the criteria is billed as a validated hour, and rejected items are recaptured at our cost.
Delivery is in the format your stack already reads: RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, or raw streams with metadata, with readable converter source alongside. The license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default, with exclusivity available as a separate term. The executed agreement controls.
Why it is hard
Small parts are easily hidden by the fingers that hold them, and fine tools put the hand and the work in close contact for long stretches. That is why hand pose carries a per-joint visibility flag, why contact events mark when the hand meets the item, and why masks are recorded per frame. The catalog itself rates both dental lab rows Hard. The second table below maps each challenge to the stream or label this site states, and says so where nothing is stated.
A robot foundation model paper on arXiv organizes its training data as a pyramid, with large quantities of web data and human videos at the base, synthetic data in the middle and real robot data at the top. The same paper says human videos have no explicit action labels, so it learns latent actions to label them. That is robot-model research, not Firsthand data, and Firsthand has no relationship with its authors.
Capture and privacy
The catalog describes the head-mounted phone as recording the first-person view of real work. The site also states that Firsthand does not capture at a customer’s own facility. Which lab or workshop a given program uses is not stated here and is agreed in the skill spec before capture begins.
Every contributor signs a written release, and each delivered episode links to it through consent artefact IDs in the batch data card. The consent chain has six checkpoints, and a break at any one discards the footage. At ingest, automated detection finds faces, plates and screens and blurs them irreversibly. Speech is scrubbed of names, addresses and card numbers, while ambient audio is kept. A human reviewer confirms that no un-consented person is identifiable in any frame, footage that cannot be de-identified is discarded, and the anonymization record ships with the data.
The site’s privacy guide names printed text such as forms, badges and mail among recurring identifiers in egocentric footage. Whether case paperwork or labels on a bench are blurred is not stated, and neither is any patient-data handling for this environment. The catalog notes HIPAA compliance for its Hospital & Clinical Care environment, but states nothing like it for dental lab work, so this page makes no regulatory, sterilization or clinical claim. Who may be in frame is agreed in the spec.
Speed
From signed spec to first validated batch, the published timeline is a median of 48 hours where coverage is deep and three to four weeks where it is thin and contributors need to be recruited first. Both dental lab rows are Available on request, so the range that applies is confirmed when the spec is quoted rather than assumed.
At program level, a pilot runs two to three weeks to first delivery and a standing program reaches full rate in four to six weeks. These are program milestones, separate from the per-batch figures above.
Getting started
Describe the bench tasks and their order, the parts and tools involved, what counts as a finished step, and the failure or variation cases your pipeline is missing. That becomes a written skill spec, quoted for reach, timeline and price before any capture begins. Our skill spec guide walks through how to write one.
Most programs begin with a Spec Pilot, a small, fast first batch that proves the spec and the accept criteria on real footage before volume scales. Collections are billed per validated hour. Counts of sites, contributors, episodes and hours are set in the skill spec, since the site does not state them for this environment.
What is not stated
Where the site is silent, this page says so. No equipment list, material, lab type or size, cycle time, number of sites or number of episodes is stated for dental lab work. There is no quality, fit or success label, no force or tactile stream, no regulatory status and no robot result. The delivered-versus-not-stated table below separates what is stated from what is not. Nothing here claims a training outcome.
Capture setup
| Part | As stated on this site |
|---|---|
| Catalog capture mode | Head-mounted phone for the first-person view of real work; a multiview rig adds synchronized third-person angles when the spec asks for them |
| Instrumented tier | Head-mounted stereo rig worn by the contributor; first-person RGB with metric depth recovered from the calibrated stereo rig |
| Streams | Ten: 4K head camera, two wrist cameras, depth, IMU, 3D hand and body pose, instance segmentation, action labels |
| Sync | Hardware-triggered onto one PTP clock domain; aligned under 2 ms |
| Hand pose | 21 joints per hand, 3D, in metres in the head-camera frame; per-joint visibility flag |
| Calibration | Twice per session; accepted only under the 0.28 px RMS reprojection gate |
| Masks | Per-frame instance masks, stored at 848×480 |
| Which mode applies to dental lab work | Not stated; confirmed in the skill spec |
Every collection runs through the same seven-stage end-to-end custom collection pipeline.
Task rows
| Task | What the catalog states | Skill | Status |
|---|---|---|---|
| Dental Prosthesis Manufacturing | Fabricating crowns, dentures and dental appliances in a dental laboratory | Hard | Available on request |
| Surgical Instrument Technician | Handling, cleaning, sterilizing and assembling surgical instrument sets | Hard | Available on request |
| Trimming, wax-up, casting, finishing, polishing | Not stated as separate rows | Not stated | Not stated |
| Small-part assembly or inspection at a device workbench | Environment examples name medical device assembly; no task row is stated | Not stated | Not stated |
Capture challenges
| Bench challenge | What goes wrong | Stated stream or label |
|---|---|---|
| Small parts hidden by the hand | Fingers cover the part being held or shaped | 3D hand pose with per-joint visibility flags; per-frame instance masks; reject if the object is out of frame for more than 15% of an episode |
| Fine tool contact | The hand, tool and part touch for long stretches | Contact events mark when a hand meets an item; no finer contact label is stated |
| Two-handed holding and working | One hand steadies while the other works | Head-mounted view keeping both hands in frame; hand pose and contact events for each hand on one clock |
| Finish and fit quality | Whether a result is acceptable | Not stated: completion is defined in the spec and episode boundaries |
| Force and contact pressure | How hard a part is gripped or pressed | Not stated: no force or tactile stream is listed |
Delivered vs not stated
| Item | Status | Detail |
|---|---|---|
| Action segments | Delivered | start_ns, end_ns, verb, noun, one per step |
| 3D hand pose | Delivered | 21 joints per hand; per-joint visibility flag for occluded fingers |
| Contact events | Delivered | The moment a hand meets an item |
| Per-frame instance masks | Delivered | Stored at 848×480 |
| Consent and anonymization records | Delivered | Consent artefact IDs per episode; anonymization record shipped with the data |
| Equipment, materials, lab types or sizes | Not stated | Agreed in the skill spec |
| Cycle times and throughput | Not stated | No such figure is listed |
| Number of sites, episodes and hours | Not stated | Set per program in the skill spec |
| Quality, fit or success labels | Not stated | No such label is listed |
| Force, tactile or thermal readings | Not stated | Not among the listed streams |
| Regulatory status and patient-data handling | Not stated | No such statement exists for this environment |
FAQ
Sources
Tell us the bench tasks, the parts and tools, and the steps your model needs to see. We will quote reach, timeline and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.