Egocentric Surgical Instrument Handling Data

Egocentric surgical instrument handling data is first-person video of a person handling instruments, recorded from their own point of view with synchronized sensor streams alongside. The camera sits on the head, close to what a robot’s onboard camera would see at a tray or a sterile field, so the frames show what the hands are doing with each instrument rather than a distant view of a room. Teams searching for surgical instrument handling robot training data, an instrument tray setup video dataset or egocentric sterile field and instrument pass data are usually looking for this: footage of hands laying out, opening, arranging and passing instruments, tied to labels.

On this site the data is human capture: a paid, consented contributor wears the rig and performs a task from a written skill spec. It is not robot or teleoperation data. It is custom clinical task data collection rather than a ready-made library, because every row on this page is Available on request. This page pulls rows from four catalog environments into one place.

The task catalog states six rows that involve handling instruments. In Dental Clinic, under Healthcare & Life Sciences, Tray setup lays out sterile instruments and materials on the tray in procedure order and is rated Easy, and Instrument handling passes, handles and returns dental instruments to the clinician during a procedure and is rated Medium. In Wet Lab & Clinical Bench, in the same sector, Sterile field setup peels open packs and arranges instruments and Instrument pass passes instruments in sequence; both are rated Medium.

In Veterinary Clinic, under Pet & Animal Care, Surgical instrument setup opens sterile packs and lays out surgical instruments on the tray in order and is rated Medium. In Dental Lab & Medical Device Workshop, under Healthcare & Life Sciences, Surgical Instrument Technician is described as handling, cleaning, sterilizing and assembling surgical instrument sets and is rated Hard. The first table below gives each row exactly as the catalog words it.

Four rows use a head-mounted phone or a multiview rig; the two Wet Lab & Clinical Bench rows use a multiview rig with handheld grippers. All six are Available on request, meaning the work is scoped and recruited to spec when a buyer asks. The catalog names no procedure, specialty, instrument list or tray layout, so this page does not either.

Several things a reader might expect are not rows. The catalog has no row for an operating room or a surgical team role, for loading a sterilizer or autoclave, for draping, or for any named instrument. Surgical instrument setup, the only row whose name says surgical, sits in the veterinary clinic environment.

So this page scopes a custom spec; it does not claim those sub-tasks are rows. Anything beyond the six rows, including instrument names, tray layouts and the procedure, is written into the skill spec and quoted before capture. The site states none of them.

Each attempt is delivered as one episode. On this site the standard episode carries action segments, 3D hand pose for both hands with a per-joint visibility flag, contact events that mark when a hand meets an item, an objects list, and per-frame instance masks stored at the depth resolution of 848×480. The capture setup table below lists the stream and sync figures the site states for the instrumented tier.

The catalog lists a head-mounted phone with a multiview rig, or a multiview rig with handheld grippers, for these rows; the ten-stream stack is the instrumented tier. Which applies is confirmed in the skill spec. Force and tactile readings are not among the listed streams.

The catalog describes the head-mounted phone as recording the first-person view of real work on site, and the multiview rig with handheld grippers as a staged working set where the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector. The site states that Firsthand does not capture at a customer’s own facility. Whether a program uses a working clinic or a staged set is not stated and is agreed in the skill spec.

On patients, the site’s healthcare page states that capture in healthcare settings uses training environments with simulated patients only and never captures real patient footage. The Wet Lab & Clinical Bench examples line reads “phantom for any invasive step”. The instrument rows do not name a mannequin or phantom themselves, so which one is used is settled in the spec. The Veterinary Clinic row does not say whether any animal is live, and this page claims none of that.

Every contributor signs a written release, and each delivered episode links to it through consent artefact IDs in the batch data card. At ingest, automated detection finds faces, plates and screens and blurs them irreversibly. Speech is scrubbed of names, addresses and card numbers. A human reviewer confirms that no un-consented person is identifiable in any frame, footage that cannot be de-identified is discarded, and the anonymization record ships with the data.

An undocumented bystander is a reject criterion, so who may appear next to the contributor, such as a clinician receiving an instrument, is agreed in the spec. The catalog notes HIPAA compliance for its Hospital & Clinical Care environment but states nothing like it for these six rows, so this page makes no clinical, sterilization or regulatory claim.

Instrument handling depends on order and on small objects. A tray is laid out in a set order, so a model has to learn sequence as well as placement. A pass is a hand-to-hand moment at the edge of the frame, and an instrument held between two fingers is easily hidden by the hand that holds it. That is why hand pose carries a per-joint visibility flag, why contact events mark when the hand meets the item, and why an episode is rejected if the manipulated object is out of frame for more than 15 percent of it.

Surgical Instrument Technician is rated Hard and bundles four verbs in one row: handling, cleaning, sterilizing and assembling. The spec should name which you need and in what order. The table below maps each challenge to a stated stream or label.

Action segments divide an episode into start- and end-timestamped spans, each carrying start_ns, end_ns, verb and noun. For instrument work, a segment might be one tray layout, one pack opened, one instrument placed or one pass, as written in the skill spec.

Validation runs against signed accept criteria written into the spec before capture, and a reject log ships with each batch. Episodes are machine-checked against reject criteria, including a sync breach, calibration drift, the object out of frame for more than 15 percent of the episode, an undocumented bystander and a mismatch against the skill spec, then a human reviewer checks each one. Only footage that clears the criteria is billed as a validated hour, and rejected items are recaptured at our cost.

Delivery is in the format your stack already reads, with readable converter source alongside. The license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default, with exclusivity available as a separate term. The executed agreement controls.

From signed spec to first validated batch, the published timeline is a median of 48 hours where coverage is deep and three to four weeks where it is thin and contributors need to be recruited first. The range that applies is confirmed when the spec is quoted. At program level, a pilot runs two to three weeks to first delivery and a standing program reaches full rate in four to six weeks.

Describe the instrument tasks and their order, what counts as a finished step, who may be in frame and the variation cases your pipeline is missing. That becomes a written skill spec, quoted for reach, timeline and price before capture begins. Most programs begin with a Spec Pilot, a small, fast first batch that proves the spec and accept criteria before volume scales. Collections are billed per validated hour.

Where the site is silent, this page says so. No procedure type, specialty, instrument list, tray layout, venue type, cycle time, or number of sites, episodes or hours is stated for instrument handling work, and nothing here claims a training outcome.