Both hands, the equipment and the patient in one view
A head-mounted view keeps both hands, the board, support or machine being handled and the patient in one view while the set-up is arranged, the equipment is adjusted and the patient is guided.
Now recruiting capture teams worldwide. Get paid to record first-person video of real work.
Apply to captureTask family
Requirements
A head-mounted view keeps both hands, the board, support or machine being handled and the patient in one view while the set-up is arranged, the equipment is adjusted and the patient is guided.
3D hand pose with a per-joint visibility flag records where the fingers are, and which joints were hidden, while a support is placed or a machine is adjusted.
Frame-accurate action segments mark where a set-up ends, an adjustment is made and guidance begins, aligned to video and depth.
Healthcare capture on this site uses simulated patients only and never real patient footage. Who stands in for the patient is agreed in the written spec.
A perpetual, buyer-owned commercial license backed by a documented consent chain.
Why it matters
Egocentric balance training and rehab equipment data is real-world, first-person video of equipment-centred work in a physiotherapy clinic. It is recorded from the worker viewpoint, with depth, 3D hand pose, contact events and frame-accurate action segments aligned on one hardware clock. It covers two tasks the site states in its task catalog: Balance training and Rehabilitation equipment operation.
The nearest existing pages each cover part of this ground. The egocentric physiotherapy stretching and exercise guidance page counts Balance training as one of three rows and does not cover Rehabilitation equipment operation. The patient mobility assistance page counts Balance training as one of five mobility rows and states that it does not count Rehabilitation equipment operation. This page is the one that puts both equipment rows together, so a team that needs egocentric balance training data, first-person rehab equipment setup video or a physiotherapy clinic equipment dataset can scope exactly those tasks. It is custom rehabilitation data collection, fast and on demand, written to your spec.
The data is human capture. A paid, consented contributor performs the task while a rig records it. It is not robot or teleoperation data, it is not simulation data, and it is not a fixed corpus you download. It is also not clinical data: the site states no diagnosis, treatment plan, outcome measure or medical record for these rows, and nothing here should be read as guidance on how to treat or handle a person.
Catalog rows
The site lists them in a Physiotherapy & Rehabilitation Clinic environment under the Healthcare & Life Sciences sector. The rows are Balance training ("Set up balance boards and supports and guide a patient through balance exercises.", Medium) and Rehabilitation equipment operation ("Set up and adjust rehab machines and guide a patient’s use of them.", Medium).
Both list the capture setup "Phone (head-mounted) / multiview rig" and the status Available on request, which the site defines as scoped and recruited to spec when a buyer asks for it, rather than already set up and recording. The environment lists its examples as physiotherapy clinic, rehabilitation center, sports medicine facility, and names assisted stretching, therapeutic exercise, mobility support, balance training and rehabilitation equipment operation. The first table below reproduces the two rows as the catalog states them.
Balance training
The catalog row reads "Set up balance boards and supports and guide a patient through balance exercises." It has two parts: arranging boards and supports, then guiding a patient through balance exercises. It is rated Medium. The first part is object handling and the second is hands-on guidance, so one row holds both.
Board types, support types, the exercises used and the way a patient is steadied are Not stated. This page makes no claim about them and gives no balance or handling guidance. They are set in the written spec.
Rehabilitation equipment operation
The catalog row reads "Set up and adjust rehab machines and guide a patient’s use of them." It has three parts: setting up a machine, adjusting it, and guiding a patient’s use of it. It is rated Medium. Of the two rows, it is the one the other physiotherapy pages leave out.
The site names rehab machines and nothing narrower. Which machines, what is adjusted on each, what values it is adjusted to and how a patient is guided on them are Not stated, and no brand or model is named. This page lists no settings and gives no operating guidance. Those details, if a task needs them, are set in the written spec.
Compared with neighbouring pages
Three neighbouring pages exist, and they are not the same topic. The egocentric physiotherapy stretching and exercise guidance page covers Assisted stretching, Therapeutic exercise guidance and Balance training. The stereo version of that page covers the two stretching and exercise guidance rows with a calibrated stereo pair and MCAP delivery. The patient mobility assistance page covers five mobility rows across three environments.
This page is the narrow view for teams scoping balance set-up and rehab equipment work in a physiotherapy clinic. The second table below sets the three against this page. Where a team also needs stretching or exercise guidance, the egocentric stretching page is the better starting point; where it needs standing, walking, transfer or a mobility-aid handover, start with the patient mobility assistance page. The site does not publish a separate physiotherapy clinic set-up page, so none is compared here.
Capture setup
Not as the site states it. The catalog lists "Phone (head-mounted) / multiview rig" for both rows and states no stereo pair for them. The site does offer a stereo pair through its general stereo offer, so stereo is a capture choice agreed in the written spec and proved on a Spec Pilot, not something these rows already run.
A head-mounted phone records the first-person view of real work on site, and a multiview rig adds synchronized third-person angles when the spec asks for them. The site states a head camera at 3840 × 2160 and 60 fps for its instrumented rig, but no camera count, resolution or frame rate for these rows, so the capture tier is agreed in the spec. Throughput is Not stated and is quoted against your spec.
Why it is hard
These rows put a hand on a board, a support or a machine while a second person is nearby. The site does not state how often equipment or a hand leaves the view in a clinic, so this page makes no claim about it. What the site does state is what egocentric video puts into the training distribution: hands entering the frame from below, occlusion during grasp and motion blur during reach.
The site also states why a hand pose stream matters here. RGB alone leaves a model to infer 3D hand structure it cannot see reliably through occlusion and motion blur. Firsthand delivers 3D hand pose as handJoints[2][21][3] in metric units in the head-camera frame, with a visibility flag per joint, aligned to depth and RGB. Two hands of 21 joints each are tracked per frame, and the flag records which of them were hidden.
Streams and labels
Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact and grasp events, and frame-accurate action segments. For these rows, hand pose tracks how the fingers hold a board, a support or a machine control, contact events mark when a hand meets the equipment or the patient, and action segments mark each step, such as a set-up, an adjustment and the guidance that follows.
The only language data the site ties to Firsthand capture is one task instruction per episode. Object labels use the terms your spec sets. The site states hand pose for the wearer’s hands, and states no pose stream for the patient’s body and none for the equipment. Force or tactile data, machine readouts, and success or quality labels for a balance session or an adjustment are Not stated for these rows, and this page does not offer them as deliverables.
Gloves
The site offers a tactile glove tier as a pilot-ready option. The gloves track the hands, the glove signal is time-synced to a head-mounted stereo camera by hardware timestamps and an IMU, each glove is calibrated every session, and the pipeline checks signal dropout and sync drift.
The site does not state that the glove tier has been used on any physiotherapy row, and it does not state whether gloves suit work with a patient or with rehab machines. Treat force and tactile data as Not stated for these rows unless a spec adds the glove tier and agrees the fit with you. The tactile glove page covers the tier in full.
Setting and privacy
The catalog places both rows in the Physiotherapy & Rehabilitation Clinic environment. The site states that capture in healthcare settings happens only in training environments with simulated patients, and that real patient footage is never captured, under any circumstance, regardless of what a spec requests. Who plays the patient is agreed in the written spec before capture begins.
Every episode links to a signed contributor release through a documented consent chain. Faces, plates and screens are detected and irreversibly blurred at ingest, a reviewer confirms the result before anything ships, and the anonymization record is delivered with the data. An undocumented bystander is also a stated reject criterion. The site names no clinic, city or practitioner, and states no further privacy rule specific to physiotherapy.
Quality gates
Episodes are machine-checked at ingest against the stated reject criteria, which include an object out of frame for more than 15 percent of the episode, more than 35 percent invalid depth pixels in the manipulation region, a sync breach beyond the ceiling for more than three consecutive frames, calibration drift beyond tolerance, an undocumented bystander and a mismatch against the named skill spec. A human reviewer then checks the result.
The site states these for every episode, so they apply to balance training and rehab equipment work alike. It does not state how often equipment leaves the view in a clinic, and it states no blur or sharpness rule. A rejected item goes to the reject log and is recaptured at our cost.
Delivery
Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. The last table below sets each against what its official documentation states. These episodes use the same schema as every other Firsthand collection, so a loader that reads another Firsthand dataset reads this one without changes.
Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch.
Fast · on demand
Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front.
On-demand top-ups run against the same spec and accept criteria after each training run. Both rows are Available on request, so the site states no capture timeline for them beyond a quote against your spec.
Scale
Firsthand runs custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs. That is the site’s general statement about the network.
The site states no provider count, hour total, throughput or cadence for these two rows, and this page does not add one. How many contributors, sites and sessions a balance and equipment collection needs is set in the written spec and quoted before capture begins.
The spec
You describe the steps and sequence your policy needs: what a balance set-up arranges, what an equipment adjustment covers, where each episode starts and ends. We turn that into a written spec covering tasks, environments, capture tier, annotation depth, who stands in for the patient and accept criteria, then quote reach, timeline and price before any capture begins.
A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Billing is per validated hour, a reject log ships with every batch, rejected items are recaptured at our cost, and every collection ships under a perpetual, buyer-owned commercial license.
At a glance
Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.
Catalog rows
| Task (as listed) | Description (as listed) | Environment | Skill | Capture setup | Status |
|---|---|---|---|---|---|
| Balance training | Set up balance boards and supports and guide a patient through balance exercises. | Physiotherapy & Rehabilitation Clinic | Medium | Phone (head-mounted) / multiview rig | Available on request |
| Rehabilitation equipment operation | Set up and adjust rehab machines and guide a patient’s use of them. | Physiotherapy & Rehabilitation Clinic | Medium | Phone (head-mounted) / multiview rig | Available on request |
Comparison
| Page | Main topic | Rows or tasks covered | How it differs from this page |
|---|---|---|---|
| This page | Balance training and rehab equipment operation | Balance training, Rehabilitation equipment operation | The only page that covers Rehabilitation equipment operation; narrow on equipment-centred work |
| Egocentric physiotherapy stretching and exercise guidance data | Hands-on stretching, exercise and balance work | Assisted stretching, Therapeutic exercise guidance, Balance training | Covers Balance training as one of three rows; does not cover Rehabilitation equipment operation |
| Stereo physiotherapy stretching and exercise guidance data | Stereo and MCAP delivery for stretching and exercise guidance | Assisted stretching, Therapeutic exercise guidance | Covers neither row on this page; centres a calibrated stereo pair and MCAP |
| Egocentric patient mobility assistance data | Standing, walking, transfer, balance and stretching support | Five mobility rows, including Balance training | Counts Balance training as one of five mobility rows; does not count Rehabilitation equipment operation |
Streams and tasks
| Stream or label | Status on this site | What it carries in these episodes |
|---|---|---|
| Head and wrist RGB, depth | Stated; ten streams synced under 2 ms | Keeps the equipment, the patient and both hands on one timeline |
| 3D hand pose, per-joint visibility | Stated; two hands of 21 joints, with a visibility flag per joint | Carries how the fingers hold a board, support or machine control and which joints were hidden |
| Contact and grasp events | Stated | Marks when a hand meets equipment or a patient |
| Action segments | Stated; frame-accurate | Separates a set-up, an adjustment and the guidance that follows |
| Task instruction | Stated; one per episode | Names the task the episode covers |
| Object labels | Set by your spec | Names the equipment and steps in the terms your policy uses |
| Patient body pose, equipment pose | Not stated | Not offered as a stream; set in the spec if needed |
| Force or tactile data | Glove tier stated; use on physiotherapy rows Not stated | Added only if a spec includes the glove tier |
What is not stated
| Item | Status on this site | Where it is settled |
|---|---|---|
| Board, support and machine types | Not stated; the rows name balance boards, supports and rehab machines only | The written spec |
| Exercises, adjustments and settings | Not stated | The written spec |
| Conditions, diagnoses, treatment protocols and outcomes | Not stated | Not offered; set in the spec only if a task needs it |
| Equipment brands and models | Not stated | The written spec |
| Number of clinics or practitioners, skill levels | Not stated | The written spec |
| Who plays the patient | Simulated patients only, as the site states | The written spec, agreed before capture |
| Stereo pair on these rows | Not stated for the rows; offered generally | The written spec, proved on a Spec Pilot |
| Throughput and capture timeline | Not stated | Quoted against your spec |
| Force or tactile data on physiotherapy rows | Not stated | The written spec, if needed |
| Success or quality labels, robot results | Not stated | The written spec, if needed |
Formats
| Format | What the official documentation states | Used for here |
|---|---|---|
| RLDS | A dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README) | Episode-based training loaders |
| LeRobot | LeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation) | LeRobot dataset format and tooling |
| WebDataset | Tar files in which files that belong together share a basename, split into numbered shards (WebDataset README) | Sharded streaming for large training runs |
| HDF5 and zarr | Stated by Firsthand only | Array storage for custom pipelines |
| Rerun .rrd | Stated by Firsthand only | Multi-stream synchronized playback for review |
Example footage
One real clip already published on this site, shown as a format and rig example: ten seconds of first-person home cooking with faces blurred. It does not show balance training or rehab equipment operation.
No physiotherapy clip is published on the site, so this is labelled as a format example. Request a sample to see delivered files. See sample data outputs, request an egocentric data sample.
FAQ
Sources
Tell us the set-ups, adjustments and sequence your policy needs to handle. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.