Both hands and the body in one view
A head-mounted view keeps both hands, the limb or posture being guided and any board or support in one view while the stretch is held, the exercise is shown or the balance work is set up.
Now recruiting capture teams worldwide. Get paid to record first-person video of real work.
Apply to captureTask family
Requirements
A head-mounted view keeps both hands, the limb or posture being guided and any board or support in one view while the stretch is held, the exercise is shown or the balance work is set up.
3D hand pose with a per-joint visibility flag records where the fingers are, and which joints were hidden, while a limb is held or a posture is corrected by hand.
Frame-accurate action segments mark where a stretch, a demonstration, a correction or a set-up ends and the next step begins, aligned to video and depth.
Healthcare capture on this site uses simulated patients only and never real patient footage. Who stands in for the patient is agreed in the written spec.
A perpetual, buyer-owned commercial license backed by a documented consent chain.
Why it matters
Egocentric physiotherapy stretching and exercise guidance data is real-world, first-person video of hands-on movement work in a physiotherapy clinic. It is recorded from the worker viewpoint, with depth, 3D hand pose, contact events and frame-accurate action segments aligned on one hardware clock. It covers three tasks the site states in its task catalog: Assisted stretching, Therapeutic exercise guidance and Balance training.
The patient mobility assistance page treats Assisted stretching and Balance training as two of five mobility rows and does not count Therapeutic exercise guidance. This page narrows to the three rows about stretching, exercise and balance work, so a team that needs egocentric physiotherapy data, first-person assisted stretching video or a therapeutic exercise and balance training dataset can scope exactly those tasks. It is custom rehabilitation clinic data collection, fast and on demand, written to your spec.
The data is human capture. A paid, consented contributor performs the task while a rig records it. It is not robot or teleoperation data, it is not simulation data, and it is not a fixed corpus you download. It is also not clinical data: the site states no diagnosis, treatment plan, outcome measure or medical record for these rows, and nothing here should be read as guidance on how to treat or handle a person.
Catalog rows
The site lists them in a Physiotherapy & Rehabilitation Clinic environment under the Healthcare & Life Sciences sector. The rows are Assisted stretching ("Guide a patient’s limb through a stretch, holding and supporting the joint through the range.", Medium), Therapeutic exercise guidance ("Demonstrate exercises and correct a patient’s movement and posture by hand.", Medium) and Balance training ("Set up balance boards and supports and guide a patient through balance exercises.", Medium).
All three list the capture setup "Phone (head-mounted) / multiview rig" and the status Available on request, which the site defines as scoped and recruited to spec when a buyer asks for it, rather than already set up and recording. The environment lists its examples as physiotherapy clinic, rehabilitation center, sports medicine facility, and names assisted stretching, therapeutic exercise, mobility support, balance training and rehabilitation equipment operation. The first table below reproduces the three rows as the catalog states them.
Assisted stretching
The catalog row reads "Guide a patient’s limb through a stretch, holding and supporting the joint through the range." It is a two-person task: one person holds and supports a limb while it moves through a range, so the working hand is in contact with a body for the whole step. It is rated Medium.
The site names a limb, a joint and a range, and no more. Which limbs and joints, how long a stretch is held, how many are done in a session and what a stretch is meant to achieve are Not stated, so this page makes no claim about them and gives no stretching or handling guidance. They are set in the written spec.
Therapeutic exercise guidance
The catalog row reads "Demonstrate exercises and correct a patient’s movement and posture by hand." It has two parts, demonstrating an exercise and then correcting a patient’s movement and posture by hand, and it is rated Medium. It is the one row on this page that the patient mobility assistance page leaves out.
Which exercises are demonstrated, how a correction is made and how many repetitions are asked of a patient are Not stated, and the site states no outcome label for whether a movement was corrected. Exercise prescriptions, programs and repetition counts are not stated, and this page does not invent them.
Balance training
The catalog row reads "Set up balance boards and supports and guide a patient through balance exercises." It covers arranging boards and supports and then guiding a patient through balance exercises, and it is rated Medium. The first part is object handling and the second is hands-on guidance, so one row holds both.
Board types, support types, the exercises used and the way a patient is steadied are Not stated. The same row also appears in the patient mobility assistance page, where it is counted as one of five mobility rows. This page reads it as part of a set with stretching and exercise guidance instead.
Compared with neighbouring pages
Four neighbouring pages exist, and they are not the same topic. The patient mobility assistance page covers five mobility rows across three environments, the elder care and assisted living page covers nursing home rows, the hospital and clinical care page covers a hospital environment, and the patient room prep page covers a different task family.
This page is the narrow view for teams scoping stretching, exercise guidance and balance work in a physiotherapy clinic. The second table below sets the four against this page. Where a team also needs standing, walking, transfer or a mobility-aid handover, the patient mobility assistance page is the better starting point. The site does not publish a separate physiotherapy clinic set-up page, so none is compared here.
Capture setup
Not as the site states it. The catalog lists "Phone (head-mounted) / multiview rig" for every row on this page and states no stereo pair for them. The site does offer a stereo pair through its general stereo offer, so stereo is a capture choice agreed in the written spec and proved on a Spec Pilot, not something these rows already run.
A head-mounted phone records the first-person view of real work on site, and a multiview rig adds synchronized third-person angles when the spec asks for them. The site states a head camera at 3840 × 2160 and 60 fps for its instrumented rig, but no camera count, resolution or frame rate for these rows, so the capture tier is agreed in the spec. Throughput is Not stated and is quoted against your spec.
Why it is hard
These rows put a hand on a body, a board or a support while a second person moves. The site does not state how often a limb or a hand leaves the view, so this page makes no claim about it. What the site does state is what egocentric video puts into the training distribution: hands entering the frame from below, occlusion during grasp and motion blur during reach.
The site also states why a hand pose stream matters here. RGB alone leaves a model to infer 3D hand structure it cannot see reliably through occlusion and motion blur. Firsthand delivers 3D hand pose as handJoints[2][21][3] in metric units in the head-camera frame, with a visibility flag per joint, aligned to depth and RGB. Two hands of 21 joints each are tracked per frame, and the flag records which of them were hidden.
Streams and labels
Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact and grasp events, and frame-accurate action segments. For these rows, hand pose tracks how the fingers hold a limb or a support, contact events mark when a hand meets the limb, the patient or a board, and action segments mark each step, such as a hold, a demonstration, a correction and a set-up.
The only language data the site ties to Firsthand capture is one task instruction per episode. Object labels use the terms your spec sets. The site states hand pose for the wearer’s hands, and states no pose stream for the patient’s body. Force or tactile data, and success or quality labels for a stretch, an exercise or a balance session, are Not stated for these rows, and this page does not offer them as deliverables.
Gloves
The site offers a tactile glove tier as a pilot-ready option. The gloves track the hands, the glove signal is time-synced to a head-mounted stereo camera by hardware timestamps and an IMU, each glove is calibrated every session, and the pipeline checks signal dropout and sync drift.
The site does not state that the glove tier has been used on any physiotherapy row, and it does not state whether gloves suit hands-on work with a patient. Treat force and tactile data as Not stated for these rows unless a spec adds the glove tier and agrees the fit with you. The tactile glove page covers the tier in full.
Setting and privacy
The catalog places all three rows in the Physiotherapy & Rehabilitation Clinic environment. The site states that capture in healthcare settings happens only in training environments with simulated patients, and that real patient footage is never captured, under any circumstance, regardless of what a spec requests. Who plays the patient is agreed in the written spec before capture begins.
Every episode links to a signed contributor release through a documented consent chain. Faces, plates and screens are detected and irreversibly blurred at ingest, a reviewer confirms the result before anything ships, and the anonymization record is delivered with the data. An undocumented bystander is also a stated reject criterion. The site names no clinic, city or practitioner, and states no further privacy rule specific to physiotherapy.
Quality gates
Episodes are machine-checked at ingest against the stated reject criteria, listed in the fourth table below, and a human reviewer then checks the result. The site states them for every episode, so they apply to stretching, exercise guidance and balance training alike.
It does not state how often a limb or a board leaves the view in a clinic, and it states no blur or sharpness rule. A rejected item goes to the reject log and is recaptured at our cost.
Delivery
Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. The last table below sets each against what its official documentation states. These episodes use the same schema as every other Firsthand collection, so a loader that reads another Firsthand dataset reads this one without changes.
Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch.
Fast · on demand
Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front.
On-demand top-ups run against the same spec and accept criteria after each training run. All three rows are Available on request, so the site states no capture timeline for them beyond a quote against your spec.
The spec
You describe the steps and sequence your policy needs: where a stretch starts and ends, what a corrected posture is, how a balance set-up is arranged. We turn that into a written spec covering tasks, environments, capture tier, annotation depth, who stands in for the patient and accept criteria, then quote reach, timeline and price before any capture begins.
A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Billing is per validated hour, a reject log ships with every batch, rejected items are recaptured at our cost, and every collection ships under a perpetual, buyer-owned commercial license.
At a glance
Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.
Catalog rows
| Task (as listed) | Description (as listed) | Environment | Skill | Capture setup | Status |
|---|---|---|---|---|---|
| Assisted stretching | Guide a patient’s limb through a stretch, holding and supporting the joint through the range. | Physiotherapy & Rehabilitation Clinic | Medium | Phone (head-mounted) / multiview rig | Available on request |
| Therapeutic exercise guidance | Demonstrate exercises and correct a patient’s movement and posture by hand. | Physiotherapy & Rehabilitation Clinic | Medium | Phone (head-mounted) / multiview rig | Available on request |
| Balance training | Set up balance boards and supports and guide a patient through balance exercises. | Physiotherapy & Rehabilitation Clinic | Medium | Phone (head-mounted) / multiview rig | Available on request |
Comparison
| Page | Main topic | Rows or tasks covered | How it differs from this page |
|---|---|---|---|
| This page | Physiotherapy stretching, exercise guidance and balance training | Assisted stretching, Therapeutic exercise guidance, Balance training | The narrow view for hands-on stretching, exercise and balance work |
| Egocentric patient mobility assistance data | Standing, walking, transfer, balance and stretching support | Five mobility rows, including Balance training and Assisted stretching | Broader on mobility; does not count Therapeutic exercise guidance; start here if you need transfer or walking |
| Egocentric elder care and assisted living data | Nursing home and assisted living care tasks | Nursing home rows | A different environment, not the physiotherapy clinic |
| Egocentric hospital and clinical care data | Hospital and clinical care tasks | Hospital environment rows | A different environment, not the physiotherapy clinic |
| Egocentric patient room prep and surface decontamination data | Patient room preparation and surface decontamination | Room prep and decontamination rows | A different task family, not stretching or exercise |
Streams and tasks
| Stream or label | Status on this site | What it carries in these episodes |
|---|---|---|
| Head and wrist RGB, depth | Stated; ten streams synced under 2 ms | Keeps the limb, any board and both hands on one timeline |
| 3D hand pose, per-joint visibility | Stated; two hands of 21 joints, with a visibility flag per joint | Carries how the fingers hold a limb or support and which joints were hidden |
| Contact and grasp events | Stated | Marks when a hand meets the limb, a patient or a board |
| Action segments | Stated; frame-accurate | Separates a hold, a demonstration, a correction and a set-up |
| Task instruction | Stated; one per episode | Names the task the episode covers |
| Object labels | Set by your spec | Names the equipment and steps in the terms your policy uses |
| Patient body pose | Not stated | Not offered as a stream; set in the spec if needed |
| Force or tactile data | Glove tier stated; use on physiotherapy rows Not stated | Added only if a spec includes the glove tier |
Quality gates
| Reject criterion | Status on this site | In a physiotherapy clinic |
|---|---|---|
| Manipulated object out of frame for more than 15 percent of the episode | Stated | Applies to every episode; how often a limb or board leaves the view is Not stated |
| More than 35 percent invalid depth pixels in the manipulation region | Stated | Applies to every episode; depth behaviour on a clinic scene is Not stated |
| Sync breach beyond the ceiling for more than three consecutive frames | Stated | Applies to every episode |
| Calibration drift beyond tolerance | Stated | Applies to every episode |
| Undocumented bystander | Stated | Applies to every episode; the episode is rejected |
| Mismatch against the named skill spec | Stated | Checked against the task and steps your spec names |
| Blur or sharpness rule | Not stated | Set in the spec if your policy needs one |
What is not stated
| Item | Status on this site | Where it is settled |
|---|---|---|
| Limbs, joints, exercises, board and support types | Not stated; rows name a limb, a joint, exercises, balance boards and supports only | The written spec |
| Hold durations, repetitions and session length | Not stated | The written spec |
| Conditions, diagnoses, treatment protocols and outcomes | Not stated | Not offered; set in the spec only if a task needs it |
| Equipment brands and models | Not stated | The written spec |
| Number of clinics or practitioners, skill levels | Not stated | The written spec |
| Who plays the patient | Simulated patients only, as the site states | The written spec, agreed before capture |
| Stereo pair on these rows | Not stated for the rows; offered generally | The written spec, proved on a Spec Pilot |
| Throughput and capture timeline | Not stated | Quoted against your spec |
| Force or tactile data on physiotherapy rows | Not stated | The written spec, if needed |
| Success or quality labels, robot results | Not stated | The written spec, if needed |
Formats
| Format | What the official documentation states | Used for here |
|---|---|---|
| RLDS | A dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README) | Episode-based training loaders |
| LeRobot | LeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation) | LeRobot dataset format and tooling |
| WebDataset | Tar files in which files that belong together share a basename, split into numbered shards (WebDataset README) | Sharded streaming for large training runs |
| HDF5 and zarr | Stated by Firsthand only | Array storage for custom pipelines |
| Rerun .rrd | Stated by Firsthand only | Multi-stream synchronized playback for review |
Example footage
One real clip already published on this site, shown as a format and rig example: ten seconds of first-person home cooking with faces blurred. It does not show stretching, exercise guidance or balance training.
No physiotherapy clip is published on the site, so this is labelled as a format example. Request a sample to see delivered files. See sample data outputs, request an egocentric data sample.
FAQ
Sources
Tell us the steps and sequence your policy needs to handle. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.