Now recruiting capture teams worldwide. Get paid to record first-person video of real work.

Apply to capture

Task family

Stereo Physiotherapy Stretching and Exercise Guidance Data

Assisted stretching and therapeutic exercise guidance are two-person, hands-on tasks: one person holds and supports a patient’s limb through a stretch, or demonstrates an exercise and corrects a patient’s movement and posture by hand. This page covers the stereo and container side of physiotherapy robot training data: what a calibrated stereo pair adds when a limb, a hand and a piece of equipment share one close view, which catalog rows apply, what MCAP is according to its own documentation, and what the site does not state. We run custom clinical data collection fast and on demand against a spec you write, as stereo assisted stretching video and an egocentric therapeutic exercise guidance dataset, with custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.
Catalog rows
"Assisted stretching" and "Therapeutic exercise guidance": Medium, Available on request
Catalog capture setup
Phone (head-mounted) / multiview rig
Stereo head rig (06)
Dual fisheye, 1080p per eye, 62 mm baseline
Container
MCAP (.mcap), open source
License
Perpetual, buyer-owned

Why stereo and MCAP here

What do a stereo pair and an MCAP file add to physiotherapy video?

01

Depth of the scene, not only its colour

The site states that a stereo pair at human-eye spacing makes depth recoverable from every frame pair, so the geometry of the hands, a supported limb and any board or support sits in the same capture as the first-person view.

02

Hands that survive the hold

3D hand pose carries a per-joint visibility flag, so a finger hidden behind a limb or a wrist is flagged as hidden rather than silently guessed.

03

A scene boundary stated before capture

Healthcare capture on this site uses simulated patients only and never real patient footage. Who stands in for the patient is agreed in the written spec.

04

Several streams in one container

MCAP stores multiple channels of timestamped, pre-serialized data, so a stereo pair, hand pose and IMU can share one file on one log-time axis. Which streams go in the file is set in the written spec.

Definition

What is stereo physiotherapy stretching and exercise guidance data?

It is first-person video of hands-on movement work in a physiotherapy clinic, recorded from the worker’s own point of view with a calibrated stereo pair and with hand pose and sensor streams alongside. The tasks are the two the site’s catalog lists: Assisted stretching and Therapeutic exercise guidance. Stereo describes the capture, and MCAP describes the container. They are separate choices, and a team can order either one without the other.

The site does not state that stereo is already running on these rows. The catalog lists a head-mounted phone or a multiview rig as the capture setup, and a stereo pair is a capture choice agreed in the written spec and confirmed on a Spec Pilot. The data is human capture by a paid, consented contributor, not robot or teleoperation data. It is also not clinical data: the site states no diagnosis, treatment plan, outcome measure or medical record for these rows. Firsthand is not affiliated with Foxglove or the MCAP maintainers.

Difference

How is this different from the egocentric physiotherapy page and the other healthcare pages?

The egocentric physiotherapy stretching and exercise guidance page covers three rows, Assisted stretching, Therapeutic exercise guidance and Balance training, from the first-person side. This page covers the two stretching and exercise guidance rows only, and adds the two choices layered on top: a calibrated stereo pair for depth, and MCAP as the delivery container. Balance training is left to the egocentric page, so a team that needs it should start there.

The patient mobility assistance page treats Assisted stretching as one of five mobility rows and does not count Therapeutic exercise guidance. The healthcare hub page covers non-clinical healthcare tasks in simulated-patient training settings, and the hospital and clinical care page covers a hospital environment. The comparison table below sets them side by side. The site has no other stereo page for a physiotherapy clinic, so none is compared here.

Catalog rows

Which catalog rows cover assisted stretching and exercise guidance?

Two rows, reproduced exactly in the first table below. Both sit in the Physiotherapy & Rehabilitation Clinic environment, in the Healthcare & Life Sciences sector. "Assisted stretching" reads "Guide a patient’s limb through a stretch, holding and supporting the joint through the range." and "Therapeutic exercise guidance" reads "Demonstrate exercises and correct a patient’s movement and posture by hand." Both are rated Medium, list "Phone (head-mounted) / multiview rig" as the capture setup and are Available on request.

Available on request means the work is scoped and recruited to your spec when you ask, rather than already queued. The environment lists its examples as physiotherapy clinic, rehabilitation center, sports medicine facility, and names assisted stretching, therapeutic exercise, mobility support, balance training and rehabilitation equipment operation. The other rows in that environment, Mobility support, Balance training and Rehabilitation equipment operation, are not counted on this page.

Assisted stretching

What does the Assisted stretching row say, and what does it leave out?

It is a two-person task: one person holds and supports a limb while it moves through a range, so the working hand is in contact with a body for the whole step. The row names a limb, a joint and a range, and no more. Which limbs and joints, how long a stretch is held, how many are done in a session and what a stretch is meant to achieve are Not stated, so this page makes no claim about them and offers no stretching or handling guidance.

For stereo capture this is a depth question about a hand and a body part held close together. The site states no joint angle, range-of-motion measure or limb pose stream for these rows, and this page does not offer them. What stereo adds is depth recovered from the calibrated pair for the scene in frame, set beside the hand pose of the wearer.

Therapeutic exercise guidance

What does the Therapeutic exercise guidance row say, and what does it leave out?

The row has two parts: demonstrating an exercise, then correcting a patient’s movement and posture by hand. The first part is the contributor’s own movement, and the second is a hand placed on a patient. Which exercises are demonstrated, how a correction is made and how many repetitions are asked are Not stated, and the site states no outcome label for whether a movement was corrected.

This is where an egocentric therapeutic exercise guidance dataset captured in stereo differs from a flat-video one: the demonstration puts the wearer’s arms and hands through space in front of the cameras, and the correction puts a hand against a body. Whether a lab wants the two parts as separate episodes or one is set in the written spec, through action segments. Exercise prescriptions, programs and repetition counts are not stated and are not invented here.

Why stereo

Why capture assisted stretching and exercise guidance in stereo?

The site states that a stereo pair at human-eye spacing makes depth recoverable from every frame pair, rather than from a standalone depth sensor. In a clinic episode that puts the geometry of the scene, including a hand, a supported limb and any board or support, in the same capture as the first-person view. The site gives no depth accuracy figure for these rows, so what a buyer does with the depth is their pipeline’s question.

Whether a physiotherapy program wants stereo alone or stereo beside a depth sensor is not something the catalog rows state, and it is agreed in the written spec.

Capture setup

What does the capture setup look like, and what is not stated?

The site describes two stereo-capable setups and does not say which one a physiotherapy order uses. The hard-environments stack is a global-shutter 4K/60 head camera with a 120° lens, two 1080p/60 wrist cameras, a depth sensor at 848×480 and 30 fps, and 200 Hz 6-DoF IMUs. The off-the-shelf stereo head rig, dataset 06, is dual fisheye cameras at 1080p per eye, a 62 mm baseline, per-unit calibration, a 9-axis IMU and hand-tracking output.

Which rig, resolution and streams a physiotherapy order uses is Not stated on the site, and the second table below sets what is stated beside what is not. Intrinsics and extrinsics are re-solved at the start and end of every session, and streams are hardware-triggered onto one clock with a 2.0 ms cross-stream ceiling. Wrist views can be added in the spec, which matters when a grip is hidden from the head camera by the limb being held.

Hands and contact

How are hands, contact and visibility handled when a hand holds a limb?

These rows put a hand on a body while a second person moves. The site does not state how often a limb or a hand leaves the view, so this page makes no claim about it. What the site does state is what egocentric video puts into the training distribution: hands entering the frame from below, occlusion during grasp and motion blur during reach.

Firsthand delivers 3D hand pose as handJoints[2][21][3] in metric units in the head-camera frame, with a visibility flag per joint, aligned to depth and RGB. Two hands of 21 joints each are tracked per frame, and the flag records which are hidden. Contact events mark when a hand meets a limb, a patient or equipment, and frame-accurate action segments mark each step. The site states hand pose for the wearer’s hands and no pose stream for the patient’s body. The only language data the site ties to Firsthand capture is one task instruction per episode.

Setting and privacy

Who appears in the footage and how are bystanders protected?

The catalog places both rows in the Physiotherapy & Rehabilitation Clinic environment. The site states that capture in healthcare settings happens only in training environments with simulated patients, and that real patient footage is never captured, under any circumstance, regardless of what a spec requests. Who plays the patient is agreed in the written spec before capture begins.

Every episode links to a signed contributor release through a documented consent chain. Faces, plates and screens are detected and irreversibly blurred at ingest, a reviewer confirms the result before anything ships, and the anonymization record is delivered with the data. An undocumented bystander is also a stated reject criterion. The site names no clinic, city or practitioner, and states no further privacy rule specific to physiotherapy.

Failure modes

What goes wrong when you record stretching and exercise guidance in stereo?

Hands are the first risk. A hand wrapped around a limb is often hidden from the head camera, and the visibility flag on each joint is the site’s answer, with wrist views available when the spec asks for them. Depth is the second. An episode is rejected when more than 35 percent of depth pixels in the manipulation region are invalid, and per-frame confidence maps mask low-confidence regions. How depth behaves on a clinic scene in particular is Not stated, so this page promises no figure.

Calibration is the third, because stereo depth is only as good as the rectification behind it: calibration is measured at the start and end of every session under a 0.28 px RMS gate. An episode is also rejected when the manipulated object is out of frame for more than 15 percent of it, when sync breaches the ceiling for more than three consecutive frames, or when an undocumented bystander appears. A reject log ships with every batch, and rejected items are recaptured at our cost.

MCAP

What is MCAP, per its own documentation?

MCAP is an open source container file format for multimodal log data, supporting multiple channels of timestamped pre-serialized data. It is serialization-agnostic, so messages can be Protobuf, DDS (CDR), ROS, JSON and more. Its design is row-oriented and append-only, it stores schemas alongside the data, and it offers an optional index plus optional LZ4 or Zstandard chunk compression.

Reader and writer libraries exist for C++, Go, Python, Rust, Swift and TypeScript, and the mcap CLI can inspect, merge and split files. The foxglove/mcap repository is MIT-licensed; that is the MCAP project’s licence, not the licence of a Firsthand delivery. The MCAP hub page and the glossary entry cover the format in full.

Streams

Which streams can ship in an MCAP delivery of physiotherapy data?

Firsthand offers MCAP delivery, and dataset 06 is stated as shipping as MCAP. For these rows the site states hand pose, a stereo-derived depth stream, IMU, contact events and action segments elsewhere. What it does not state is which of those are channels in an MCAP file, how they are named, what encoding they use or at what rate.

No topic name, message schema or rate is stated on this page, and none should be assumed. Name the streams that matter in the written spec and confirm them on a Spec Pilot batch. If your training loop expects RLDS, LeRobot or WebDataset, name that format beside MCAP. The third table below sets each stream beside what the site states about it.

Scale

How do off-the-shelf data and custom collection combine for physiotherapy work?

Off-the-shelf covers what is already in stock: the stereo category lists the stereo datasets and hand-tracking video, and only dataset 06 is stated as MCAP. This page does not claim off-the-shelf coverage of physiotherapy. Custom collection covers the rest: custom clinical data collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.

A lab can start a pipeline on the stock stereo and hand-tracking video, then order physiotherapy batches against one written spec so each recurring batch is captured and checked the same way. The site states no batch size, cadence, provider count or hours for physiotherapy, so those are Not stated.

Fast · on demand

How fast can a custom stereo physiotherapy dataset be collected?

Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front. Both rows are Available on request, so the site states no capture timeline for them beyond a quote against your spec.

On-demand top-ups run against the same spec and accept criteria after each training run. Every collection ships under a perpetual, buyer-owned commercial license, and a Spec Pilot, a small and fast first batch, proves the spec and accept criteria before you scale.

Ordering

How do you order a stereo physiotherapy stretching and exercise guidance dataset?

Describe the steps and their order: where a stretch starts and ends, what a demonstration is, what a corrected posture is. Then name who stands in for the patient, the streams you want in the file, the topic naming and message encoding your reader expects, whether calibration ships inside the file or beside it, and whether MCAP is the only delivery or sits beside RLDS, LeRobot, WebDataset, HDF5 or zarr.

We turn that into a written spec and quote reach, timeline and price before any capture begins. The fourth table below shows what each spec element decides.

At a glance

What you get.

Catalog rows
Two rows in Physiotherapy & Rehabilitation Clinic: "Assisted stretching" and "Therapeutic exercise guidance", both Medium and Available on request
Catalog capture setup
Phone (head-mounted) / multiview rig on both rows; a stereo pair is agreed in the written spec
Stereo head rig (06)
Dual fisheye, 1080p per eye, 62 mm baseline, per-unit calibration, 9-axis IMU, hand-tracking output; shipped as MCAP
Hand pose
21 joints per hand with a per-joint visibility flag
Sync
Hardware-triggered onto one clock; 2.0 ms cross-stream ceiling
Patients
Simulated patients only; real patient footage is never captured
MCAP topics, schemas, rates
Not stated on the site; agreed in the written spec
Joint angles, range of motion, hold times, repetitions, outcomes
Not stated
License
Perpetual, irrevocable, buyer-owned, non-exclusive by default

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

Catalog rows

Which catalog rows cover assisted stretching and exercise guidance?

The two rows, reproduced as the catalog states them, with the description, environment, skill, capture setup and status as listed.
Task (as listed)Description (as listed)EnvironmentSkillCapture setupStatus
Assisted stretchingGuide a patient’s limb through a stretch, holding and supporting the joint through the range.Physiotherapy & Rehabilitation ClinicMediumPhone (head-mounted) / multiview rigAvailable on request
Therapeutic exercise guidanceDemonstrate exercises and correct a patient’s movement and posture by hand.Physiotherapy & Rehabilitation ClinicMediumPhone (head-mounted) / multiview rigAvailable on request

Stated vs not stated

What the site states about stereo capture for physiotherapy work

Left to right: the item, what the site states, and what that means for a physiotherapy order. “Not stated” means the site does not say.
ItemWhat the site statesFor a physiotherapy order
Catalog capture setupPhone (head-mounted) / multiview rig on both rowsA stereo pair is a spec choice; not stated on the rows
Stereo head rig (dataset 06)Dual fisheye, 1080p per eye, 62 mm baseline, per-unit calibration, 9-axis IMU, hand-tracking output; shipped as MCAPWhether a physiotherapy order uses it: Not stated
Hard-environments stack4K/60 head camera, 120° lens; two 1080p/60 wrist cameras; depth 848×480 at 30 fps; 200 Hz 6-DoF IMUWhether a physiotherapy order uses it: Not stated
CalibrationMeasured every session and shipped with the episode; 0.28 px RMS reprojection gateStated
SynchronizationHardware-triggered onto one clock; 2.0 ms cross-stream ceilingStated
Hand pose21 joints per hand with a per-joint visibility flagStated; the wearer’s hands only
Patient body poseNot statedNot offered as a stream; set in the spec if needed
Joint angles, range of motion, hold times, repetitions, outcomesNot stated; no such label or stream is listedNot offered
MCAP topics, schemas, ratesNot statedAgreed in the written spec

Stream map

Streams for physiotherapy work and what the site states about an MCAP file

Left to right: the stream or item, what the site states about it, and what the site states about it in MCAP. “Not stated” means the site does not say.
Stream or itemWhat the site statesIn an MCAP delivery, as the site states it
Stereo pairDual fisheye, 1080p per eye, 62 mm baseline (dataset 06)Dataset 06 is stated as shipped as MCAP; channel layout not stated
Depth with confidence mapsRecovered from the calibrated stereo pair; confidence map masks low-confidence regionsNot stated
Hand pose21 joints per hand with a per-joint visibility flagChannel layout and joint order not stated
IMU9-axis (dataset 06); 6-DoF at 200 Hz (hard-environments stack)Channel layout and rate not stated
Contact events and action segmentsListed in the site’s episode schemaNot stated
Task instructionOne per episode; the only language data tied to Firsthand captureNot stated
CalibrationMeasured every session and shipped with the episodePlacement in the file not stated
Topic names, schemas, encoding, ratesNot statedAgreed in the written spec

Skill spec

What the written spec fixes for a stereo physiotherapy order

Spec element and where a buyer can see it in the delivery. “Set per program” means the site states no fixed value.
Spec elementWhat it decidesWhere it shows up
Steps and orderWhat one stretch, demonstration or correction is, and where an episode starts and stopsEpisode boundaries and action segments; set per program
Who plays the patientThe simulated patient, agreed before captureSet per program; real patient footage is never captured
Rig and streamsStereo pair, wrist views, hand pose, IMU and any othersThe channels you can read; confirm on the Spec Pilot
MCAP topics and encodingWhat your reader expectsSet per program
Calibration deliveryInside the file or beside itSet per program
Delivery formatHow the data is packagedMCAP alone, or beside RLDS, LeRobot, WebDataset, HDF5 or zarr
Accept criteriaWhat passes QAReject log per batch
PrivacyHow people in frame are protectedFaces and screens blurred at ingest
LicenseWho owns the datasetPerpetual, irrevocable, buyer-owned, non-exclusive by default

Cluster map

Which page covers which physiotherapy and healthcare work?

The nearest existing pages, set against this page by main topic and rows covered. Counts overlap between pages.
PageMain topicRows or tasks coveredHow it differs from this page
This pageStereo and MCAP view of stretching and exercise guidanceAssisted stretching, Therapeutic exercise guidanceAdds a calibrated stereo pair and MCAP delivery to two rows
Egocentric physiotherapy stretching and exercise guidance dataFirst-person physiotherapy stretching, exercise and balance workAssisted stretching, Therapeutic exercise guidance, Balance trainingThe egocentric sibling; covers Balance training; does not centre stereo or MCAP
Egocentric patient mobility assistance dataStanding, walking, transfer, balance and stretching supportFive mobility rows, including Assisted stretchingBroader on mobility; does not count Therapeutic exercise guidance
Egocentric hospital and clinical care dataHospital and clinical care tasksHospital environment rowsA different environment, not the physiotherapy clinic
Healthcare egocentric dataNon-clinical healthcare tasks in simulated-patient training settingsThe healthcare family as a wholeA hub, not a stretching or exercise page

Example footage

What does egocentric stereo footage look like?

One real clip already published on this site. It is a format and rig example: a head-mounted stereo capture with hands in frame. It is not physiotherapy work, and it does not show a task from this page.

egocentric_stereo_sample.mp4 · head-mounted stereo · hands in frame · 1920 × 1080 web preview · rig example, not a physiotherapy clip

No physiotherapy clip is published on the site, so this is the nearest stereo clip. Request a sample to see delivered files. See stereo sample page, stereo + wrist-cam example videos, request an egocentric data sample.

FAQ

Physiotherapy robot training data, answered.

What is stereo physiotherapy stretching and exercise guidance data?
First-person video from two calibrated cameras of a person guiding a patient’s limb through a stretch, or demonstrating exercises and correcting movement and posture by hand, with depth and hand pose alongside and simulated patients only.
Which catalog rows cover it?
Two. "Assisted stretching" and "Therapeutic exercise guidance", both in Physiotherapy & Rehabilitation Clinic, rated Medium, captured by head-mounted phone or multiview rig and listed as Available on request.
Is stereo already captured on these rows?
Not stated. The catalog lists a head-mounted phone or multiview rig, and a stereo pair is agreed in the written spec and confirmed on a Spec Pilot.
Are real patients filmed?
No. The site states that healthcare capture uses simulated patients only in training environments and that real patient footage is never captured. Faces are irreversibly blurred at ingest, and each episode links to a signed contributor release.
Does it include joint angles, range of motion, outcomes or exercise advice?
No. Joint angles, range of motion, hold times, repetitions, conditions and outcomes are Not stated, and this page gives no medical, handling or exercise guidance. It describes what is collected for robot training.
Can it be delivered as MCAP, and what is in the file?
Yes. Firsthand offers MCAP delivery. Topic names, message schemas and rates are Not stated on the site and are agreed in the written spec.
How does this differ from the egocentric physiotherapy page?
The egocentric page covers three rows from the first-person side, including Balance training. This page covers the two stretching and exercise guidance rows and adds a calibrated stereo pair and MCAP delivery.
How fast is a first batch, and who owns the data?
Where coverage is deep, the median time from signed spec to first validated batch is 48 hours; thin coverage typically runs three to four weeks. Which applies to these rows is not stated. The buyer owns the dataset under a perpetual, irrevocable, non-exclusive-by-default licence, with exclusivity available.

Sources

Where is MCAP documented?

Request a custom stereo physiotherapy dataset delivered as MCAP.

Tell us the stretching and exercise steps and their order, who stands in for the patient, the streams you want in the file and whether MCAP sits alone or beside a training format. We will quote reach, timeline and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.