Fingers tracked, not just the wrist
Fine manipulation regrasping, in-hand reorientation, precision pinches depends on finger-level pose, not a single wrist or gripper position.
Manipulation

Requirements
Fine manipulation regrasping, in-hand reorientation, precision pinches depends on finger-level pose, not a single wrist or gripper position.
Contact events aligned to the same clock as video and depth mark exactly when and where each part of the hand makes and breaks contact.
When the object or the hand itself occludes fingers, visibility flags mark it rather than letting a tracker hallucinate a pose.
A perpetual, buyer-owned commercial license backed by a documented consent chain, so a policy trained on the data can go into a product.
Why it matters
Most manipulation data defaults to a wrist-level pose or a parallel-gripper state because it is simpler to log. But fine manipulation, tool use, in-hand reorientation, precision pinches happens at the fingertip, and that signal is lost the moment capture drops to wrist level.
Capturing it requires 3D hand pose tracked through the full reach-grasp-adjust cycle, with visibility flags for the fingers an object or the hand itself occludes, not a wide shot that loses finger detail.
Capture setup
A head-mounted camera keeps the hand and manipulated object in frame from the viewpoint a manipulation policy will actually see from, through the whole reach-grasp-release cycle. An optional wrist camera adds close-range detail for fine manipulation.
3D hand pose is tracked with visibility flags, and contact events mark exactly when and where the hand makes and breaks contact, all aligned to depth and video on one clock.
The spec
You describe the manipulation tasks your policy needs. We turn it into a written spec covering tasks, environments, objects, capture tier, annotation depth, and accept criteria, then quote reach, timeline, and price against that document before any capture begins.
The collection runs through the same seven-stage end-to-end custom collection pipeline as every Firsthand program: contributor recruiting, capture, per-batch QA, anonymization, and licensed delivery. Rejected items are recaptured at our cost.
Fast · on demand
Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that timeline up front.
On-demand top-ups run against the same spec and accept criteria after each training run, so new dexterous manipulation data stays consistent with what you already hold.
Rights
Every custom collection ships under a perpetual, buyer-owned commercial license, and exclusivity is available so the data is never resold. Each episode links to a signed contributor release through a documented consent chain.
Faces, plates, and screens are detected and irreversibly blurred at ingest, and a reviewer confirms the result before anything ships. The anonymization record is delivered with the data.
Dexterous manipulation need vs delivery
| Dexterous manipulation need | What Firsthand captures |
|---|---|
| Hand and object in frame | Head-mounted camera keeping the hand and object visible through the full task cycle |
| Finger-level pose | 3D hand pose tracked through the sequence, with visibility flags for occlusion |
| Contact detail | Contact events aligned to the same clock as video and depth |
| Fine manipulation detail | Optional wrist camera for close-range detail on the hand |
| Depth | Synchronized depth stream for scene and contact geometry |
| Action structure | Instance segmentation, action segments, grasp and contact events |
| Quality | Measured against signed accept criteria; billed per validated hour; reject log with every batch |
| Formats | RLDS, LeRobot, WebDataset, plus HDF5, zarr, and Rerun .rrd |
Every collection runs through the same seven-stage end-to-end custom collection pipeline.
FAQ
Sources
Tell us the dexterous manipulation tasks your policy needs to perform. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.