Hard environments

Egocentric stereo capture in hard environments.

Reflective metal, small parts, clutter and awkward lighting are where a single camera loses depth and a policy loses the plot. We collect custom egocentric stereo capture on demand for plant-floor work, with a calibrated head-mounted stereo pair, hardware-synchronized streams and a buyer-owned license, quoted against your written spec.
Capture
Head-mounted stereo, calibrated per session
Sync
Hardware-triggered, one PTP clock domain
Environments
Eight plant types, scoped per order
License
Perpetual, buyer-owned

Why stereo

What does stereo add when the environment is hard?

01

Depth that is aligned with the RGB view

Stereo gives dense depth aligned pixel for pixel with the RGB view, so the geometry of a part, a fixture or a door frame is recoverable from the same frame pair that shows it.

02

A human-baseline viewpoint

A lens spacing close to human interpupillary distance matches the viewpoint head-mounted and humanoid robot cameras actually see from.

03

Calibration shipped with every episode

Intrinsics, extrinsics and the stereo baseline are measured every session and shipped with the episode, so rectification is exact rather than assumed.

04

One clock across every stream

Stereo, depth, IMU and wrist views are hardware-triggered onto one PTP clock domain, so there is no drift to correct between sensors.

Definition

What counts as a hard environment for egocentric capture?

A hard environment is a workplace where ordinary first-person video loses information a robot needs. Think glossy or dark surfaces, plain panels with little texture, mixed light, tight clutter, and small parts held close to the lens. Plant floors that build appliances, hardware, electronics, lighting and furniture are full of all four.

These are the working conditions robot manipulation has to survive, and they are exactly where a lab most often lacks data. The environments below are examples of where we scope custom stereo collection. Which of them is recorded for your order is agreed in the spec.

Environments

Which hard environments can egocentric stereo capture cover?

We scope eight plant types as example targets: air conditioner plants, gas appliance plants, refrigerator and cold appliance plants, water meter plants, door and window hardware plants, electronics assembly plants, lighting products plants and furniture plants. Each has its own detail page, linked below, with the work typical of that setting.

Whether recording for a particular plant type is already running is Not stated on this page. We confirm access, consent and timeline before we quote, and we say so plainly if a plant type needs a new venue.

Capture

What does the stereo capture stack contain?

The head-mounted camera is a global-shutter 4K/60 unit with a 120° lens. Two wrist-mounted 1080p/60 cameras sit alongside a depth sensor at 848×480 and 30 fps and 200 Hz 6-DoF IMUs. All streams are hardware-triggered onto a single PTP clock domain, and intrinsics and extrinsics are re-solved with a checkerboard target at the start and end of every session so drift is detectable rather than assumed.

Stereo pairs are delivered raw with calibration, or rectified with disparity if you want it added. Hand pose is 3D, in metres in the head-camera frame.

Why it is hard

Why do hard environments break single-camera data?

Depth from a single frame is a guess, and a wrong guess about where a part sits costs a failed insertion. In a glare-heavy or low-texture scene the guess gets worse. A calibrated stereo pair removes the guess by measuring disparity between two views taken at a fixed, known baseline.

Stereo also keeps working outdoors where active depth sensors struggle, and many programs capture both and sync them on one clock. The head camera still loses sight of a grasp when the hand blocks it, which is why wrist views and hand pose travel with the stereo pair.

Labels and delivery

How is hard-environment stereo data labeled and delivered?

Labels follow the stereo geometry: 3D hand joints, object poses and contact events are annotated against it rather than guessed from one frame. Episodes ship as RLDS, LeRobot, WebDataset, HDF5 or zarr, with per-stream nanosecond timestamps in the PTP domain so sync can be verified independently.

Which labels a given plant program carries is Not stated here. It is set in the skill spec and quoted before capture begins.

Speed

How fast can a custom stereo dataset be collected?

Where our coverage is already deep, a first validated batch lands in a median of 48 hours from a signed spec. Where coverage is thin, plan on three to four weeks. Which applies to a given plant type is quoted against the spec, since the site does not state that coverage for these environments.

Collections are billed per validated hour, and a visible reject log shows what did not make the cut and why. Rejected items are recaptured rather than shipped with a caveat.

Getting started

How do you start a hard-environment stereo pilot?

Describe the plant type, the tasks and their order, how each step starts and ends, and the failure cases your model is missing. That becomes a written skill spec, quoted for reach, timeline and price before any capture. Most programs begin with a Spec Pilot, a small, fast first batch that proves the spec and accept criteria on real footage before volume scales.

Then request a custom dataset and a rep will scope it with you.

Capture setup

What is the stereo capture setup for hard environments?

The capture setup as stated on this site. Items marked Not stated are not promised on this page and are agreed in the skill spec.
PartAs stated on this site
Head cameraGlobal-shutter 4K/60, 120° lens
StereoLeft and right views at a human interpupillary baseline, calibrated per session
Wrist camerasTwo, 1080p/60
Depth848×480 at 30 fps
IMU200 Hz, 6-DoF
SyncHardware-triggered onto one PTP clock domain
CalibrationIntrinsics and extrinsics re-solved with a checkerboard target at the start and end of every session
Stereo resolution per cameraNot stated
Force or tactile readingsNot in standard capture; whether a glove tier applies to a plant program is Not stated

Every collection runs through the same seven-stage end-to-end custom collection pipeline.

Example environments

Which plant environments do the detail pages cover?

Eight example plant environments with the work typical of each setting. The task list for an order comes from the skill spec.
EnvironmentTypical work (examples)Detail page
Air conditioner plantFitting coils, covers and tubing; wiring; final checksAppliance and metering plants
Gas appliance plantAssembling burners and valves; fitting connections; inspectionAppliance and metering plants
Refrigerator and cold appliance plantFitting doors, shelves and gaskets; panel and wiring workAppliance and metering plants
Water meter plantAssembling small meter bodies and registers; fitting sealsAppliance and metering plants
Door and window hardware plantFitting hinges, handles and locks; fastening and clippingHardware and light-assembly plants
Electronics assembly plantSeating connectors; routing cable; fastening housingsHardware and light-assembly plants
Lighting products plantAssembling housings; wiring drivers; fitting lensesHardware and light-assembly plants
Furniture plantFitting panels; drilling and fastening; finishingHardware and light-assembly plants

Delivered vs not stated

What is delivered, and what is Not stated?

What the site states for stereo capture versus what is agreed per order.
ItemStatusDetail
Calibration with each episodeStatedIntrinsics, extrinsics and baseline shipped with the episode
Delivery formatsStatedRLDS, LeRobot, WebDataset, HDF5 or zarr
LicenseStatedPerpetual, buyer-owned
Pricing basisStatedPer validated hour
Which plant types are recording nowNot statedConfirmed before a quote
Labels carried by a plant programNot statedSet in the skill spec
Venue types, regions and site countsNot statedAgreed in the spec
Cycle times, tolerances and standardsNot statedNot promised on this page

FAQ

Egocentric stereo capture in hard environments, answered.

What is egocentric stereo capture in hard environments?
It is first-person video from a calibrated head-mounted stereo pair, recorded in demanding workplaces such as appliance, hardware, electronics, lighting and furniture plants, so depth is recoverable from every frame pair.
Why use stereo instead of a single camera?
Stereo gives dense depth aligned pixel for pixel with the RGB view, and it keeps working outdoors where active depth sensors struggle. Many programs capture both and sync them on one clock.
Which environments do you cover?
We scope eight plant types as examples: air conditioner, gas appliance, refrigerator and cold appliance, water meter, door and window hardware, electronics assembly, lighting products and furniture. Access for each is confirmed before a quote.
Do you deliver rectified or raw stereo?
Both, if you want. Raw frames ship with calibration so you can re-rectify, and rectified pairs plus disparity can be added to the delivery.
Can stereo be combined with wrist cameras and IMU?
Yes. Head-mounted stereo, two wrist views, depth and IMU all trigger on one clock in one episode.
How fast can I get data?
Where coverage is deep, a first validated batch lands in a median of 48 hours from a signed spec. Where it is thin, plan on three to four weeks. Which applies to your plant type is quoted against the spec.
Who owns the data?
You do. Licenses are perpetual and buyer-owned.

Scope a stereo capture for your plant environment.

Tell us the environment, the tasks and the failure cases. We quote reach, timeline and price against a written spec before capture begins.