Now recruiting capture teams worldwide. Get paid to record first-person video of real work.

Apply to capture

Task rows

Stereo Baking and Dough Handling Data

Working dough and batter means kneading, rolling flat, measuring and mixing, with both hands and a material that keeps changing shape close to the lens. This page covers the stereo and container side of baking robot training data for the two catalog rows that name this work: what a calibrated stereo pair adds to stereo dough kneading and rolling video, what MCAP is according to its own documentation, and what the site does not state. We run custom kitchen data collection fast and on demand against a spec you write, as a handheld gripper batter mixing dataset when the spec names it, delivered as MCAP, as custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.
Catalog rows
"Knead + roll dough" and "Measure + mix"; Medium; Available on request
Environment
Working Kitchen Set (food prep)
Container
MCAP (.mcap), open source
License
Perpetual, buyer-owned
A lived-in kitchen with dishes drying by the sink, utensils on the counter and a small bin on the floor at the right edge of the frame.
A kitchen setting. The catalog describes its working kitchen set with a stovetop, counter, sink, dishwasher, utensils and food props. The image is a setting illustration, not a delivered clip of this task.

Why stereo and MCAP here

What do a stereo pair and an MCAP file add to dough and batter video?

01

Depth under the hands and around the dough

The site states that a stereo pair at human-eye spacing makes depth recoverable from every frame pair, so the hands, the dough and the work surface sit in one frame. The site gives no depth accuracy figure for these rows and does not say how depth behaves on dough.

02

Fingers inside the work, flagged not guessed

The site states that fingers disappear behind objects and that the hands occlude the work. 3D hand pose carries a per-joint visibility flag, so a finger pressed into or under the dough is marked as hidden rather than silently filled in.

03

Two named rows, worded as the catalog words them

"Knead + roll dough" reads "Knead dough and roll it flat." and "Measure + mix" reads "Measure ingredients and mix a batter." A spec names those rows and says where a run starts and ends, rather than relying on a generic baking label.

04

Several streams in one container

MCAP stores multiple channels of timestamped, pre-serialized data, so a stereo pair, hand pose and IMU can share one file on one log-time axis. Which streams go in the file is set in the skill spec.

Definition

What is stereo baking and dough handling data?

It is first-person video of a person working dough and batter, recorded with two calibrated cameras, with hand pose and sensor streams alongside. People reach it through several phrasings: baking robot training data, stereo dough kneading and rolling video, a handheld gripper batter mixing dataset, or custom kitchen data collection at scale. They describe one request from different angles. Stereo describes the capture, and MCAP describes the container. They are separate choices.

The site does not state that stereo is already running on these rows. The catalog lists a multiview rig with handheld grippers as the capture setup, so a stereo pair is a capture choice agreed in the skill spec through the site’s general stereo offer and confirmed on a Spec Pilot. The data is human capture by paid, consented contributors, not robot or teleoperation data, so using it for a specific robot still needs your own retargeting step. Firsthand is not affiliated with Foxglove or the MCAP maintainers.

Catalog rows

Which catalog rows does this page rely on, and what is their status?

Two. "Knead + roll dough" and "Measure + mix" both sit in the Working Kitchen Set (food prep) environment of the Food & Beverage sector, which the catalog describes as a stovetop, counter, sink, dishwasher, utensils and food props. The first reads "Knead dough and roll it flat." The second reads "Measure ingredients and mix a batter." Each is rated Medium, lists the capture setup "Multiview rig + handheld grippers", and has the status Available on request.

Available on request means the work is scoped and recruited to spec when a buyer asks. It is not a statement that footage of these tasks has been delivered, and the site states no delivered hours or stereo clips for them, so this page claims none. The first table below reproduces both rows exactly as the catalog states them. The site names no dough type, recipe, tool, bowl, oven or quantity for either row, so none is stated here.

The setting

What is the Working Kitchen Set environment?

The catalog describes it as a staged kitchen with the items above and lists several tasks in it. Three more sit beside the dough rows: "Crack + whisk eggs" reads "Crack eggs and whisk, then pour to pan." "Slice + spread" reads "Slice bread and spread a condiment." "Stir + flip on stovetop" reads "Stir a pan and flip contents." All are rated Medium, listed with Multiview rig + handheld grippers and Available on request.

The site describes this capture mode as a staged working set recorded by a multiview rig while the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector. The site states that Firsthand does not capture at a customer’s own facility, so the kitchen set is a capture setting arranged for the task, not your kitchen and not a bakery. Whether a stereo pair would be worn, mounted or combined with the multiview rig the catalog names is not stated, and is settled in the spec.

Nearby rows

Which other catalog rows touch baking, and how are they different?

None name baking. The catalog lists "artisan bakery, patisserie" only as an example in the Restaurant & Commercial Kitchen environment, and a pizza counter in a fast food environment, but the rows under them cover other work, so this page does not describe those as dough tasks. The neighbouring kitchen rows above are separate requests, and so is "Pour-over coffee", the drink row.

They are context only, not steps of the dough rows. If your policy needs whisking, spreading, stovetop work or a pour, those are spec questions for those rows, and the stereo beverage and coffee prep page covers the pour-over row. The catalog does not list oven work, proofing, portioning dough, shaping loaves or pastries, loading trays or decorating as tasks, so this page does not describe them as available.

Difference

How is this different from the egocentric baking, beverage and food prep pages?

This page is the stereo and MCAP treatment of two kitchen-set rows, Knead + roll dough and Measure + mix. The egocentric baking and dough handling page is the first-person page for the same two rows: stereo and MCAP are not its subject. It is a sibling, not an equivalent, and both pages cover the same catalog wording.

The stereo cutting and food prep page covers a different task, working a knife and a board. The stereo beverage and coffee prep page covers a different row, a pour-over coffee. The second table below sets the pages side by side.

Capture setup

What capture setup do the rows list, and where does stereo come in?

The catalog lists "Multiview rig + handheld grippers" for both rows. The site does not state a stereo pair for them, and it does not describe these tasks as stereo capture. Stereo applies through the site’s general stereo offer: a stereo pair is a capture choice agreed in the skill spec and confirmed on a Spec Pilot. The site does not state a camera count for the rows.

The site describes two stereo setups and does not say which one an order for these rows uses. The hard-environments stack is a global-shutter 4K/60 head camera with a 120° lens, two 1080p/60 wrist cameras, a depth sensor at 848×480 and 30 fps, and 200 Hz 6-DoF IMUs. The off-the-shelf stereo head rig, dataset 06, is dual fisheye cameras at 1080p per eye, a 62 mm baseline, per-unit calibration, a 9-axis IMU and hand-tracking output. Whether either is used with the catalog’s multiview rig is not stated.

Handheld grippers

Why does a handheld gripper capture matter for batter mixing?

The catalog lists handheld grippers because the operator holds a gripper rather than a bare hand while performing the task, and the site says this lets demonstrations map onto a robot end effector. For mixing, how the bowl and the stirring item are held is what a policy has to reproduce. A handheld gripper batter mixing dataset keeps the demonstration closer to the hardware a robot would use than a bare-hand clip does.

The site does not state which gripper is used, how it attaches or how it holds a bowl or a utensil, and this page names none. It also does not claim that a model trained on this capture succeeds at the task. The embodiment mapping is a design choice agreed in the skill spec, and the site does not claim that human capture replaces robot data.

Why stereo

Why capture dough handling in stereo?

Dough is a material whose shape changes under the hands, and the work is about how two hands act on it against a surface: where it sits, how it is pressed and folded, and how long a step lasts. A stereo pair recovers depth from the calibrated frame pair rather than from a standalone depth sensor, so the geometry sits in the same capture that shows the hands working. The site gives no depth accuracy figure for these rows, so what a buyer does with that depth is their pipeline’s question.

A stereo pair adds depth, not a verdict. The site lists no label for dough type, dough state or consistency, no proofing label and no outcome label for these rows, and none is claimed. The egocentric baking page already supplies the first-person framing; stereo is the addition for a buyer who wants the depth and the MCAP file.

Steps

Which steps of dough and batter work can a stereo spec label?

The rows name four actions: knead, roll flat, measure and mix. A spec that says "bake" gives one long action segment. A spec that names the steps gives a sequence you can slice by step. The site’s skill-spec guide says to name the verb and the noun rather than a broad activity, so the rows’ own verbs are the place to start.

Whether the steps are separate segments, or a whole run is one segment, is a spec decision, not a default. The site does not set an episode length, so the spec says whether one episode is one step, one batch of dough or a run of several. Contact events can mark when a hand meets an item, where the spec asks for them, and the spec decides what counts as the item and where each step starts and ends. The site lists no shaping task beyond rolling dough flat.

Soft material

What do dough and occlusion do to visibility and depth?

Both hands are busy in these rows, and the dough can close over a finger. The site states that the hands occlude the work and that fingers disappear behind objects. That is why each hand joint carries a visibility flag, why contact events mark when the hand meets the item, and why instance masks are recorded per frame. The site’s kitchen dataset page lists "Bimanual dough handling" as a skill, described as deformable-object manipulation and two-handed coordination, and the cooking page says dough changes shape as it is handled and does not track well with masks propagated frame to frame, so per-frame masks are shipped.

The site also states that depth degrades on wet and reflective surfaces and that glare-heavy, low-texture scenes make single-frame depth worse, with per-frame confidence maps masking low-confidence regions. Batter is the kind of surface where this may matter, but the site does not say how depth behaves on dough or batter for these rows. If your policy depends on those frames, say so in the spec and settle it on a Spec Pilot.

Safety and privacy

What does the site say about safety, compliance and privacy?

This page describes the hand work named in the catalog rows, and nothing beyond it. It gives no food-safety or kitchen-safety guidance and makes no certification claim. A contributor handling protocol is not stated on this site, so this page does not describe one. The data carries no force, tactile or weight reading, and it is not robot or teleoperation data.

For every delivered episode the site states that faces and screens are blurred irreversibly, that a reviewer confirms no un-consented person is identifiable, and that footage that cannot be de-identified is discarded. The anonymization record ships with the data, an undocumented bystander is a stated reject criterion, and every episode links to a signed contributor release. Whether printed text on a package in view is blurred is not stated, so it is agreed in the spec. This is not legal advice, and the executed agreement controls.

MCAP

What is MCAP, per its own documentation?

MCAP is an open source container file format for multimodal log data, supporting multiple channels of timestamped pre-serialized data. It is serialization-agnostic, so messages can be Protobuf, DDS (CDR), ROS, JSON and more. Its design is row-oriented and append-only, it stores schemas alongside the data, and it offers an optional index plus optional LZ4 or Zstandard chunk compression.

Reader and writer libraries exist for C++, Go, Python, Rust, Swift and TypeScript, and the mcap CLI can inspect, merge and split files. The foxglove/mcap repository is MIT-licensed; that is the MCAP project licence, not the licence of a Firsthand delivery. The MCAP hub page and the glossary entry cover the format in full.

Streams

Which streams can ship in an MCAP delivery of dough and batter data?

Firsthand offers MCAP delivery, and dataset 06 is stated as shipping as MCAP. For these rows the site states hand pose, a stereo-derived depth stream with confidence maps, IMU, contact events, action segments, per-frame instance masks and one task instruction per episode elsewhere. What it does not state is which of those are channels in an MCAP file, how they are named, what encoding they use or at what rate.

No topic name, message schema or rate is stated on this page, and none should be assumed. Name the streams that matter in the skill spec and confirm them on a Spec Pilot batch. The fourth table below sets each stream beside what the site states about it.

Failure modes

What goes wrong when you record dough work in stereo, and what does QA reject?

Hand occlusion by the dough or a held item is the first risk, under the visibility flag above. Weak depth on wet, glare-heavy or reflective surfaces is the second. Calibration is measured at the start and end of every session under a 0.28 px RMS gate, and an episode is rejected for a sync breach beyond the ceiling for more than three consecutive frames, for the manipulated object out of frame for more than 15 percent of the episode, for an undocumented bystander or for a mismatch against the named skill spec.

A reject log ships with every batch, and rejected items are recaptured at the provider’s cost. For these rows, the spec decides what the manipulated object is: the dough, the bowl, or the batter in it.

Scale and speed

How fast can custom stereo baking data be collected at scale?

The rows are Available on request, so this is custom collection, not an off-the-shelf purchase. The off-the-shelf stereo and hand-tracking video can still show the format before you write a spec.

It is custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs. Where coverage is deep, the median time from signed spec to first validated batch is 48 hours; where it is thin, turnaround runs three to four weeks. The site does not say which applies to the working kitchen set, so the timeline is quoted against your spec. Collections are billed per validated hour, and rejected episodes and recaptures are never billed.

Delivery and license

Which formats and license come with a stereo baking order?

Delivery is MCAP, alone or beside the formats your stack already reads: RLDS, LeRobot, WebDataset, HDF5 or zarr, or raw streams with metadata. Readable converter source ships alongside the data so the schema can be retargeted to your own loader.

The license is perpetual, irrevocable and worldwide, with the data buyer-owned and non-exclusive by default. Training, evaluating, fine-tuning and deploying models, including commercial ones, is permitted, and exclusivity is available as a separate term. The executed agreement controls. The site does not publish a price list, a minimum order or a batch size for these tasks, so those are set in your quote.

Ordering

How do you order a stereo baking and dough handling dataset?

Describe the steps and where each starts and ends: knead, roll flat, measure and mix. Say whether an episode covers one step, one batch or a run of several, what counts as the object and what counts as a finished step, the privacy rule for the space, and name the variation your pipeline is missing. Then name the streams you want in the file, the topic naming and message encoding your reader expects, whether calibration ships inside the file or beside it, and whether MCAP is the only delivery or sits beside a training format.

Most programs begin with a Spec Pilot, a small first batch that proves the spec and accept criteria on real footage before you scale. The last table below shows what each spec element decides.

At a glance

What you get.

Catalog row: Knead + roll dough
"Knead + roll dough" (Working Kitchen Set, food prep); Medium; Available on request
Catalog description
"Knead dough and roll it flat."
Catalog row: Measure + mix
"Measure + mix" (Working Kitchen Set, food prep); Medium; Available on request
Catalog description
"Measure ingredients and mix a batter."
Catalog capture setup
Multiview rig + handheld grippers on both rows. The site states no stereo pair for these rows, so a stereo pair is agreed in the skill spec through the general stereo offer
Stereo head rig (06)
Dual fisheye, 1080p per eye, 62 mm baseline, per-unit calibration, 9-axis IMU, hand-tracking output; shipped as MCAP
Hand pose
21 joints per hand with a per-joint visibility flag
Sync
Hardware-triggered onto one clock; 2.0 ms cross-stream ceiling
Language data
One task instruction per episode
Dough type, recipe, equipment, quantities, times, temperatures
Not stated; agreed in the skill spec
Food safety
Not stated; nothing here is safety guidance
MCAP topics, schemas, rates
Not stated on the site; agreed in the skill spec
License
Perpetual, irrevocable, buyer-owned, non-exclusive by default

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

Catalog rows

Which catalog rows cover dough and batter work, and what is their status?

The two rows exactly as the task catalog states them, followed by three neighbouring kitchen rows shown for context only. Items the catalog does not list are marked Not stated. Source file: lib/commercial-catalog-data.ts.
Task (as listed)Description (as listed)EnvironmentSkillCapture setupStatus
Knead + roll doughKnead dough and roll it flat.Working Kitchen Set (food prep)MediumMultiview rig + handheld grippersAvailable on request
Measure + mixMeasure ingredients and mix a batter.Working Kitchen Set (food prep)MediumMultiview rig + handheld grippersAvailable on request
Crack + whisk eggs (context only)Crack eggs and whisk, then pour to pan.Working Kitchen Set (food prep)MediumMultiview rig + handheld grippersAvailable on request
Slice + spread (context only)Slice bread and spread a condiment.Working Kitchen Set (food prep)MediumMultiview rig + handheld grippersAvailable on request
Stir + flip on stovetop (context only)Stir a pan and flip contents.Working Kitchen Set (food prep)MediumMultiview rig + handheld grippersAvailable on request
Dough type, recipe, equipment, quantities, outcome labelsNoneNot stated as rowsNot statedNot statedNot stated

Compared pages

How does this page differ from the egocentric baking, food prep and beverage pages?

Each page and what it covers. Statuses are as the site lists them; none of these pages is claimed to hold delivered hours here.
PageCaptureWhat it coversRelation to this page
This page: stereo baking and dough handling dataStereo, agreed in the specKnead + roll dough; Measure + mix (Medium, Available on request)Stereo pair and MCAP delivery for two kitchen-set rows
Egocentric baking and dough handling video dataEgocentric, not stereoThe same two rows, first-personThe first-person sibling; stereo and MCAP are not its subject
Stereo cutting and food prep dataStereo, agreed in the specCutting and food prepDifferent task; knife and board work rather than dough
Stereo beverage and coffee prep dataStereo, agreed in the specPour-over coffeeDifferent row in the same environment
Egocentric egg cracking and whisking dataEgocentric, not stereoCrack + whisk eggsNeighbouring row in the same environment
Egocentric stovetop stirring and flipping dataEgocentric, not stereoStir + flip on stovetopNeighbouring row in the same environment
Egocentric stereo data in MCAPStereo, hubThe stereo and MCAP hub across tasksGeneral stereo and MCAP treatment; not specific to baking

Stated vs not stated

What the site states about stereo capture for dough and batter work

Left to right: the item, what the site states, and what that means for a dough order. “Not stated” means the site does not say.
ItemWhat the site statesFor a dough or batter order
Catalog capture setupMultiview rig + handheld grippers on both rowsNo stereo pair is stated for these rows; a stereo pair is a spec choice through the general stereo offer
Stereo head rig (dataset 06)Dual fisheye, 1080p per eye, 62 mm baseline, per-unit calibration, 9-axis IMU, hand-tracking output; shipped as MCAPWhether an order uses it: Not stated
Hard-environments stack4K/60 head camera, 120° lens; two 1080p/60 wrist cameras; depth 848×480 at 30 fps; 200 Hz 6-DoF IMUWhether an order uses it: Not stated
Hands, contacts and masksPer-joint visibility flag on hand pose; contact events; per-frame instance masks stored at 848×480Stated; what counts as the object is set in the spec
Dough and shape changeDough changes shape as it is handled and does not track well with propagated masks, so masks ship per frameStated; how often it occurs on these rows is Not stated
Hand occlusionThe hands occlude the work and fingers disappear behind objects; visibility flags and instance masks address itStated; how often it occurs on these rows is Not stated
Depth on wet and reflective surfacesDepth degrades on wet and reflective surfaces; confidence maps mask low-confidence regionsStated; behaviour on dough or batter is Not stated
CalibrationMeasured every session and shipped with the episode; 0.28 px RMS reprojection gateStated
SynchronizationHardware-triggered onto one clock; 2.0 ms cross-stream ceilingStated
Row statusMedium, Available on requestNo volume, hours or delivered stereo footage is claimed on this page
Dough type, recipe, equipment, quantities, timesNot statedNot claimed; set in the spec
Dough state, consistency or outcome labelNot stated; no such label is listed for the rowsNot claimed; set in the spec
Food safety, certificationNot statedNot claimed on this page
Task duration, success rateNot statedNot claimed on this page
MCAP topics, schemas, ratesNot statedAgreed in the skill spec

Stream map

Streams for dough and batter work and what the site states about an MCAP file

Left to right: the stream or item, what the site states about it, and what the site states about it in MCAP. “Not stated” means the site does not say.
Stream or itemWhat the site statesIn an MCAP delivery, as the site states it
Stereo pairDual fisheye, 1080p per eye, 62 mm baseline (dataset 06)Dataset 06 is stated as shipped as MCAP; channel layout not stated
Depth with confidence mapsRecovered from the calibrated stereo pair; confidence map masks low-confidence regionsNot stated
Hand pose21 joints per hand with a per-joint visibility flagChannel layout and joint order not stated
IMU9-axis (dataset 06); 6-DoF at 200 Hz (hard-environments stack)Channel layout and rate not stated
Contact events, action segments, instance masksListed in the site episode schema; masks stored at 848×480Not stated
Task instructionOne per episodeNot stated
CalibrationMeasured every session and shipped with the episodePlacement in the file not stated
Topic names, schemas, encoding, ratesNot statedAgreed in the skill spec

Skill spec

What the skill spec fixes for a stereo dough and batter order

Spec element and where a buyer can see it in the delivery. “Set per program” means the site states no fixed value.
Spec elementWhat it decidesWhere it shows up
RowsKnead + roll dough and Measure + mix, worded as the catalog words themSet per program; Available on request as listed
Steps and orderWhat one step is: knead, roll flat, measure, mixEpisode boundaries and action segments; set per program
Episode scopeOne step, one batch or a run of severalSet per program; the site does not state an episode length
Object definitionWhich item in frame counts as the object: the dough, the bowl or the batterContact events and the out-of-frame reject rule; set per program
Rig and streamsStereo pair, multiview angles, wrist views, hand pose, IMU and any othersThe channels you can read; confirm on the Spec Pilot
Setting and lightingWhere capture runs and how the set is litSet per program; the site states no lighting setup for these rows
MCAP topics and encodingWhat your reader expectsSet per program
Delivery formatHow the data is packagedMCAP alone, or beside RLDS, LeRobot, WebDataset, HDF5 or zarr
Accept criteriaWhat passes QA, including what counts as a rejectReject log per batch
PrivacyHow people, screens and printed text in frame are handledFaces and screens blurred at ingest; other items agreed in the spec
LicenseWho owns the datasetPerpetual, irrevocable, buyer-owned, non-exclusive by default

Example footage

What do egocentric baking and stereo capture look like on this site?

Two real clips already published on this site, shown as format and rig examples. The first is a ten-second egocentric home-baking recording; it is not stereo, not the Working Kitchen Set and not an example of the multiview rig with handheld grippers these rows list. The second is a head-mounted stereo capture with hands in frame; it does not show dough or a kitchen set.

egocentric_baking_10s_usa.mp4 · egocentric, not stereo · home baking, not the Working Kitchen Set · faces blurred · format example, not a clip of these rows
egocentric_stereo_sample.mp4 · head-mounted stereo · hands in frame · 1920 × 1080 web preview · rig example, not a dough clip

No stereo dough clip is published on the site, so these are labelled as format and rig examples. Request a sample to see delivered files. See sample data outputs, stereo sample page, request an egocentric data sample.

FAQ

Baking robot training data, answered.

What is stereo baking and dough handling data?
First-person video from two calibrated cameras of a person kneading dough, rolling it flat, measuring ingredients and mixing a batter, with depth and hand pose alongside.
Which catalog rows cover it, and what is their status?
"Knead + roll dough" ("Knead dough and roll it flat.") and "Measure + mix" ("Measure ingredients and mix a batter.") in Working Kitchen Set (food prep). Both are rated Medium, listed with Multiview rig + handheld grippers, and Available on request. This page claims no delivered hours.
Is stereo already captured on these rows?
Not stated. The catalog lists a multiview rig with handheld grippers for both rows. A stereo pair is agreed in the skill spec through the general stereo offer and confirmed on a Spec Pilot.
How is this different from the egocentric baking page?
The egocentric page covers the same two rows as first-person video. This page covers them with a stereo pair and MCAP delivery. The stereo cutting and food prep and stereo beverage pages cover different tasks.
Is there an off-the-shelf baking or dough dataset?
No. The rows are Available on request, so this is custom collection, at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.
Does the data include dough type, recipe or outcome labels?
Not stated. The site lists no dough type, recipe, equipment, quantity, time or temperature, no dough-state or outcome label and no force reading, so none is claimed. These are set in the spec.
How fast can a custom stereo baking dataset be collected?
From signed spec to first validated batch, a median of 48 hours where coverage is deep and three to four weeks where it is thin. The site does not say which applies to the working kitchen set, so it is quoted against your spec.
Can it be delivered as MCAP, and what is in the file?
Yes. Firsthand offers MCAP delivery. Topic names, message schemas and rates are not stated on the site and are agreed in the skill spec.

Sources

Where is MCAP documented?

Request a custom stereo baking and dough handling dataset delivered as MCAP.

Tell us the steps and where each starts and ends, whether an episode covers one step, one batch or a run of several, what counts as the object, the setting and lighting, the privacy rule for the space, the streams you want in the file and whether MCAP sits alone or beside a training format. We will quote reach, timeline and price against a written spec.