Now recruiting capture teams worldwide. Get paid to record first-person video of real work.

Apply to capture

Task row

Egocentric Egg Cracking and Whisking Data

Cracking eggs, whisking them and pouring to a pan is a short, ordered, two-handed job at a kitchen counter, and both hands, the eggs, the bowl and the pan all have to stay in view. This page covers egocentric egg cracking data for the one catalog row that names this work: what the row says, how it is captured, what the site states about labels and delivery, and what it does not state. We run custom cooking data collection fast and on demand against a spec you write, as first-person whisking video and a handheld gripper kitchen dataset, as custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.
Catalog row
Crack + whisk eggs: Medium, Available on request
Environment
Working Kitchen Set (food prep)
Capture mode
Multiview rig + handheld grippers, as the catalog lists it
License
Perpetual, buyer-owned
A real lived-in domestic kitchen with everyday clutter on the countertops, seen from the first-person viewpoint of someone preparing food.
A kitchen counter setting seen from the first-person viewpoint. The catalog describes its working kitchen set with a stovetop, counter, sink, dishwasher, utensils and food props. The image is a setting illustration, not a delivered clip of this task.

Requirements

What does an egg-and-whisk capture need that a general kitchen clip does not?

01

One named catalog row

The task is the catalog row "Crack + whisk eggs", described as "Crack eggs and whisk, then pour to pan." A spec names that row rather than relying on a generic cooking label.

02

Both hands and the food in view together

Cracking and whisking is two-handed work close to the bowl. Hand pose carries a per-joint visibility flag, so a finger hidden behind an object is flagged rather than guessed.

03

A spec that splits the steps

The row words three actions in one description: crack, whisk and pour to pan. The spec names which steps you need and where each starts and ends, so each becomes its own labeled segment.

04

Limits stated plainly

No recipe, egg count, bowl, whisk or pan type, task time or quality claim is made, because the site states none for this row.

Definition

What is egocentric egg cracking and whisking data?

Egocentric egg cracking and whisking data is first-person video of a person cracking eggs, whisking them and pouring to a pan, recorded from their own point of view with synchronized sensor streams alongside. The task wording comes from one catalog row, "Crack + whisk eggs", which the catalog describes as "Crack eggs and whisk, then pour to pan." This page repeats that description as written and adds nothing to it. The data is human capture: a paid, consented contributor performs the task to a written skill spec. It is not robot or teleoperation data, and it is not a fixed corpus you download.

People reach this topic through several phrasings: egocentric egg cracking data, first-person whisking video, a handheld gripper kitchen dataset, or custom cooking data collection. They describe one request from different angles. Under each of them the work is the same: write down the task, collect it on demand, and receive validated episodes with the labels a training pipeline expects. Nothing on this page states that the video carries an egg-state label, a whisk-progress label or a liquid-level reading.

The task row

Which catalog row covers cracking and whisking eggs?

One row names the task. In the task catalog, the Working Kitchen Set (food prep) environment, in the Food & Beverage sector, lists "Crack + whisk eggs" with the description "Crack eggs and whisk, then pour to pan." It is rated Medium, its capture mode is Multiview rig + handheld grippers, and its status is Available on request, meaning the work is scoped and recruited to spec when a buyer asks.

The catalog gives one line for the row. The steps inside that line, how many eggs an attempt uses and where an attempt starts and ends are set by your spec. The first table below gives the row exactly as the catalog states it. This page claims no delivered hours for it.

The setting

What is the Working Kitchen Set environment?

The catalog describes the environment with these examples: stovetop, counter, sink, dishwasher, utensils and food props. Fourteen rows sit in it, and every one lists the same capture mode, a multiview rig with handheld grippers, and the same status, Available on request. Ten are rated Medium and four are rated Easy.

The site describes this capture mode as a staged working set recorded by a multiview rig while the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector. The site states that Firsthand does not capture at a customer’s own facility, so the kitchen is a capture setting arranged for the task, not your kitchen.

Nearby rows

Which other catalog rows sit next to egg cracking and whisking?

Four neighbouring rows in the same environment share parts of the job. "Stir + flip on stovetop" reads "Stir a pan and flip contents." "Measure + mix" reads "Measure ingredients and mix a batter." "Knead + roll dough" reads "Knead dough and roll it flat." "Assemble a salad" reads "Tear greens, add toppings, dress, and toss a salad." All four are rated Medium, listed with Multiview rig + handheld grippers and Available on request.

These are separate rows, not steps of the egg row. They are context only, and each is its own request. If your policy needs the stovetop step that follows the pour, that is a spec question for the neighbouring row.

Related pages

How does this page differ from the cooking, egg collection and baking pages?

The cooking page is organized around a domain: first-person food-prep and cooking capture in real kitchens, with the kitchen task categories the site documents. The egg collection and candling page is a farm task: collecting eggs from the nests, checking them against a light and packing them, in Farm & Field Operations. The baking page covers two dough and batter rows. This page keeps a single row, Crack + whisk eggs, and looks at what a capture of it needs. The comparison table below sets them side by side.

For cooking as a whole, start from the cooking page. For eggs on a farm, start from the egg collection page. For dough and batter, start from the baking page. For cracking and whisking at a kitchen counter, start here.

Why it is hard

Why is cracking and whisking hard to capture for robot learning?

The row bundles three actions in one description: crack, whisk and pour to pan. A spec has to say which of those steps it needs, in what order, and where each one starts and ends, so each can become its own labeled segment. The site states no egg count, bowl type, whisk type, recipe or whisking duration, so none is claimed here.

Limits the site already states apply. Hand occlusion is the first: fingers disappear behind objects in manipulation, which is why 3D hand pose carries a per-joint visibility flag. Depth is the second: it degrades on wet and reflective surfaces, and per-frame confidence maps mask the low-confidence regions rather than hiding them. The cooking page adds that ingredients change shape and state, and that masks propagated frame to frame do not track them well, so cooking captures ship per-frame instance masks. How a whisked liquid, a bowl or a pan behaves in depth is not stated for this row. If your policy depends on it, say so at the start.

An episode is also rejected if the manipulated object is out of frame for more than 15 percent of it, so the spec decides what the manipulated object is: the egg, the bowl, the whisk or the pan.

Capture setup

What capture setup is used for this row?

The catalog lists one capture mode for the row: a multiview rig with handheld grippers. The site describes that mode as a staged working set recorded by a multiview rig while the operator performs the task with handheld grippers. The site does not explain the grippers further and does not state a camera count for the row.

The instrumented tier is a head-mounted stereo rig worn by the contributor, with first-person RGB and metric depth recovered from the calibrated stereo rig. The wider stack is ten streams: a 4K head camera, two wrist cameras, depth, IMU, 3D hand and body pose, instance segmentation and action labels, hardware-triggered onto one PTP clock domain and aligned under 2 ms, with 6-DoF IMU data at 200 Hz. The rig is calibrated twice per session, and an episode is accepted only if RMS reprojection stays under 0.28 px. Which tier applies to this row is not stated and is confirmed in the skill spec.

This is an egocentric page. The catalog does not list stereo capture for the Crack + whisk eggs row, and this page does not describe the task as stereo capture. Stereo applies only through the site’s general stereo offer, agreed in the skill spec.

Episodes

What does one episode contain?

Each attempt is delivered as one episode. The site does not set an episode length, so the skill spec decides what one attempt is: one egg, one bowl, one whisk, or the whole run from cracking to the pour. Inside the episode, the synchronized streams run from start to end, and action segments divide it into labeled spans. Whether the egg step stands alone, as it does in this row, or sits inside a longer cooking sequence is a spec decision.

The standard fields are action segments with start_ns, end_ns, verb and noun; hand_joints and hand_visible for 3D hand pose on both hands, with a per-joint visibility flag; contact_events for the moment a hand meets an object; an objects list; and per-frame instance masks stored at the depth resolution of 848×480. The site does not say whether an egg, a whisk or a bowl counts as the item in a contact event, so the spec settles it.

Labels and delivery

How is the data validated and delivered?

Validation runs against signed accept criteria written into the spec before capture, and a reject log ships with each batch. Episodes are machine-checked against reject criteria, including a sync breach beyond the ceiling for more than three consecutive frames, calibration drift beyond tolerance, the manipulated object out of frame for more than 15 percent of the episode, more than 35 percent invalid depth pixels in the manipulation region, an undocumented bystander and a mismatch against the skill spec. A human reviewer then checks each episode. Only footage that clears the criteria is billed as a validated hour, and rejected items are recaptured at our cost.

Delivery is in the format your stack already reads: RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, or raw streams with metadata, with readable converter source alongside. The license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default, with exclusivity available as a separate term. The executed agreement controls.

Capture and privacy

How are people and printed text protected?

Every contributor signs a written release, and each delivered episode links to it through consent artefact IDs in the batch data card. At ingest, automated detection finds faces, plates and screens and blurs them irreversibly. Speech is scrubbed of names, addresses and card numbers. A human reviewer confirms that no un-consented person is identifiable in any frame, footage that cannot be de-identified is discarded, and the anonymization record ships with the data.

A kitchen can put printed text in view, such as a label on a package. Whether a product label is blurred is not stated, so it is agreed in the spec. A kitchen can have other people nearby, and an undocumented bystander is a reject criterion. The site states no contributor safety protocol and no food-safety guidance for any kitchen row, and this page does not describe one.

Not stated

What does an egg cracking and whisking collection not include?

Where this site does not state something, this page says "not stated" rather than filling the gap. There is no listed label for egg state, whisk progress, liquid level, recipe or quantity, no force or tactile stream, no thermal stream, and no stated cycle time, error rate or success rate for the row. Counts of contributors, episodes and hours are set in your skill spec. Nothing here claims a training outcome or a model improvement.

The tradeoff to plan for is the embodiment gap between a human cracking and whisking eggs and a robot platform doing it, which retargeting or pairing with robot data has to close. The site does not claim that human capture replaces robot data.

Custom collection

Is there an off-the-shelf dataset, or is this custom collection?

The site lists an egocentric kitchen video dataset as a fixed corpus you can review, but the row for this task is Available on request, so a cracking and whisking collection is custom collection. It runs as custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs. This page does not state a provider count, hours or throughput beyond what the site already states.

Because the row is Available on request, the work is scoped and recruited to your spec rather than pulled from a library of existing hours. If you also need the stovetop step, the neighbouring rows are listed with their own statuses in the first table.

Speed

How fast can a custom egg cracking and whisking dataset be collected?

From signed spec to first validated batch, the published timeline is a median of 48 hours where coverage is deep and three to four weeks where it is thin and contributors need to be recruited first. The site does not say which applies to the working kitchen set, so the range that applies is confirmed when the spec is quoted. At program level, a pilot runs two to three weeks to first delivery and a standing program reaches full rate in four to six weeks.

Getting started

How do you start a pilot?

Describe the steps you need, their order, where an attempt starts and ends, what counts as complete and what the camera must see. That becomes a written skill spec, quoted for reach, timeline and price before capture. Most programs begin with a Spec Pilot, a small, fast first batch that proves the spec before volume scales. Collections are billed per validated hour.

Capture setup

What is the capture setup for an egg cracking and whisking collection?

The capture setup as stated on this site. Counts of sites, contributors, episodes and hours are set in the skill spec.
PartAs stated on this site
Catalog capture modeMultiview rig + handheld grippers: a staged working set recorded by a multiview rig while the operator performs the task with handheld grippers
Instrumented tierHead-mounted stereo rig worn by the contributor; first-person RGB with metric depth recovered from the calibrated stereo rig
StreamsTen: 4K head camera, two wrist cameras, depth, IMU, 3D hand and body pose, instance segmentation, action labels
Sync and IMUHardware-triggered onto one PTP clock domain, aligned under 2 ms; 6-DoF IMU at 200 Hz
Hand pose21 joints per hand, 3D, with a per-joint visibility flag
CalibrationTwice per session; accepted only under the 0.28 px RMS reprojection gate
Capture locationFirsthand contributor settings, not a customer’s own facility
Which tier applies to this rowNot stated; confirmed in the skill spec

Every collection runs through the same seven-stage end-to-end custom collection pipeline.

Task rows

Catalog row × environment × what the catalog says × skill × capture × status

The egg row exactly as the task catalog states it, followed by four neighbouring rows from the same environment. Items the catalog does not list are marked Not stated.
Catalog rowEnvironmentWhat the catalog statesSkillCapture modeStatus
Crack + whisk eggsWorking Kitchen Set (food prep)Crack eggs and whisk, then pour to pan.MediumMultiview rig + handheld grippersAvailable on request
Stir + flip on stovetop (nearby, context only)Working Kitchen Set (food prep)Stir a pan and flip contents.MediumMultiview rig + handheld grippersAvailable on request
Measure + mix (nearby, context only)Working Kitchen Set (food prep)Measure ingredients and mix a batter.MediumMultiview rig + handheld grippersAvailable on request
Knead + roll dough (nearby, context only)Working Kitchen Set (food prep)Knead dough and roll it flat.MediumMultiview rig + handheld grippersAvailable on request
Assemble a salad (nearby, context only)Working Kitchen Set (food prep)Tear greens, add toppings, dress, and toss a salad.MediumMultiview rig + handheld grippersAvailable on request
Recipe, egg count, bowl, whisk or pan type, egg-state or whisk-progress labelsNoneNot stated as rowsNot statedNot statedNot stated

Page comparison

This page × the cooking, egg collection and baking pages

What each page is mainly about, the catalog rows it covers, and the status and capture mode the catalog lists for them. Statuses are quoted as the catalog states them; no delivered hours are claimed.
PageMain topicCatalog rows it coversStatus as listedCapture mode as listed
This page: egocentric egg cracking and whisking dataCracking and whisking eggs, then pouring to a pan, at a kitchen counterCrack + whisk eggsAvailable on requestMultiview rig + handheld grippers
/custom-collection/egocentric-cooking-video-dataFirst-person food-prep and cooking capture in kitchensThe kitchen task categories the site documents; not a single rowPer row; see the catalogHead-mounted capture with hardware-synced streams, as that page states
/custom-collection/egocentric-egg-collection-and-candling-dataCollecting eggs from nests, checking them against a light and packing them, on a farmEgg Collection & CandlingReady to deployHead-mounted phone or multiview rig
/custom-collection/egocentric-baking-and-dough-handling-dataKneading, rolling dough and mixing batterKnead + roll dough; Measure + mixAvailable on requestMultiview rig + handheld grippers

Capture challenges

Kitchen challenge × what goes wrong × stream or label that addresses it

Each challenge mapped to a stream or label this site already states. Where nothing is stated, the row says so.
ChallengeWhat goes wrongStated stream or label
Crack, whisk and pour share one rowThree actions sit in one descriptionAction segments with verb and noun split each step; the skill spec names each; no whisking duration is stated
Fingers behind objectsHand occlusion in manipulation3D hand pose, 21 joints per hand, with a per-joint visibility flag
Wet or reflective surfacesDepth degradesPer-frame confidence maps mask low-confidence regions; how a whisked liquid behaves in depth is not stated
Ingredients that change shape and stateMasks propagated frame to frame do not track them wellPer-frame instance masks, stored at 848×480
The manipulated object leaves the frameThe episode loses its subjectReject if the object is out of frame for more than 15% of an episode; the spec names the manipulated object
Judging a finished whiskA finished result still needs a labelNot stated: no egg-state, whisk-progress or success labels are listed

Delivered vs not stated

What is delivered and what is not stated

Delivered items are stated elsewhere on this site. Items marked not stated are not promised on this page.
ItemStatusDetail
Action segmentsDeliveredstart_ns, end_ns, verb, noun, one per step
3D hand poseDelivered21 joints per hand; per-joint visibility flag for occluded fingers
Contact eventsDeliveredThe moment a hand meets an item
Per-frame instance masksDeliveredStored at 848×480
Consent and anonymization recordsDeliveredConsent artefact IDs per episode; anonymization record shipped with the data
Recipe, egg count, bowl, whisk and pan typesNot statedAgreed in the skill spec
Egg-state, whisk-progress, liquid-level or success labelsNot statedNot among the listed labels
Cycle times, error rates, and counts of sites, episodes and hoursNot statedSet per program in the skill spec
Force, tactile or thermal readings; safety and certificationsNot statedNot among the listed streams or claims

Example footage

What does egocentric capture look like?

One real clip already published on this site, shown as a format and rig example: a head-mounted stereo capture with hands in frame. It does not show egg cracking, whisking or a kitchen, and it is not an example of the multiview rig with handheld grippers this row uses.

egocentric_stereo_sample.mp4 · head-mounted stereo · hands in frame · 1920 × 1080 web preview · rig example, not an egg or whisk clip

No egg cracking or whisking clip is published on the site, so this is the nearest clip. Request a sample to see delivered files. See stereo sample page, stereo + wrist-cam example videos, request an egocentric data sample.

FAQ

Egocentric egg cracking data, answered.

What is egocentric egg cracking and whisking data?
Custom first-person video of a paid, consented contributor cracking eggs, whisking them and pouring to a pan, captured to a written skill spec, with synchronized streams, hand pose and action segments.
Which catalog row covers it, and what is its status?
One row: "Crack + whisk eggs" in Working Kitchen Set (food prep), described as "Crack eggs and whisk, then pour to pan." It is rated Medium, listed with Multiview rig + handheld grippers, and its status is Available on request. This page claims no delivered hours.
Is there an egg cracking dataset I can download?
No. The row is Available on request, so this is a custom collection: you write a skill spec, we quote reach, timeline and price against it, and capture runs to your accept criteria.
Does the site state a recipe, egg count or whisk and bowl types?
No. The site states no recipe, egg count, bowl, whisk or pan type, whisking duration, task time or success rate for this row. Those details are agreed in the skill spec.
Is this stereo capture, and is it captured at my kitchen?
The catalog lists a multiview rig with handheld grippers for this row and does not list stereo, so this page treats it as egocentric capture. The instrumented tier is a head-mounted stereo rig, and which tier applies is confirmed in the spec. Firsthand does not capture at a customer’s own facility.
How are people and printed labels protected?
Contributors sign a release and each episode links to it. Faces, plates and screens are blurred irreversibly at ingest, and an undocumented bystander is a reject criterion. Whether a product label is blurred is not stated and is agreed in the spec.
How fast can a fast, on-demand egg and whisk dataset arrive?
A median of a median of 48 hours from signed spec to first validated batch where coverage is deep, and three to four weeks where it is thin. A pilot runs two to three weeks to first delivery.
Who owns the data and in which formats does it arrive?
The buyer owns the delivered data under a perpetual, non-exclusive commercial license by default. Formats are RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, or raw streams with metadata.

Sources

Where are the delivery formats on this page documented?

Request a custom egg cracking and whisking dataset.

Tell us the steps you need, their order, where an attempt starts and ends, what counts as complete and what the camera must see. We will quote reach, timeline and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.