Task family

Egocentric Catering and Event Kitchen Video Data

Plating dishes in sequence, prepping food in large batches and setting out and clearing an event service area, captured first-person in catering and event kitchens against a spec you write, for catering robot training data and fast, on-demand custom collection.
Kitchen tasks
Three catalog rows
Status
All Available on request
Billing
Per validated hour
License
Buyer-owned

Requirements

What does catering and event kitchen data need?

01

A named catering task list

Plating, bulk prep and service setup and breakdown are different sequences, so a spec names each one and the kitchen setting it covers.

02

Both hands and the work surface in frame

A head-mounted view keeps both hands, the plates, trays or pans, and the station in view while items are portioned, wiped, loaded, set out or cleared.

03

Hand pose through every repeated step

3D hand pose with per-joint visibility carries how the fingers hold, place and release each item, plate after plate and batch after batch.

04

Step boundaries on the same clock

Frame-accurate action segments mark where prepping ends, where plating starts and where setup or breakdown begins, aligned to video and depth.

05

Rights you can ship on

A perpetual, buyer-owned commercial license backed by a documented consent chain.

Why it matters

What is egocentric catering and event kitchen data, and why does it need its own page?

Egocentric catering and event kitchen video data is real-world, first-person video of work in a kitchen that prepares and serves food for events and institutions. It is recorded from the worker viewpoint, with depth, 3D hand pose, contact events and frame-accurate action segments aligned on one hardware clock. The tasks it covers are the ones the site states in its task catalog, under the Catering & Event Kitchen environment: banquet plating, bulk food preparation, and event service setup and breakdown.

The meal plating and serving page covers plating, portioning and serving across several environments, and the cutting and food prep page covers cutting and preparation. The food service page is broader. This page is about the catering environment itself, where the catalog describes work in batches and in sequence: many plates, large batches of prep, and a service area that is set out and then cleared and packed.

Setting

Which catering tasks can be captured?

The site states catering work in one catalog environment, Catering & Event Kitchen, under the Food & Beverage sector. Its examples line reads "Hotel banquet kitchen, airline catering, hospital canteen, stadium concessions, event catering facility." Three task rows sit under it, one rated Easy and two rated Medium, and every one lists a head-mounted phone or multiview rig as the capture mode.

All three rows carry the status Available on request. The site defines that status as work scoped and recruited to spec when a buyer asks for it. None is marked Ready to deploy or Active collection, so this page does not claim that contributors or site access are already in place. The first table below lists the three rows as the catalog states them.

Plating

How is the banquet plating row described?

The catalog row is Banquet plating, described as portioning hot dishes onto plates in sequence, wiping rims and loading plates onto service trays. It is rated Medium. The order in the description is the useful part: portion, wipe, load, repeated plate after plate.

The word hot is catalog wording. The site states no temperature, holding or food-safety rule for this row, so none is claimed here. Dish and menu types, plate counts and tray types are Not stated and are set in the written spec. The same row also appears on the meal plating and serving page, where it sits with the other plating, portioning and serving rows.

Bulk prep

How is the bulk food preparation row described?

The row is Bulk food preparation, described as prepping vegetables, proteins and sauces in large batches using hotel pans and commercial mixers. It is rated Medium. The pans and mixers are tool types the catalog lists, not models.

The catalog names three ingredient groups and a batch scale, not recipes. Specific ingredients, quantities, batch sizes and pan or mixer models are Not stated. The cutting and food prep page notes that the catering environment lists this row and that the catalog does not describe a specific cut in it, so this page claims no cut either.

Setup and breakdown

How is the event service setup and breakdown row described?

Event service setup and breakdown is described as setting out chafing dishes, service stations and utensils, then clearing and packing them after service. It is the only Easy row in the environment.

It is the one row where the work is about the service area rather than the food. Setup and breakdown are two ends of the same row, so a spec can ask for one or both. Event sizes, guest counts, layouts and what is packed where are Not stated.

Combining rows

How can the three catering rows be combined in a spec?

The catalog lists the three rows separately and does not state that they are performed in one event or by one worker. A spec can still name them as separate task families or chain them: prepare in bulk, plate in sequence, set out the service area, then clear and pack. That chain is a way to write a spec, not a claim about how any one event runs.

Action segments are what make a chain usable. Frame-accurate step boundaries separate prepping, plating, wiping, loading, setting out and clearing, aligned to video and depth, so a policy or a reviewer can tell where one step ends and the next begins. How many segments an episode holds is Not stated.

Environments

Where is it captured and how are workers protected?

The catalog places the work in the catering and event kitchen settings its examples line names, and the environment page states that contributors are recruited to spec in Western program markets, so the footage reflects how this work is done in North American and European businesses. The site names no venue, caterer, company, city or region, and it does not state capture at a customer own site. Access and schedule are agreed in the spec, and the number of sites is Not stated.

The privacy steps the site states are these. Every episode links to a signed contributor release through a documented consent chain, and the consent record is part of the delivery. Faces, plates and screens are detected and irreversibly blurred at ingest, a reviewer confirms the result before anything ships, and the anonymization record is delivered with the data. Physical-safety measures, PPE rules, hygiene rules and venue access terms are Not stated.

Capture setup

How is catering work captured from a first-person view?

A head-mounted phone records the first-person view of real work on site, and a multiview rig adds synchronized third-person angles when the spec asks for them. All three catering rows list this single setup. On the rig tier, every stream is hardware-triggered onto one PTP clock domain, and the rig is calibrated twice per session, before capture starts and after it ends. An episode is accepted only if RMS reprojection stays under 0.28 px.

Camera count, resolution and frame rate for catering work are Not stated, so session length and volume are quoted against your spec.

Streams and labels

What does each catering episode contain?

Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact and grasp events, and frame-accurate action segments. In a catering kitchen, hand pose tracks how the fingers hold and place each item, contact events mark when fingers meet a plate, a pan, a tray or a utensil, and action segments mark each step.

Object labels use the terms your spec sets. Force or tactile data, and success or quality labels, are Not stated for these rows. If your policy needs them, they are defined in the spec. Tactile gloves are a separate capture tier with their own page.

Delivery

How is the data labeled and delivered?

Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. The format table below sets each against what its official documentation states. Action segments are the step labels, and any further object labels follow the spec.

Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch. Billing is per validated hour, and rejected items are recaptured at our cost.

Why it is hard

Why are batch prep, portioning and loading hard for robot learning?

A survey of more than 150 studies states that, compared with rigid objects, deformable object manipulation poses significant challenges for perception, modeling and manipulation, because deformable objects have an infinite-dimensional state space and complex dynamics. The same survey states that data-driven approaches can address some of those challenges.

The site does not state that vegetables, proteins or sauces are deformable, and the catalog names no specific item, so this page applies the survey only where your spec names deformable items. What the catalog does state is the shape of the work: large batches, plates portioned in sequence, and a service area set out and then cleared and packed. Repeating the same step across many items and many plates is hard to cover with a few recordings, which is why a spec names the tasks, the items and the number of sequences. Cycle times, repetition counts and error rates are Not stated.

Fast · on demand

How fast can a custom catering dataset be collected?

Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front. The site does not state which of the two applies to catering work.

All three catering rows are Available on request, so treat the timeline as the scoped-to-spec case until the quote says otherwise. On-demand top-ups run against the same spec and accept criteria after each training run.

The spec

How do you start a pilot?

You describe the catering tasks, items and sequence your policy needs. We turn that into a written spec covering tasks, environments, capture tier, annotation depth and accept criteria, then quote reach, timeline and price before any capture begins.

A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Billing is per validated hour, a reject log ships with every batch, rejected items are recaptured at our cost, and every collection ships under a perpetual, buyer-owned commercial license.

At a glance

What you get.

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

Catalog rows

Which catalog rows cover catering and event kitchens?

The three Catering & Event Kitchen rows with the catalog description, skill rating and status as listed. Every row lists a head-mounted phone or multiview rig as capture mode.
Task familyCatalog task and descriptionSkillStatus
PlatingBanquet plating: portion hot dishes onto plates in sequence, wipe rims and load plates onto service traysMediumAvailable on request
Bulk prepBulk food preparation: prep vegetables, proteins and sauces in large batches using hotel pans and commercial mixersMediumAvailable on request
Service setup and breakdownEvent service setup and breakdown: set out chafing dishes, service stations and utensils, then clear and pack them after serviceEasyAvailable on request

Streams and tasks

How do the stated streams map to catering tasks?

The streams the site states for Firsthand custom collections, set against what each carries in a catering or event kitchen episode.
Stream or labelStatus on this siteWhat it carries in a catering episode
Head and wrist RGB, depthStated; ten streams synced under 2 msKeeps the plates, pans or trays, the station and both hands on one timeline
3D hand pose, per-joint visibilityStatedCarries how the fingers hold, place and release each item and each utensil
Contact and grasp eventsStatedMarks when fingers meet a plate, a pan, a tray or a utensil
Action segmentsStated; frame-accurateSeparates prepping, portioning, wiping, loading, setting out and clearing
Object labelsSet by your specNames the items and steps in the terms your policy uses

What is not stated

Which catering details does the site not state?

Catering and event kitchen fields the site does not state, and where each one is settled.
ItemStatus on this siteWhere it is settled
Dish, menu, ingredient or recipe typesNot stated; task rows name food groups and plated dishes onlyThe written spec
Equipment or tool modelsNot stated; task rows name tool types onlyThe written spec
Venue types or sizes, guest counts, regions, number of sitesNot stated beyond the examples line and Western program marketsThe written spec
Cycle times, throughput, repetition countsNot statedQuoted against your spec
Number of episodes or workersNot statedThe written spec
Food-safety, hygiene, allergen or temperature-holding rulesNot statedNot claimed on this page
Success or quality labelsNot statedThe written spec, if needed
Force or tactile dataNot stated for these rowsThe written spec, if needed
Robot or policy resultsNot statedNot claimed on this page

Formats

Which formats carry catering and event kitchen data?

Delivery formats stated on the site, set against what each format official documentation states where the documentation was read.
FormatWhat the official documentation statesUsed for here
RLDSA dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README)Episode-based training loaders
LeRobotLeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation)LeRobot dataset format and tooling
WebDatasetTar files in which files that belong together share a basename, split into numbered shards (WebDataset README)Sharded streaming for large training runs
HDF5 and zarrStated by Firsthand onlyArray storage for custom pipelines
Rerun .rrdStated by Firsthand onlyMulti-stream synchronized playback for review

FAQ

Catering robot training data, answered.

What is egocentric catering and event kitchen video data?
Real-world, first-person video of kitchen work for events and institutions, such as portioning dishes onto plates in sequence, prepping food in large batches and setting out and clearing a service area, captured against a written spec with 3D hand pose, depth and action segments.
Which catering tasks does the site state?
The task catalog lists three rows under Catering & Event Kitchen: banquet plating, bulk food preparation, and event service setup and breakdown. One is rated Easy and two Medium, and all three are Available on request.
Does the site state dishes, equipment, venues or guest counts?
No. The examples line names a hotel banquet kitchen, airline catering, a hospital canteen, stadium concessions and an event catering facility, but dish types, equipment models, venue sizes, guest counts, cycle times and any food-safety or hygiene rule are Not stated.
Are force data or quality labels included?
Not stated for these rows. They are defined in the written spec if your policy needs them. The site states hand pose, depth, contact events and action segments.
How is privacy handled?
Faces, plates and screens are detected and irreversibly blurred at ingest, and a reviewer confirms the result. Each episode links to a signed contributor release, and the anonymization record ships with the data. PPE and venue safety rules are Not stated.
How fast can a custom catering dataset be collected?
Where coverage is deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks. All three catering rows are Available on request, so the timeline is quoted against your spec.
How do you start a pilot?
Describe the catering tasks, items and sequence you need. We write a spec, quote against it, and a Spec Pilot proves the accept criteria before you scale.

Sources

Where are the deformable-object claim and delivery formats documented?

Request a custom dataset.

Tell us the catering tasks, items and sequence your policy needs to handle. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.