A named catering task list
Plating, bulk prep and service setup and breakdown are different sequences, so a spec names each one and the kitchen setting it covers.
Task family
Requirements
Plating, bulk prep and service setup and breakdown are different sequences, so a spec names each one and the kitchen setting it covers.
A head-mounted view keeps both hands, the plates, trays or pans, and the station in view while items are portioned, wiped, loaded, set out or cleared.
3D hand pose with per-joint visibility carries how the fingers hold, place and release each item, plate after plate and batch after batch.
Frame-accurate action segments mark where prepping ends, where plating starts and where setup or breakdown begins, aligned to video and depth.
A perpetual, buyer-owned commercial license backed by a documented consent chain.
Why it matters
Egocentric catering and event kitchen video data is real-world, first-person video of work in a kitchen that prepares and serves food for events and institutions. It is recorded from the worker viewpoint, with depth, 3D hand pose, contact events and frame-accurate action segments aligned on one hardware clock. The tasks it covers are the ones the site states in its task catalog, under the Catering & Event Kitchen environment: banquet plating, bulk food preparation, and event service setup and breakdown.
The meal plating and serving page covers plating, portioning and serving across several environments, and the cutting and food prep page covers cutting and preparation. The food service page is broader. This page is about the catering environment itself, where the catalog describes work in batches and in sequence: many plates, large batches of prep, and a service area that is set out and then cleared and packed.
Setting
The site states catering work in one catalog environment, Catering & Event Kitchen, under the Food & Beverage sector. Its examples line reads "Hotel banquet kitchen, airline catering, hospital canteen, stadium concessions, event catering facility." Three task rows sit under it, one rated Easy and two rated Medium, and every one lists a head-mounted phone or multiview rig as the capture mode.
All three rows carry the status Available on request. The site defines that status as work scoped and recruited to spec when a buyer asks for it. None is marked Ready to deploy or Active collection, so this page does not claim that contributors or site access are already in place. The first table below lists the three rows as the catalog states them.
Plating
The catalog row is Banquet plating, described as portioning hot dishes onto plates in sequence, wiping rims and loading plates onto service trays. It is rated Medium. The order in the description is the useful part: portion, wipe, load, repeated plate after plate.
The word hot is catalog wording. The site states no temperature, holding or food-safety rule for this row, so none is claimed here. Dish and menu types, plate counts and tray types are Not stated and are set in the written spec. The same row also appears on the meal plating and serving page, where it sits with the other plating, portioning and serving rows.
Bulk prep
The row is Bulk food preparation, described as prepping vegetables, proteins and sauces in large batches using hotel pans and commercial mixers. It is rated Medium. The pans and mixers are tool types the catalog lists, not models.
The catalog names three ingredient groups and a batch scale, not recipes. Specific ingredients, quantities, batch sizes and pan or mixer models are Not stated. The cutting and food prep page notes that the catering environment lists this row and that the catalog does not describe a specific cut in it, so this page claims no cut either.
Setup and breakdown
Event service setup and breakdown is described as setting out chafing dishes, service stations and utensils, then clearing and packing them after service. It is the only Easy row in the environment.
It is the one row where the work is about the service area rather than the food. Setup and breakdown are two ends of the same row, so a spec can ask for one or both. Event sizes, guest counts, layouts and what is packed where are Not stated.
Combining rows
The catalog lists the three rows separately and does not state that they are performed in one event or by one worker. A spec can still name them as separate task families or chain them: prepare in bulk, plate in sequence, set out the service area, then clear and pack. That chain is a way to write a spec, not a claim about how any one event runs.
Action segments are what make a chain usable. Frame-accurate step boundaries separate prepping, plating, wiping, loading, setting out and clearing, aligned to video and depth, so a policy or a reviewer can tell where one step ends and the next begins. How many segments an episode holds is Not stated.
Environments
The catalog places the work in the catering and event kitchen settings its examples line names, and the environment page states that contributors are recruited to spec in Western program markets, so the footage reflects how this work is done in North American and European businesses. The site names no venue, caterer, company, city or region, and it does not state capture at a customer own site. Access and schedule are agreed in the spec, and the number of sites is Not stated.
The privacy steps the site states are these. Every episode links to a signed contributor release through a documented consent chain, and the consent record is part of the delivery. Faces, plates and screens are detected and irreversibly blurred at ingest, a reviewer confirms the result before anything ships, and the anonymization record is delivered with the data. Physical-safety measures, PPE rules, hygiene rules and venue access terms are Not stated.
Capture setup
A head-mounted phone records the first-person view of real work on site, and a multiview rig adds synchronized third-person angles when the spec asks for them. All three catering rows list this single setup. On the rig tier, every stream is hardware-triggered onto one PTP clock domain, and the rig is calibrated twice per session, before capture starts and after it ends. An episode is accepted only if RMS reprojection stays under 0.28 px.
Camera count, resolution and frame rate for catering work are Not stated, so session length and volume are quoted against your spec.
Streams and labels
Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact and grasp events, and frame-accurate action segments. In a catering kitchen, hand pose tracks how the fingers hold and place each item, contact events mark when fingers meet a plate, a pan, a tray or a utensil, and action segments mark each step.
Object labels use the terms your spec sets. Force or tactile data, and success or quality labels, are Not stated for these rows. If your policy needs them, they are defined in the spec. Tactile gloves are a separate capture tier with their own page.
Delivery
Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. The format table below sets each against what its official documentation states. Action segments are the step labels, and any further object labels follow the spec.
Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch. Billing is per validated hour, and rejected items are recaptured at our cost.
Why it is hard
A survey of more than 150 studies states that, compared with rigid objects, deformable object manipulation poses significant challenges for perception, modeling and manipulation, because deformable objects have an infinite-dimensional state space and complex dynamics. The same survey states that data-driven approaches can address some of those challenges.
The site does not state that vegetables, proteins or sauces are deformable, and the catalog names no specific item, so this page applies the survey only where your spec names deformable items. What the catalog does state is the shape of the work: large batches, plates portioned in sequence, and a service area set out and then cleared and packed. Repeating the same step across many items and many plates is hard to cover with a few recordings, which is why a spec names the tasks, the items and the number of sequences. Cycle times, repetition counts and error rates are Not stated.
Fast · on demand
Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front. The site does not state which of the two applies to catering work.
All three catering rows are Available on request, so treat the timeline as the scoped-to-spec case until the quote says otherwise. On-demand top-ups run against the same spec and accept criteria after each training run.
The spec
You describe the catering tasks, items and sequence your policy needs. We turn that into a written spec covering tasks, environments, capture tier, annotation depth and accept criteria, then quote reach, timeline and price before any capture begins.
A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Billing is per validated hour, a reject log ships with every batch, rejected items are recaptured at our cost, and every collection ships under a perpetual, buyer-owned commercial license.
At a glance
Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.
Catalog rows
| Task family | Catalog task and description | Skill | Status |
|---|---|---|---|
| Plating | Banquet plating: portion hot dishes onto plates in sequence, wipe rims and load plates onto service trays | Medium | Available on request |
| Bulk prep | Bulk food preparation: prep vegetables, proteins and sauces in large batches using hotel pans and commercial mixers | Medium | Available on request |
| Service setup and breakdown | Event service setup and breakdown: set out chafing dishes, service stations and utensils, then clear and pack them after service | Easy | Available on request |
Streams and tasks
| Stream or label | Status on this site | What it carries in a catering episode |
|---|---|---|
| Head and wrist RGB, depth | Stated; ten streams synced under 2 ms | Keeps the plates, pans or trays, the station and both hands on one timeline |
| 3D hand pose, per-joint visibility | Stated | Carries how the fingers hold, place and release each item and each utensil |
| Contact and grasp events | Stated | Marks when fingers meet a plate, a pan, a tray or a utensil |
| Action segments | Stated; frame-accurate | Separates prepping, portioning, wiping, loading, setting out and clearing |
| Object labels | Set by your spec | Names the items and steps in the terms your policy uses |
What is not stated
| Item | Status on this site | Where it is settled |
|---|---|---|
| Dish, menu, ingredient or recipe types | Not stated; task rows name food groups and plated dishes only | The written spec |
| Equipment or tool models | Not stated; task rows name tool types only | The written spec |
| Venue types or sizes, guest counts, regions, number of sites | Not stated beyond the examples line and Western program markets | The written spec |
| Cycle times, throughput, repetition counts | Not stated | Quoted against your spec |
| Number of episodes or workers | Not stated | The written spec |
| Food-safety, hygiene, allergen or temperature-holding rules | Not stated | Not claimed on this page |
| Success or quality labels | Not stated | The written spec, if needed |
| Force or tactile data | Not stated for these rows | The written spec, if needed |
| Robot or policy results | Not stated | Not claimed on this page |
Formats
| Format | What the official documentation states | Used for here |
|---|---|---|
| RLDS | A dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README) | Episode-based training loaders |
| LeRobot | LeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation) | LeRobot dataset format and tooling |
| WebDataset | Tar files in which files that belong together share a basename, split into numbered shards (WebDataset README) | Sharded streaming for large training runs |
| HDF5 and zarr | Stated by Firsthand only | Array storage for custom pipelines |
| Rerun .rrd | Stated by Firsthand only | Multi-stream synchronized playback for review |
FAQ
Sources
Tell us the catering tasks, items and sequence your policy needs to handle. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.