Egocentric Kitchen Line Setup and Breakdown Data

It is first-person video of a person setting up and breaking down a prep line in a commercial kitchen, recorded from their own point of view with hand pose and sensor streams alongside. The tasks are the rows the site’s catalog lists in Restaurant & Commercial Kitchen. It is custom data: Firsthand collects it on demand, to a written skill spec, from paid, consented contributors.

It is human capture, not robot or teleoperation data. The site does not state that any batch of these two rows has been delivered, so this page claims no volume, hours or delivered footage for them.

Two, both in Restaurant & Commercial Kitchen under Food & Beverage, in the catalog data file lib/commercial-catalog-data.ts. The catalog lists examples for the environment such as a sit-down restaurant kitchen, a café, a coffee shop, an artisan bakery and a patisserie. "Set up and break down a prep line using gastronorm pans and sanitizing buckets" is described as filling gastronorm pans with prepped items, setting them in the line and clearing them down after service, is rated Easy and is listed as Active collection.

"Restaurant Line Setup & Breakdown" is described as filling and arranging prep pans on the line before service, then emptying, cleaning and storing them, is rated Easy and is listed as Ready to deploy. Both list a head-mounted phone or a multiview rig as the capture setup. The site says nothing further about what each status means in volume, hours or delivered footage, so this page claims none, and what applies to a given order is confirmed when you request the quote. This page names only the tools and steps that appear in the two rows. The first table below reproduces them as the catalog states them.

The egocentric cutting and food prep page is about knife work: chopping, peeling, slicing and dicing. The meal plating and serving page covers plating, portioning and serving rows, and the food portioning and weighing page covers two portioning and packaging rows. The food service page is an overview across prep, assembly, plating, cooking-line handling, dishwashing and packaging. None of them treats filling pans, setting a line and clearing it down as its main topic.

The stereo commercial kitchen line cooking page covers the knife work and vegetable chopping rows, and the stereo dishwashing page covers the wash-up and clean-down rows. This page covers the two line setup and breakdown rows. The comparison table below sets the pages side by side.

The rows give the outline: fill the pans with prepped items, arrange them, set them in the line, and after service clear them down, empty, clean and store them. A spec turns that outline into episodes. It decides whether one episode is one pan, one section of the line, the setup alone, the breakdown alone or the whole chain, and what the pans, items and line look like at the start.

The site states no pan size or count, no line layout, no list of prepped items and no episode length for these rows, so they are Not stated and are written into the spec. Action segments carry start, end, verb and noun as the spec defines them, which is how the steps are made readable to a model.

The catalog lists a head-mounted phone or a multiview rig for both rows. The site states that a multiview rig adds synchronized third-person angles when the spec asks for them, and that wrist cameras give a closer view of the hands. Ten streams are synced under 2 ms, with hand pose at 21 joints per hand.

Which rig a given order uses, and which of the available streams it includes, is agreed in the skill spec and confirmed on a Spec Pilot. The site does not state a frame rate or resolution for these two rows, so this page gives none. Capture at your own facility is listed as not offered.

Hidden hands are the first risk. Fingers go behind pans and shelving, and the visibility flag on each joint is the answer the site gives, with contact events marking when a hand meets an item. A spec can also ask for wrist views, so a grip the head camera loses is still recorded.

Wet and reflective surfaces are the second. The site states that wet and reflective surfaces degrade active-stereo depth, that kitchen captures ship per-frame depth confidence maps so low-confidence regions can be masked, and that per-frame instance masks are provided for wet or reflective cookware. Whether those apply to gastronorm pans specifically is Not stated.

Framing is the third. An episode is rejected when the manipulated object is out of frame for more than 15 percent of it or an undocumented bystander appears, and a reject log ships with every batch. The site lists no label for a full pan, a clean pan or a finished line, so what counts as a finished step is written into the spec up front.

For every delivered episode the site states that faces, plates and screens are blurred irreversibly, and that footage that cannot be de-identified is discarded. Who may be in frame, and how a kitchen’s own staff, menus or labels are handled, is agreed in the spec.

The site states no throughput, timing, food-safety, HACCP, temperature, certification, accuracy or product-brand claim for these rows, so this page describes none.

Firsthand offers MCAP delivery, and the data can also ship as RLDS, LeRobot, WebDataset, HDF5 or zarr as the spec asks. MCAP is an open source container for multimodal log data; its own documentation and repository are linked in the sources, and the MCAP hub page and the glossary entry cover the format on this site.

Topic names, message schemas and rates are Not stated on the site and are agreed in the skill spec. Firsthand is not affiliated with Foxglove or the MCAP maintainers.

Off-the-shelf covers what is already in stock. This page does not claim off-the-shelf coverage of the two line setup rows. Custom collection covers the rest: custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.

Where coverage is deep, the median time from signed spec to first validated batch is a median of 48 hours; where it is thin, turnaround runs three to four weeks. The site does not say which speed applies to a line setup order, so ask when you request the quote. Collections are billed per validated hour.

Describe the line and its stations, the pans, prepped items and buckets and their start states, whether you want setup, breakdown or both, what counts as a finished step, and the variation your pipeline is missing. Then name the streams you want and the delivery format, with MCAP alone or beside a training format.

Most programs begin with a Spec Pilot, a small first batch that proves the spec and accept criteria on real footage before you scale. The last table below shows what each spec element decides.