A named bag task list
Delivering luggage to a room, loading a belt, scanning a tag and re-packing a bag are different sequences, so a spec names each one and the setting it runs in.
Task family
Requirements
Delivering luggage to a room, loading a belt, scanning a tag and re-packing a bag are different sequences, so a spec names each one and the setting it runs in.
The hotel row is work on site, recorded with a head-mounted phone. The checkpoint rows are a staged mock set with props and no live site.
A first-person view and, where the spec calls for it, wrist cameras or a multiview rig keep each grip, lift, place and release visible.
Frame-accurate action segments mark where loading ends, where the move starts, where a tag is scanned and where a bag is opened or closed.
A perpetual, buyer-owned commercial license backed by a documented consent chain.
Why it matters
Egocentric luggage and baggage handling data is real-world, first-person video of the physical work of moving bags, recorded against a written spec with the streams the site states for its custom collections. This page joins rows the site keeps in two places: one guest-facing hotel row and three bag rows on a staged mock checkpoint.
It is task data, not footage of travellers. The checkpoint set is described as props with no live airport, and this page does not describe capturing real passengers, baggage systems or screening. The hotel row is real work on site, and the site names no property for it.
Task coverage
Four catalog rows are counted. Luggage Handling sits in Hotel & Lodging, under Hospitality & Events, rated Easy with the status Ready to deploy. Bag search + re-pack, Baggage load to belt and Baggage tag scan sit in Mock Security Checkpoint, under Public Spaces & Outdoor. The first two are rated Medium, the tag scan Easy, and all three are Available on request.
Other bag-adjacent rows are left out on purpose and listed in a table below, because a row about trays, boxes, documents or room resets does not state luggage work.
Hotel luggage
The catalog line for Luggage Handling reads: load guest luggage onto a trolley, move it through the hotel and deliver it to the room. That is three steps in one row: load, move and deliver. The catalog does not use the word bellhop, and this page names no job title and makes no claim about any staff role.
The site states no luggage sizes, weights, trolley model, route length or delivery rules, so those are set in the spec. Luggage Handling is the only hotel row that names bags.
Checkpoint bags
Three rows use bag props on a staged set. Baggage load to belt loads bags to a belt at pitch, rated Medium. Bag search + re-pack opens, inspects and re-packs a bag, also Medium. Baggage tag scan scans a bag tag and routes it, rated Easy. The environment lists screening bins, a belt, a wand, a mannequin and bag props, with no live airport.
The phrase "at pitch" is catalog wording, and the site states no belt speed, spacing or bag counts. This is a mock checkpoint only. The page makes no real-screening, detection or threat claim, and the site does not say what inspecting a bag means, what a route is or what a tag encodes.
Why it is hard
The site states no robot results for baggage work, so this section describes what the work asks of a dataset, not what any policy achieves. Luggage is a container that is lifted, set down and delivered in order, and a trolley adds a second object to load onto and move through the hotel.
At the checkpoint, a bag opens, holds other items and closes again, so re-packing changes what the next grasp finds. A tag scan is a small, precise action, and a belt adds timing to placement. The site states no cycle times or error rates, so a spec names the tasks, bag types and number of sequences.
Capture setup
The catalog lists two modes. The hotel row lists a head-mounted phone and a multiview rig: the phone records the first-person view of real work on site, and a multiview rig adds synchronized third-person angles when the spec asks for them. The three checkpoint rows list a multiview rig with handheld grippers, so demonstrations map onto a robot end effector.
On the rig tier, every stream is hardware-triggered onto one PTP clock domain, and the rig is calibrated twice per session, before capture starts and after it ends. An episode is accepted only if RMS reprojection stays under 0.28 px. Camera count, resolution and frame rate for baggage work are Not stated, so session length and volume are quoted against your spec.
Streams and labels
The Firsthand episode schema has ten streams synced under 2 ms: a 4K head camera, two wrist cameras, depth, IMU, 3D hand and body pose, instance segmentation and action labels. The site states 3D hand pose with per-joint visibility and frame-accurate action segments, and contact events mark when a hand meets an item.
For luggage work, contact events mark touches on a handle or trolley and action segments mark load, move and deliver. For checkpoint work, they mark load, scan, open and re-pack. The site does not say which streams apply to each row, so the stream list is confirmed in the spec. Force or tactile data and success labels are Not stated for these rows.
Privacy
Every contributor signs a written release before capture, and each delivered episode links to that record through consent artefact IDs in the batch data card. At ingest, automated detection finds faces, plates and screens and blurs them irreversibly. A human reviewer confirms that no un-consented person is identifiable in any frame, footage that cannot be de-identified is discarded, and the anonymization record is delivered with the data. Speech is scrubbed of names, addresses and card numbers, while ambient audio is kept.
Luggage delivery is guest-facing work, and the hospitality page states that front-of-house settings are bystander-dense with lower yield after de-identification. The site states no rule for printed text on a bag tag or luggage label, and none for bystanders at the mock checkpoint, so both are settled in the spec. The site names no venue, property or region for these rows.
Delivery
Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. The format table below sets each against what its official documentation states. Action segments are the step labels, and any further bag or object labels follow the spec.
Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch. Billing is per validated hour, and rejected items are recaptured at our cost.
Fast · on demand
Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front. The hospitality page lists hospitality coverage as thin, and the site does not say which timeline applies to the checkpoint rows.
The hotel row is Ready to deploy, which means contributors and site access are set up and capture starts once a spec is signed. The three checkpoint rows are Available on request. Either way the timeline is quoted against your spec before capture begins, and on-demand top-ups run against the same accept criteria.
At a glance
Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.
Catalog rows
| Setting | Catalog task and description | Skill | Capture mode | Status |
|---|---|---|---|---|
| Hotel & Lodging | Luggage Handling: load guest luggage onto a trolley, move it through the hotel and deliver it to the room | Easy | Phone (head-mounted) / multiview rig | Ready to deploy |
| Mock Security Checkpoint | Baggage load to belt: load bags to a belt at pitch | Medium | Multiview rig + handheld grippers | Available on request |
| Mock Security Checkpoint | Bag search + re-pack: open, inspect, and re-pack a bag | Medium | Multiview rig + handheld grippers | Available on request |
| Mock Security Checkpoint | Baggage tag scan: scan a bag tag and route | Easy | Multiview rig + handheld grippers | Available on request |
Adjacent rows
| Row | Where it sits | Why it is not counted |
|---|---|---|
| Room Turnover & Inspection | Hotel & Lodging | Resets the room after checkout; it does not name bags |
| Load screening trays | Mock Security Checkpoint | Places bags and loose items into bins; it is tray work |
| Package inspection | Mock Security Checkpoint | Opens and reseals a package, not a bag |
| Divest + re-collect | Mock Security Checkpoint | Divests belongings and re-collects them; no bags named |
| Scan + sort parcels | Warehouse Zone | Parcel work in a logistics setting |
Capture setup
| Part | Hotel luggage row | Mock checkpoint bag rows |
|---|---|---|
| Catalog capture mode | Phone (head-mounted) / multiview rig | Multiview rig + handheld grippers |
| What is recorded | First-person view of real work on site; synchronized third-person angles when the spec asks | A staged working set recorded by a multiview rig while the operator uses handheld grippers |
| Setting | A hotel; no property, brand or city is named | Screening bins, a belt, a wand, a mannequin and bag props; no live airport |
| Status | Ready to deploy | Available on request |
| Sync and calibration, rig tier | The same rules where the multiview rig is used | One PTP clock domain; calibrated twice per session; accepted only if RMS reprojection stays under 0.28 px |
| Camera count, resolution, frame rate | Not stated | Not stated |
Streams and labels
| Stream or label | What it gives a baggage episode | Status |
|---|---|---|
| RGB and depth | Keeps bags, trolley or belt, and hands on one timeline | Stated; ten streams synced under 2 ms |
| 3D hand pose, per-joint visibility | Carries how fingers grip a handle, a tag or a bag opening | Stated for custom collections |
| Contact and grasp events | Marks when a hand meets a handle, trolley or bag | Stated |
| Action segments (start_ns, end_ns, verb, noun) | One labeled span per step, such as load, move, deliver, scan, open or re-pack | Stated; frame-accurate |
| Consent artefact IDs and anonymization record | Provenance per episode | Delivered |
| Luggage or bag weight, size, contents | Not among the listed streams | Not stated |
| Tag type, scanner or routing result | Not among the listed streams | Not stated |
| Belt speed, bag counts, cycle times, throughput | Not listed | Not stated |
| Contact force, tactile readings, success labels | Not among the listed streams | Not stated |
| Robot or teleoperation data | Human first-person demonstrations only | Not captured |
Formats
| Format | What the official documentation states | Used for here |
|---|---|---|
| RLDS | A dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README) | Episode-based training loaders |
| LeRobot | LeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation) | LeRobot dataset format and tooling |
| WebDataset | Tar files in which files that belong together share a basename, split into numbered shards (WebDataset README) | Sharded streaming for large training runs |
| HDF5 and zarr | Stated by Firsthand only | Array storage for custom pipelines |
| Rerun .rrd | Stated by Firsthand only | Multi-stream synchronized playback for review |
FAQ
Sources
Tell us the luggage and bag tasks, the settings and the sequence your policy needs to handle. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.