A named delivery task list
Pickup and drop-off, carrying a parcel to the door and handing it to the recipient are different sequences, so a spec names each one.
Task family
Requirements
Pickup and drop-off, carrying a parcel to the door and handing it to the recipient are different sequences, so a spec names each one.
A head-mounted view keeps both hands, the parcel and the person receiving it in view through the carry and the hand-over.
3D hand pose with per-joint visibility carries the grip on a parcel while walking and the release at hand-over.
Frame-accurate action segments mark where loading ends, where the carry starts and where the hand-over happens, aligned to video and depth.
A perpetual, buyer-owned commercial license backed by a documented consent chain.
Why it matters
Egocentric last-mile package delivery video data is real-world, first-person video of a courier doing the final leg of a delivery: sorting parcels in a vehicle, carrying one to a door, scanning it and handing it to the recipient. It is recorded from the courier viewpoint, with depth, 3D hand pose, contact events and frame-accurate action segments aligned on one hardware clock.
Delivery differs from warehouse work because it ends with a hand-over to a person. The box and parcel handling page and the logistics fulfillment page cover warehouse, dock and fulfillment work. This page covers the delivery end of the chain, where the parcel leaves the vehicle and reaches a recipient.
Setting
The site states delivery in its task catalog, in a Last-Mile Delivery & Courier environment under the Logistics & Warehousing sector. The environment lists four rows: Courier pickup and drop-off, Food delivery, Parcel delivery and Postal sorting. Its examples are parcel delivery, food delivery, courier services, postal sorting and drop-off.
Every row is rated Easy, listed as Available on request and uses the same capture mode, a head-mounted phone or a multiview rig. Two rows describe delivering a parcel to a recipient, one describes delivering a food order, and one is sorting.
Parcel delivery
The catalog row reads "Sort parcels in the van, carry them to the door, scan and hand them to the recipient." It is the clearest stated last-mile delivery task, because it names the carry to the door and the hand-over to a recipient.
The row says "the van" and "the door", and no more. Vehicle types, package sizes and weights, and door or building access details are Not stated, so they are set in the written spec.
Pickup and drop-off
The catalog row reads "Scan and collect parcels at pickup, load the vehicle and hand them over at drop-off." It covers the start of a route, where parcels are collected and loaded, as well as the hand-over at the end.
The row is listed as Available on request, so its timeline is quoted against your spec. The site does not state how many drop-offs a session covers or how long a route runs.
Food delivery
The Food delivery row reads "Collect a food order at the restaurant, bag it in an insulated carrier and deliver it." The site lists it in the same environment, but it describes an order, not a parcel, so this page lists it as neighbouring work and does not count it as package delivery.
It is the only row that names a restaurant or an insulated carrier. The site does not state how the final hand-over of a food order is captured.
What is not delivery
The Postal sorting row reads "Sort letters and parcels by route into pigeonholes and trays at the sorting bench." It is sorting at a bench and names no carry or hand-over, so it stays a neighbour.
Warehouse, fulfillment and parcel-handling rows, such as scanning, palletizing, packing and totes, sit in other environments and have their own pages. They do not name a delivery to a recipient or a door.
Environments
The catalog places all four rows in the Last-Mile Delivery & Courier environment. The site names no city, neighbourhood, route, carrier or courier, and it does not state capture on a customer own delivery routes or at a customer own facility.
Environment, access and schedule are agreed in the spec. Route lengths and the number of couriers or sites are Not stated.
Capture setup
A head-mounted phone records the first-person view of real work on site, and a multiview rig adds synchronized third-person angles when the spec asks for them. Both are the capture modes the catalog lists for every last-mile row.
The site does not state a camera count, resolution or frame rate for delivery. GPS or location traces are Not stated, so raise them in the spec if your policy needs them.
Streams and labels
Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact and grasp events, and frame-accurate action segments. For delivery, hand pose tracks the grip on a parcel and the release at hand-over, contact events mark when fingers meet a parcel, and action segments mark each step.
Object labels use the terms your spec sets. Package sizes and weights, force or tactile data, and a delivery-outcome or task-completion label are Not stated. They are defined in the spec if your policy needs them.
Delivery
Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. The format table below sets each against what its official documentation states. Delivery episodes use the same schema as every other Firsthand collection, so a loader that reads another Firsthand dataset reads this one without changes.
Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch.
Privacy
Every episode links to a signed contributor release through a documented consent chain, and the consent record is part of the delivery. Faces, plates and screens are detected and irreversibly blurred at ingest, and a reviewer confirms the result before anything ships. The anonymization record is delivered with the data.
The anonymization page states that egocentric capture happens in real homes, workplaces and semi-public spaces, so bystanders end up in frame, and that the pass removes them before anyone downstream sees the footage. The site also states that a clip where a bystander cannot be de-identified is discarded rather than shipped. It does not state a rule for house numbers or addresses, street signs or traffic safety, so this page makes no claim on them.
Fast · on demand
Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front.
On-demand top-ups run against the same spec and accept criteria after each training run. All four last-mile rows are Available on request, so the site states no capture timeline for them beyond a quote against your spec.
The spec
You describe the parcels, hand-overs and sequence your policy needs. We turn that into a written spec covering tasks, environments, capture tier, annotation depth and accept criteria, then quote reach, timeline and price before any capture begins.
A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Billing is per validated hour, a reject log ships with every batch, rejected items are recaptured at our cost, and every collection ships under a perpetual, buyer-owned commercial license.
At a glance
Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.
What the site states
| Where it appears | What the site states | Used on this page as |
|---|---|---|
| Task catalog, Last-Mile Delivery & Courier environment | Four rows, all Easy and Available on request: Courier pickup and drop-off, Food delivery, Parcel delivery and Postal sorting | The stated delivery tasks and two neighbours |
| Anonymization page | Capture happens in real homes, workplaces and semi-public spaces, so bystanders end up in frame | The only public-space wording used |
| Anonymization and delivery terms | Faces, plates and screens are irreversibly blurred at ingest and a reviewer confirms the result | The privacy pass applied to every episode |
| Site FAQ | A clip where a bystander cannot be de-identified is discarded rather than shipped | The stated bystander rule, quoted as the site states it |
Catalog rows
| Task family | Catalog task and description | Skill | Status |
|---|---|---|---|
| Parcel delivery | Parcel delivery: sort parcels in the van, carry them to the door, scan and hand them to the recipient | Easy | Available on request |
| Pickup and drop-off | Courier pickup and drop-off: scan and collect parcels at pickup, load the vehicle and hand them over at drop-off | Easy | Available on request |
| Neighbour, food | Food delivery: collect a food order at the restaurant, bag it in an insulated carrier and deliver it | Easy | Available on request |
| Neighbour, sorting | Postal sorting: sort letters and parcels by route into pigeonholes and trays at the sorting bench | Easy | Available on request |
Streams and labels
| Item | Status on this site | Why it matters for last-mile delivery |
|---|---|---|
| Head and wrist RGB, depth | Stated; ten streams synced under 2 ms | Keeps the parcel, the door and the hands on one timeline |
| 3D hand pose, per-joint visibility | Stated | Carries the grip on a parcel and the release at hand-over |
| Contact and grasp events | Stated | Marks when fingers meet a parcel |
| Action segments | Stated; frame-accurate | Separates loading, carrying and handing over |
| Vehicle types, package sizes or weights | Not stated; rows name a van, parcels and a food order only | Defined in the spec |
| Route lengths, cities or neighbourhoods | Not stated | Defined in the spec |
| Number of couriers or sites | Not stated | Defined in the spec |
| GPS or location traces, door or building access details | Not stated | Raised in the spec before capture |
| Throughput, force or tactile data | Not stated | Defined in the spec if needed |
| Delivery-outcome or task-completion label | Not stated | Defined in the spec if needed |
Formats
| Format | What the official documentation states | Used for here |
|---|---|---|
| RLDS | A dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README) | Episode-based training loaders |
| LeRobot | LeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation) | LeRobot dataset format and tooling |
| WebDataset | Tar files in which files that belong together share a basename, split into numbered shards (WebDataset README) | Sharded streaming for large training runs |
| HDF5 and zarr | Stated by Firsthand only | Array storage for custom pipelines |
| Rerun .rrd | Stated by Firsthand only | Multi-stream synchronized playback for review |
FAQ
Sources
Tell us the parcels, hand-overs and sequence your policy needs to handle. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.