Egocentric Envelope Stuffing and Mailer Packing Data

Egocentric envelope stuffing and mailer packing data is real-world video of a person preparing outgoing mail at a desk: putting documents into an envelope and sealing it, and packing a mailer and taping it shut. The footage shows the hands, the sheets, the envelope or mailer and the surface under them. Alongside the video, each episode follows the Firsthand episode schema, with depth, 3D hand pose, contact events and frame-accurate action segments aligned on one hardware clock.

Teams search for it under several names, including envelope stuffing robot training data, egocentric mailer packing video, an office mail prep dataset and custom office data collection. They all describe demonstrations of the same two desk jobs, collected to a written spec. This page covers only what the Firsthand site states about them, and marks everything else as Not stated.

Two rows in the site task catalog cover this work, both in the Office Document Station environment. The first is "Stuff + seal envelopes", described as "Insert documents and seal envelopes." and rated Medium. The second is "Pack + tape mailer", described as "Pack a mailer and tape it shut." and rated Easy. Both use a multiview rig with handheld grippers, and both are listed as Available on request.

Anything outside those two rows is Not stated. That includes folding or inserting a letter in a particular way, addressing or labeling an envelope, franking or weighing a letter, choosing a mailer size, and any named type of envelope, mailer or tape, so none is claimed here. If your policy needs one of them, you write it into the spec and we scope it, because the catalog rows are a starting vocabulary, not a fixed menu.

The site defines Available on request as work that is scoped and recruited to spec when a buyer asks for it. Neither row is listed as Active collection or Ready to deploy, so the site does not say that an envelope or mailer capture stream is running today. A first batch is therefore quoted against your spec rather than drawn from a stream that already exists.

The site does not list an off-the-shelf envelope, mailer or office mail dataset either, so this is custom collection. Where the site states what is in stock, it says off-the-shelf covers what is already in stock and custom collection covers the rest: custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.

The site describes the Office Document Station as a desk-and-document station with a printer and tray, binders, a stapler, a label maker and mailers. It is a staged working set, not a described real workplace. The site contrasts it with the Office and Professional Services environment, whose rows use a head-mounted phone and include a Mail handling row for opening, sorting and distributing incoming mail and preparing outgoing letters and parcels.

The site names no office, company or building, and does not state the number of sites, the regions or the venue type. It does not state capture at a customer own facility either. Environment, access and schedule are agreed in the written spec.

The catalog states one capture mode for both rows: a multiview rig with handheld grippers. The site describes it as a staged working set recorded by a multiview rig while the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector. The site also states that every sensor in a multiview rig, meaning the head camera, both wrist cameras, depth and the IMU, is hardware-triggered from a single PTP grandmaster clock.

The site does not state a head-mounted capture mode for these two rows, so this page does not claim one, and it does not claim that a stereo pair is running on them. Stereo capture is a general Firsthand offer that is agreed in the skill spec. A per-environment stream list is Not stated, so which of the ten streams an order carries is decided in the spec. Camera count, resolution, frame rate, desk layout, paper volume and the type of envelope or mailer are Not stated, so raise any of them in the spec.

The site already has a mailroom and document handling page that names stuffing and sealing envelopes in a longer list of mail, filing, scanning and collating jobs, and a packing and kitting page that names a mailer in a longer list of packing jobs. This page narrows to the two Office Document Station rows that cover envelopes and mailers, and it describes the capture mode those rows use. The comparison table below sets each neighbor against this page.

A buyer who needs the whole mail workflow, including opening and sorting incoming mail, starts from the mailroom page. A buyer who needs cartons, bundles, weighing and sealing or kitting starts from the packing page. A buyer whose policy ends at a stuffed and sealed envelope or a taped mailer on a desk starts here.

Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact and grasp events, and frame-accurate action segments. Inserting a sheet and closing a flap are contact events with a hand covering part of the work, and the site pairs them with 3D hand pose that carries per-joint visibility, contact events on grasp and release, an IMU on one clock and action segments.

Object labels use the terms your spec sets. Paper sizes, stock, envelope types, mailer types and tape types are Not stated. Task durations, cycle times and the number of episodes are Not stated too. Success or quality labels, such as whether an envelope is fully sealed or a mailer is fully taped, are Not stated, as are certifications and robot results. The site makes no safety-compliance claim for this work.

The catalog rates "Stuff + seal envelopes" Medium and "Pack + tape mailer" Easy, so the site does not call either one Hard, and this page makes no claim about robot results. What the site does say is where paper work is difficult to capture. It describes paper as thin and flexible, so a sheet changes shape every time it is touched. It also notes that for paper work a hand often covers the sheet or flap, which is why close-range wrist views and hand pose with per-joint visibility are paired with it.

The viewpoint matters too. The site states that a robot or humanoid perceives from a head- or wrist-mounted camera, not a static overhead shot, and that egocentric capture matches that geometry. The two rows here are recorded by a multiview rig, so the geometry a buyer receives is the one the rig and the spec define.

A good spec treats each named job as its own task. Stuffing and sealing an envelope and packing and taping a mailer each get a start state, an end state and a set of accept criteria. For the envelope, a spec can say what counts as inserted and what counts as sealed; for the mailer, what counts as packed and what counts as taped shut. Naming the two end states keeps action segments consistent across contributors and lets you ask for more of one job without re-collecting the other.

The same station also lists a Staple + collate sets row and a Sort into folders row, and a spec can chain them into one mail preparation sequence if your policy needs the whole run. Whether such chained sequences are collected as one episode or several is agreed in the spec.

Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. These episodes use the same schema as every other Firsthand collection, so a loader that reads another Firsthand dataset reads this one without changes. The format table below sets each format against what its official documentation states.

Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch. Rejected items are recaptured at our cost, and billing is per validated hour.

Every episode links to a signed contributor release through a documented consent chain, and the consent record is part of the delivery. A vision model runs on every frame at ingest, flagging faces, heads, licence plates and any legible screen or document. The site describes the documents class as phone and monitor content, forms, badges and mail that would leak names, addresses or account data. Those regions are irreversibly blurred, and a human reviewer confirms the result before footage ships.

If the reviewer is unsure a region is fully covered, the episode is held or discarded, never downgraded and shipped. So legible names, addresses and document content are not in the delivered pixels, which matters for a task whose whole subject is paper that goes into an envelope. If your pipeline needs document content, raise it before the spec is signed; whether any engagement can keep specific content is Not stated. The site states no other privacy, compliance or legal terms for this work, and no in-home capture.

Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front. The site does not state how deep coverage is for these two rows, and they are Available on request, so plan on a quote rather than assuming the 48 hour figure.

The site also states program milestones. A pilot reaches its first delivery in two to three weeks, and a standing program reaches full rate in four to six weeks. Those assume capture coverage is already in place. On-demand top-ups run against the same spec and accept criteria after each training run. A batch size and a later-batch turnaround are Not stated, so both are quoted against your spec.

You describe the envelope and mailer jobs, the environment and the sequence your policy needs. We turn that into a written spec covering tasks, environments, capture tier, annotation depth and accept criteria, then quote reach, timeline and price before any capture begins. This is the custom egocentric data collection route that every Firsthand task family follows.

A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Every collection ships under a perpetual, buyer-owned commercial license, with a reject log and signed accept criteria on every batch.