Commercial collection · Environments
Western Commercial Environments for Robotics Data Collection
Every commercial activity Firsthand can capture first-person, organized by sector and environment, with the live status of each task.
- Tasks
- 526
- Environments
- 67
- Sectors
- 18
- Settings
- Western commercial
Catalog
What is the commercial environment catalog?
It is the list of real commercial work Firsthand records as egocentric video for robot learning: who is doing the task, where, and with what. Each environment links to a page with every task, its skill level, the capture setup and its status. In data-planning terms it is a task taxonomy: a map of what a dataset can cover.
Labs use it to scope a custom collection fast: pick the environments and tasks your model is missing, then turn them into a written spec. The scoping guide walks through that step by step.
| Status | Meaning | Tasks |
|---|---|---|
| Active collection | Recording in this environment is running now, so a spec can join an existing capture stream. | 83 |
| Ready to deploy | Contributors and site access are set up; capture starts once a spec is signed. | 146 |
| Available on request | Scoped and recruited to spec when a buyer asks for it. | 297 |
Sectors
Which commercial sectors are covered?
| Sector | Environments | Tasks | Active | Ready | On request |
|---|---|---|---|---|---|
| Agriculture & Grounds | 4 | 37 | 12 | 10 | 15 |
| Automotive & Transport | 2 | 31 | 20 | 11 | 0 |
| Beauty & Personal Care | 1 | 14 | 9 | 2 | 3 |
| Construction & Trades | 4 | 43 | 11 | 15 | 17 |
| Creative Workshops & Crafts | 7 | 36 | 0 | 6 | 30 |
| Education & Childcare | 2 | 5 | 0 | 0 | 5 |
| Facilities & Cleaning | 2 | 20 | 12 | 8 | 0 |
| Food & Beverage | 6 | 42 | 9 | 12 | 21 |
| Healthcare & Life Sciences | 8 | 55 | 0 | 0 | 55 |
| Hospitality & Events | 3 | 38 | 0 | 26 | 12 |
| Logistics & Warehousing | 3 | 32 | 0 | 14 | 18 |
| Manufacturing & Workshops | 10 | 79 | 7 | 31 | 41 |
| Office & IT | 3 | 30 | 0 | 0 | 30 |
| Pet & Animal Care | 2 | 7 | 2 | 0 | 5 |
| Public Spaces & Outdoor | 3 | 16 | 0 | 1 | 15 |
| Repair Services | 2 | 7 | 1 | 0 | 6 |
| Retail & Consumer Goods | 4 | 31 | 0 | 10 | 21 |
| Sports, Recreation & Wellness | 1 | 3 | 0 | 0 | 3 |
Sector
Which agriculture & grounds environments can be captured?
4 environments, 37 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Farm & Field Operations | Farm fieldwork, greenhouse, orchard, vineyard -- harvesting, planting, pruning, irrigation, equipment operation | 21 | 11 active collection, 10 ready to deploy |
| Greenhouse, Nursery & Garden Centre | Greenhouse / grow-bench set: pots, trays, plants, shears, stakes, crates | 12 | 12 available on request |
| Landscaping & Groundskeeping | Commercial grounds, parks, corporate campuses, golf courses | 1 | 1 active collection |
| Produce Packing Facility | Farm packhouse with sorting tables, weighing stations and packing lines | 3 | 3 available on request |
Sector
Which automotive & transport environments can be captured?
2 environments, 31 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Auto Service Center & Tire Shop | Car garage, dealership service bay, oil change, tire rotation, brake work, vehicle diagnostics | 23 | 12 active collection, 11 ready to deploy |
| Car Wash & Detailing | Car wash bays, detailing shop, polishing stations | 8 | 8 active collection |
Sector
Which beauty & personal care environments can be captured?
1 environment, 14 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Hair Salon, Barbershop & Beauty Studio | Hair salon, barbershop, nail studio, beauty spa -- cutting, coloring, styling, nail treatments, workspace sanitation | 14 | 9 active collection, 2 ready to deploy, 3 available on request |
Sector
Which construction & trades environments can be captured?
4 environments, 43 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Active Construction Site | Active construction site, carpentry, electrical installation, plumbing, drywall, tiling, painting | 15 | 11 active collection, 4 ready to deploy |
| On-Site Home Repair (professional trades in a client's home) | Professional plumber, electrician, HVAC technician, or handyman working in a client's home | 4 | 4 available on request |
| Trade Service Calls (Plumbing / HVAC / Electrical) | Plumber, electrician or HVAC crew on service calls at client sites | 11 | 11 ready to deploy |
| Trades Workshop Bench | Workshop bench with hand and power tools: wrenches, drivers, drill, saw, clamps, fasteners | 13 | 13 available on request |
Sector
Which creative workshops & crafts environments can be captured?
7 environments, 36 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Art Studio (painting, sculpture, printmaking) | Artist studio, canvas painting, sculpting, mural work, printmaking | 4 | 4 available on request |
| Glass & Mosaic Studio | Glassblowing studio, stained glass, mosaic tiling, glass etching | 4 | 4 available on request |
| Jewelry & Metalsmithing Studio | Goldsmith bench, gem setting, wire wrapping, soldering, engraving, polishing | 5 | 5 available on request |
| Leathercraft Workshop | Leather tooling, hand-stitched goods, saddlery, leather bag/wallet making | 4 | 4 available on request |
| Pottery & Ceramics Studio | Pottery studio, wheel throwing, hand-building, glazing, kiln firing, ceramic sculpting | 5 | 5 available on request |
| Textile Arts & Stitching Studio | Hand embroidery, tailoring studio, quilting, needlepoint, custom garment fitting, hemming | 9 | 6 ready to deploy, 3 available on request |
| Woodcraft & Carving Studio | Woodturning, wood carving, marquetry, furniture crafting, whittling | 5 | 5 available on request |
Sector
Which education & childcare environments can be captured?
2 environments, 5 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Childcare & Early Education | Daycare center, preschool, nursery -- toy and material organization, feeding, low-angle child interactions, classroom setup | 4 | 4 available on request |
| School & Training Facility | Classrooms, training centres, first-aid and vocational training rooms | 1 | 1 available on request |
Sector
Which facilities & cleaning environments can be captured?
2 environments, 20 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Commercial Cleaning & Janitorial | Office building, shopping mall, airport, industrial facility -- mopping, vacuuming, surface sanitizing, restroom cleaning | 15 | 8 active collection, 7 ready to deploy |
| Commercial Laundry & Linen Service | Commercial laundromat, hotel linen facility, dry cleaner, hospital linen service -- sorting, washing, folding, pressing | 5 | 4 active collection, 1 ready to deploy |
Sector
Which food & beverage environments can be captured?
6 environments, 42 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Cafe, Bar & Beverage Service | Coffee shop, juice bar, cocktail bar, hotel bar | 1 | 1 available on request |
| Catering & Event Kitchen | Hotel banquet kitchen, airline catering, hospital canteen, stadium concessions, event catering facility | 3 | 3 available on request |
| Fast Food & Quick Service Kitchen | Burger chain, fried chicken, pizza counter, sandwich shop, fast-casual kitchen | 3 | 3 available on request |
| Food & Beverage Manufacturing Plant | Packaged food factory, bottling plant, meat processing facility, ready-meal production line | 8 | 8 ready to deploy |
| Restaurant & Commercial Kitchen | Sit-down restaurant kitchen, café, coffee shop, artisan bakery, patisserie | 13 | 9 active collection, 4 ready to deploy |
| Working Kitchen Set (food prep) | Stovetop, counter, sink, dishwasher, utensils, food props | 14 | 14 available on request |
Sector
Which healthcare & life sciences environments can be captured?
8 environments, 55 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Care Room (assistive care) | Care room: bed, tray table, linens, participant or mannequin | 12 | 12 available on request |
| Dental Clinic | Dental clinic, orthodontic practice, oral surgery center -- instrument handling, patient preparation, tray setup, suction and irrigation, and post-procedure cleaning | 5 | 5 available on request |
| Dental Lab & Medical Device Workshop | Dental laboratory, sterile processing, medical device assembly | 2 | 2 available on request |
| Hospital & Clinical Care | Patient room prep, equipment setup, specimen handling, surface decontamination -- requires HIPAA compliance | 5 | 5 available on request |
| Nursing Home & Assisted Living | Nursing home, assisted living facility, hospice, memory care unit -- resident mobility assistance, feeding, medication handling, personal hygiene care, and room preparation. | 5 | 5 available on request |
| Pharmacy & Laboratory | Medication dispensing, liquid handling, pipetting, labeling, safety protocol adherence -- requires regulatory compliance | 7 | 7 available on request |
| Physiotherapy & Rehabilitation Clinic | Physiotherapy clinic, rehabilitation center, sports medicine facility -- assisted stretching, therapeutic exercise, mobility support, balance training, and rehabilitation equipment operation | 5 | 5 available on request |
| Wet Lab & Clinical Bench | Burette, pipettes, balance, labware, phantom for any invasive step | 14 | 14 available on request |
Sector
Which hospitality & events environments can be captured?
3 environments, 38 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Event Venue | Conference halls, wedding venues, stages and banquet rooms | 8 | 8 ready to deploy |
| Hospitality Service Set (table, bar, room) | A table, a counter/bar, and a housekeeping/room area | 12 | 12 available on request |
| Hotel & Lodging | Hotel guest room servicing, resort housekeeping, bed-making, linen changes, bathroom cleaning, amenity restocking | 18 | 18 ready to deploy |
Sector
Which logistics & warehousing environments can be captured?
3 environments, 32 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Last-Mile Delivery & Courier | Parcel delivery, food delivery, courier services, postal sorting and drop-off | 4 | 4 available on request |
| Warehouse & Distribution Center | E-commerce fulfillment hub, distribution center, cold storage facility, freight warehouse | 14 | 14 ready to deploy |
| Warehouse Zone (conveyor, racking, pallets, pack bench) | Conveyor, racking, pallets, totes, a pack bench and scale | 14 | 14 available on request |
Sector
Which manufacturing & workshops environments can be captured?
10 environments, 79 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Carpentry & Furniture Workshop | Joinery and furniture workshop with saws, sanders and finishing stations | 11 | 7 active collection, 4 ready to deploy |
| Deformables & Textiles Bench | Cloth-and-cable bench: garments, towels, cables, form boards, bags | 12 | 12 available on request |
| Electronics Manufacturing & E-Waste | Circuit board assembly, device manufacturing, component soldering, e-waste disassembly and sorting | 4 | 4 available on request |
| Heavy Industry & Fabrication | Metal fabrication, woodworking, glass manufacturing, concrete plant, welding workshop | 5 | 5 available on request |
| Metal Fabrication & Welding Workshop | Metal shop with welding bays, grinders, cutting and fitting benches | 11 | 10 ready to deploy, 1 available on request |
| Plastic & Light-Assembly Manufacturer | Consumer goods assembly, packaging operations, labeling, quality inspection on a production line | 15 | 15 ready to deploy |
| Precision Assembly Bench (electronics) | Assembly bench: PCB/electronics, fasteners, fixtures, solder/crimp tools, small parts | 15 | 15 available on request |
| Print & Packaging Plant | Printing presses, die-cutting, folding and packaging lines | 1 | 1 ready to deploy |
| Recycling & Waste-Transfer Facility | Sorting lines, baling, material recovery | 1 | 1 ready to deploy |
| Textile & Apparel Production | Garment factory, sewing workshop, fabric cutting facility, textile mill, fashion manufacturing | 4 | 4 available on request |
Sector
Which office & it environments can be captured?
3 environments, 30 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Data Center & IT Hardware Bench | Server rack plus hardware bench: modules, cabling, drivers | 12 | 12 available on request |
| Office & Professional Services | Corporate office, co-working space, reception area -- desk work, printing, filing, scanning, coffee machine, mail handling | 6 | 6 available on request |
| Office Document Station | Desk-and-document station: printer/tray, binders, stapler, label maker, mailers | 12 | 12 available on request |
Sector
Which pet & animal care environments can be captured?
2 environments, 7 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Pet Grooming Salon | Pet grooming salon with washing tubs, grooming tables and drying stations | 2 | 2 active collection |
| Veterinary Clinic | Animal handling, examination room prep, surgical instrument setup, kennel cleaning, post-procedure care | 5 | 5 available on request |
Sector
Which public spaces & outdoor environments can be captured?
3 environments, 16 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| City Streets, Shops & Public Transit | Sidewalks, shops, markets, buses, metro and train stations | 3 | 3 available on request |
| Mock Security Checkpoint | Screening bins, a belt, a wand, a mannequin, bag props (no live airport) | 12 | 12 available on request |
| Outdoor Work Sites | Parks, grounds, outdoor markets, sports fields, exterior building work | 1 | 1 ready to deploy |
Sector
Which repair services environments can be captured?
2 environments, 7 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Electronics & Device Repair Shop | Phone, laptop and consumer electronics repair counter | 1 | 1 active collection |
| Repair Shop (appliance, bicycle, shoe, watch, furniture) | Electronics repair, appliance workshop, bicycle shop, shoe repair, watch repair, furniture restoration | 6 | 6 available on request |
Sector
Which retail & consumer goods environments can be captured?
4 environments, 31 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Grocery & Supermarket | Supermarket, convenience store, wholesale club, produce market, pharmacy retail floor | 4 | 4 available on request |
| Retail Floor Set (shelving, checkout, rail, pack bench) | Shelving, a checkout, a garment rail and a pack bench | 12 | 12 available on request |
| Retail Store -- Back of House | Stockroom, receiving dock and backroom of supermarkets, apparel and general retail | 10 | 10 ready to deploy |
| Retail Store -- Front of House | Clothing store, electronics shop, furniture showroom, sporting goods, bookstore, department store | 5 | 5 available on request |
Sector
Which sports, recreation & wellness environments can be captured?
1 environment, 3 tasks.
| Environment | Typical settings | Tasks | Status |
|---|---|---|---|
| Gym & Fitness Studio | Commercial gym, yoga studio, group fitness space -- equipment setup, floor cleaning, weight rack organization | 3 | 3 available on request |
Capture setup
How is each environment captured?
| Setup | How it works |
|---|---|
| Phone (head-mounted) / multiview rig | A head-mounted phone records the first-person view of real work on site; a multiview rig adds synchronized third-person angles when the spec asks for them. |
| Multiview rig + handheld grippers | A staged working set recorded by a multiview rig while the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector. |
Every take passes the same gates before it is billed: spec fit, consent, sync on the rig tier, and human-reviewed anonymization.
Western markets
Which Western markets are recruited?
Contributors are recruited to spec in North American and European program markets, so footage reflects how the work is done in Western businesses. Country pages show the legal basis and status per market.
FAQ
Western commercial environments, answered.
- Which commercial environments can Firsthand collect robotics data in?
- 67 Western commercial environments across 18 sectors, including agriculture & grounds, automotive & transport, beauty & personal care, construction & trades, creative workshops & crafts. Each environment page lists every catalog task with its status.
- What does "Western" commercial environment mean?
- Work settings, equipment, packaging and signage as found in North American and European businesses, recruited to spec in program markets such as the United States, Canada, the United Kingdom and Germany.
- Can I request a task that is not in the catalog?
- Yes. The catalog is a starting point. A written spec sets the tasks, environments, capture tier, annotation depth and accept criteria, and unlisted tasks are scoped against it.
- How fast can a commercial collection start?
- A median of 48 hours from signed spec to first validated batch where coverage is deep, such as environments in active collection. Thin environments are quoted for timeline before capture begins.
- What formats is the data delivered in?
- RLDS, LeRobot, WebDataset, HDF5, zarr and Rerun .rrd, each mapped to the same canonical episode schema, under a buyer-owned commercial licence.
Sources
Where are the delivery formats documented?
- RLDS (opens in a new tab)Reinforcement Learning Datasets format specification.
- LeRobot (opens in a new tab)LeRobot dataset format documentation.
Need footage from a commercial environment?
Pick the environments and tasks your model is missing. We quote reach, timeline and price against one written spec, starting with a Spec Pilot.