Egocentric Medication Sorting and Dispensing Data

Egocentric medication sorting and dispensing data is first-person video of a person handling medication packs and containers, recorded from their own point of view with synchronized sensor streams alongside. The camera sits on the head, close to what a robot’s onboard camera would see at a tray table or a pharmacy counter, so the frames show what the hands do with each blister pack, cup or label rather than a distant view of a room. Teams searching for medication handling robot training data, a pharmacy dispensing video dataset or egocentric medication pack sorting data are usually looking for this: footage of hands sorting, checking, counting, packaging and labeling, tied to labels.

On this site the data is human capture: a paid, consented contributor wears the rig and performs a task from a written skill spec. It is not robot or teleoperation data. It is custom care and pharmacy task data collection rather than a ready-made library, because every row on this page is Available on request. This page pulls rows from three catalog environments into one place.

The task catalog states three rows whose names are about medication, all in the Healthcare & Life Sciences sector. In Care Room (assistive care), Sort medication packs reads "Sort blister packs into an organizer." and is rated Easy. In Nursing Home & Assisted Living, Medication handling reads "Check the medication chart, pop tablets from packs into cups and record what was given." and is rated Medium. In Pharmacy & Laboratory, Medication dispensing reads "Read the prescription, count or measure the medication, package and label it." and is rated Medium.

A fourth row is adjacent rather than medication-specific. Labeling, also in Pharmacy & Laboratory and rated Easy, reads "Print and apply labels to tubes, bottles and dispensed medication and check them." It covers tubes and bottles as well as dispensed medication, so this page lists it separately and does not count it as a medication row. The first table below gives each row exactly as the catalog words it.

The nursing home and pharmacy rows use a head-mounted phone or a multiview rig; Sort medication packs uses a multiview rig with handheld grippers. All are Available on request, meaning the work is scoped and recruited to spec when a buyer asks. The catalog names no medication, pack type or organizer, so this page does not either.

Several things a reader might expect are not rows. The catalog has no row for a medication cart or trolley, an automated dispensing cabinet, scanning a medication barcode, or handling controlled substances. Counting tablets is not its own row either: the dispensing row says to count or measure the medication.

So this page scopes a custom spec; it does not claim those sub-tasks are rows. Anything beyond the rows, including medication names, packaging types, chart formats and the order of steps, is written into the skill spec and quoted before capture. The site states none of them.

Those pages are organized by environment. The pharmacy and lab bench page covers the seven Pharmacy & Laboratory rows and the fourteen Wet Lab & Clinical Bench rows, including pipetting and liquid handling. The elder care page covers the five Nursing Home & Assisted Living rows, of which Medication handling is one. The hospital and clinical care page covers a different environment.

This page cuts across three environments and keeps only the rows about sorting, handling and dispensing medication. If your program is about the whole bench or the whole care shift, start from the environment page; if it is about the medication steps specifically, start here.

Each attempt is delivered as one episode. On this site the standard episode carries action segments, 3D hand pose for both hands with a per-joint visibility flag, contact events that mark when a hand meets an item, an objects list, and per-frame instance masks stored at the depth resolution of 848×480. The capture setup table below lists the stream and sync figures the site states for the instrumented tier.

The catalog lists a head-mounted phone with a multiview rig for the nursing home and pharmacy rows, and a multiview rig with handheld grippers for Sort medication packs; the ten-stream stack is the instrumented tier. Which applies is confirmed in the skill spec. Force and tactile readings are not among the listed streams.

The catalog describes the head-mounted phone as recording the first-person view of real work on site, and the multiview rig with handheld grippers as a staged working set where the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector. The site states that Firsthand does not capture at a customer’s own facility. Whether a program uses a working pharmacy, a care facility or a staged set is not stated and is agreed in the skill spec.

On people, the site’s healthcare page states that capture in healthcare settings uses training environments with simulated patients only and never captures real patient footage. The Care Room examples line reads "Care room: bed, tray table, linens, participant or mannequin". The nursing home and pharmacy rows do not say who plays the resident or the customer, so that is settled in the spec.

Every contributor signs a written release, and each delivered episode links to it through consent artefact IDs in the batch data card. At ingest, automated detection finds faces, plates and screens and blurs them irreversibly. Speech is scrubbed of names, addresses and card numbers. A human reviewer confirms that no un-consented person is identifiable in any frame, footage that cannot be de-identified is discarded, and the anonymization record ships with the data.

Medication work puts printed text in view: a chart, a prescription and a label. The site’s privacy guide names printed text such as forms, badges and mail among recurring identifiers in egocentric footage. Whether chart, prescription or label text is blurred is not stated, so it is agreed in the spec, as is who may appear next to the contributor. An undocumented bystander is a reject criterion.

The catalog notes HIPAA compliance for its Hospital & Clinical Care environment and a regulatory-compliance line for Pharmacy & Laboratory, and states nothing like it for the other rows. This page makes no regulatory, medication-safety, controlled-substance or clinical claim.

Medication work depends on sequence and on small objects. Blister packs, tablets and cups are small, and an item held between two fingers is easily hidden by the hand that holds it. That is why hand pose carries a per-joint visibility flag, why contact events mark when the hand meets the item, and why an episode is rejected if the manipulated object is out of frame for more than 15 percent of it.

Medication handling ends with a record, not a motion, and Medication dispensing bundles reading, counting or measuring, packaging and labeling in one row. The spec should name which steps you need and in what order. The challenge table below maps each difficulty to a stated stream or label.

Action segments divide an episode into start- and end-timestamped spans, each carrying start_ns, end_ns, verb and noun. For medication work, a segment might be one pack sorted, one tablet popped into a cup, one count or one label applied, as written in the skill spec.

Validation runs against signed accept criteria written into the spec before capture, and a reject log ships with each batch. Episodes are machine-checked against reject criteria, including a sync breach, calibration drift, the object out of frame for more than 15 percent of the episode, an undocumented bystander and a mismatch against the skill spec, then a human reviewer checks each one. Only footage that clears the criteria is billed as a validated hour, and rejected items are recaptured at our cost.

Delivery is in the format your stack already reads, with readable converter source alongside. The license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default, with exclusivity available as a separate term. The executed agreement controls.

From signed spec to first validated batch, the published timeline is a median of 48 hours where coverage is deep and three to four weeks where it is thin and contributors need to be recruited first. The range that applies is confirmed when the spec is quoted. At program level, a pilot runs two to three weeks to first delivery and a standing program reaches full rate in four to six weeks.

Describe the medication tasks and their order, what counts as a finished step, who may be in frame and the variation cases your pipeline is missing. That becomes a written skill spec, quoted for reach, timeline and price before capture begins. Most programs begin with a Spec Pilot, a small, fast first batch that proves the spec and accept criteria before volume scales. Collections are billed per validated hour.

Where the site is silent, this page says so. No medication name, dose, schedule, pack, organizer or cup type, venue type, cycle time, or number of sites, episodes or hours is stated for medication work, and nothing here claims a training outcome.