Pet care

Egocentric Pet Care Video Data

Bathe the pet, dry the coat, trim, brush, then clean the kennel and lay fresh bedding: pet care is a run of tool changes and gentle handling, done by hand around a living animal. We collect custom egocentric video of pet care on demand, to a written skill spec, with synchronized streams, 3D hand pose, contact events, action segments, anonymization and a buyer-owned license.
Tasks
Grooming, animal handling, kennel cleaning, as the catalog lists them
Streams
Ten, synced under 2 ms
First batch
Median 48 h in deep-coverage settings
License
Perpetual, buyer-owned

Requirements

What does pet care need that a generic animal clip does not?

01

Tool changes around one animal

The grooming row names a shampoo, a dryer, clippers and brushes, so the hands change tools in a sequence while working on the pet. The value is in the order of the steps and in which hand holds what. First-person capture keeps the hands in frame, and the two wrist cameras add a closer view. 3D hand pose carries a per-joint visibility flag, so a finger hidden behind a coat or a tool is flagged rather than guessed.

02

A clear line between what is listed and what is not

The catalog lists pet care in a grooming salon and a veterinary clinic. It lists no feeding, bowl-filling, litter or dog-walking row, and no pet care row in a home. This page says so plainly and marks those items "Not stated", so a buyer sees the real boundary before asking for a quote.

Definition

What is egocentric pet care video data?

It is first-person video of a person caring for animals, recorded from a head-mounted camera, with two wrist cameras for a closer view of the hands. The contributor is a paid, consented person following a written skill spec, not an actor and not a robot.

The point of the data is what the hands do: lifting and holding, washing, drying, trimming and brushing, then clearing and cleaning the space the animal used. It is labeled so each step can be sliced out. Where the site states nothing, a table says "Not stated" and the answer lives in the spec or the quote.

Task coverage

Which pet care tasks can be captured?

The task catalog has a Pet & Animal Care sector with two environments. In the Pet Grooming Salon, one row reads "Bathe, dry, trim, and brush pets’ coats and nails using pet shampoo, a grooming dryer, clippers, and brushes," and a second, "Pet Grooming," is described as "Washing, clipping, drying and grooming animals in a commercial grooming setting." Both are Medium and Active collection.

In the Veterinary Clinic, three rows name an animal: "Animal handling," "Kennel cleaning" and "Post-procedure care." All three are listed as Available on request. The second table lists the neighbouring rows that do not name a pet or an animal in their own text, for context only.

The site lists no row for feeding a pet, filling a food or water bowl, brushing a pet at home, walking a dog or cleaning a litter box. Ask for any of them in the spec. Its "Feeding & Watering Rounds" and "Animal Pen Cleaning & Waste Removal" rows are farm rows for livestock, so this page does not count them as pet care.

Settings and rigs

Where is pet care data captured, and on what rig?

Every pet row is listed under a commercial setting. The grooming rows sit under Pet Grooming Salon, described as a salon "with washing tubs, grooming tables and drying stations." The three animal rows sit under Veterinary Clinic, whose catalog examples are animal handling, examination room prep, surgical instrument setup, kennel cleaning and post-procedure care. All list a head-mounted phone or multiview rig.

The site’s in-home page describes capture in real, lived-in homes, with laundry, tidying, cleaning and surface reset as the listed tasks. It states no pet care row there. If you need pet care in a home, say so in the brief. The site does not otherwise state where capture happens or who hosts it, so the spec settles location and access.

Episode contents

What does each pet care episode contain?

An episode is one contributor performing one task from the skill spec, recorded with ten hardware-synchronized streams that line up within 2 ms. The site documents a canonical episode schema, and every delivery format is a view of it.

Hand pose is stored as 21 joints per hand in metres in the head frame, with a visibility flag for each joint. Contact events record when a hand meets an object. The site does not say whether an animal, a brush or a kennel counts as the object, so settle it in the spec.

Action segments carry a start, an end, a verb and a noun from a taxonomy the site states as 97 verbs and 512 nouns, human-reviewed. Every episode links to its contributor’s signed release by a consent artefact ID, and each batch ships with a data card.

Labeling

How is pet care data labeled?

The unit of labeling is the action segment. A spec that says "groom the pet" gives you one long segment. A spec that names bathe, dry, trim and brush gives you a sequence you can slice by step.

Every episode is machine-checked, then reviewed by a human against its skill spec, and rejected episodes are recaptured at our cost. The site states no label for the animal’s species, breed or behaviour, no task-completion label and no force or tactile reading, so ask for any such label at the start.

Privacy

How is privacy handled when capturing pet care in homes, salons and clinics?

Only what the site already states applies. Every contributor signs a written release, and each episode links to it. Faces and screens are detected and blurred irreversibly, a human reviewer confirms that no un-consented person is identifiable, and footage with bystanders who cannot be de-identified is discarded rather than shipped.

The site does not state how animal owners, clients or other staff in a salon or clinic are handled beyond that general rule, and it makes no animal-welfare claim. Settle both in the spec before capture. This is not legal advice, and the executed agreement controls.

Delivery

How is pet care data delivered, and who owns it?

Data is delivered in RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, or as raw streams with metadata, with the episode schema as the canonical layout. QA runs once, against the canonical episode, before any format is cut. The formats table sets the site’s delivery next to each maintainer’s own documentation, linked under Sources.

The license is perpetual, irrevocable and worldwide, buyer-owned and non-exclusive by default, with exclusivity available as a separate term and the executed order form governing.

Speed

How fast can a custom pet care dataset be collected?

The site states one published timeline: from a signed spec to a first validated batch, a median of 48 hours where coverage is already deep, and typically three to four weeks where it is thin because operators have to be staffed. The site does not say which applies to the pet care rows and promises nothing faster, so ask when you request the quote.

Getting started

How do you start a pilot?

Start with the free sample pack to check the loader and label quality, then move to a Spec Pilot: a small, fast first batch against the written spec that proves the fill rate and reject rate on your conditions before you scale.

A good pet care brief names the setting, the order of steps, how each step starts and ends, what counts as a reject and the privacy rule for the space. The site’s skill-spec guide walks through that structure. Then request a custom dataset.

Capture setup

What is the capture setup for a pet care collection?

The capture setup as stated on this site, applied to pet care. Counts of contributors and hours are set in the skill spec.
PartAs stated on this site
Head cameraGlobal-shutter 4K at 60 fps with a 120 degree lens
Wrist camerasTwo wrist-mounted cameras at 1080p and 60 fps
DepthDepth sensor at 848×480 and 30 fps, with per-frame confidence maps
IMU6-DoF at 200 Hz
SyncTen streams, hardware-triggered onto one PTP clock domain and aligned under 2 ms
CalibrationRe-solved with a checkerboard target at the start and end of every session; accepted only under the 0.28 px RMS reprojection gate
Catalog capture setupHead-mounted phone or multiview rig for every pet row
Device models and animal species or breedsNot stated

Every collection runs through the same seven-stage end-to-end custom collection pipeline.

Task catalog

Which pet care rows does the catalog name?

The five catalog rows whose own text names a pet or an animal in a grooming salon or veterinary clinic, reproduced as the catalog states them.
Task (as listed)Description (as listed)EnvironmentSkill levelStatus
Bathe, dry, trim, and brush pets’ coats and nails using pet shampoo, a grooming dryer, clippers, and brushes.Pet grooming salon with washing tubs, grooming tables, and drying stations.Pet Grooming SalonMediumActive collection
Pet GroomingWashing, clipping, drying and grooming animals in a commercial grooming setting.Pet Grooming SalonMediumActive collection
Animal handlingLift, hold and restrain animals safely on the table during examination.Veterinary ClinicMediumAvailable on request
Kennel cleaningRemove bedding and waste, hose and disinfect the kennel and lay fresh bedding.Veterinary ClinicEasyAvailable on request
Post-procedure careMonitor a recovering animal, change dressings, give fluids and clean the wound area.Veterinary ClinicMediumAvailable on request

Neighbouring rows

Which catalog rows sit next to pet care?

Rows that sit beside pet care but do not name a pet in their own text, or that concern farm animals, reproduced as the catalog states them. They are listed for context.
Task (as listed)Description (as listed)EnvironmentStatus
Examination room prepWipe the table, lay out instruments and supplies and set up the room for the next patient.Veterinary ClinicAvailable on request
Animal Pen Cleaning & Waste RemovalMuck out pens with fork and shovel, remove waste in barrows and lay fresh bedding.Farm & Field OperationsReady to deploy
Feeding & Watering RoundsWalk the pens or fields delivering feed and topping up water for the animals.Farm & Field OperationsReady to deploy

Episode fields

What fields does a pet care episode carry?

Episode fields as documented in the site’s episode schema, and what each is useful for in a pet care task.
FieldAs documentedUse for pet care
hand_joints21 joints per hand, in metres, head frameHow each hand holds a tool and steadies or lifts
hand_visibleBoolean visibility flag per jointWhich fingers are hidden behind a coat or a tool
contact_eventsTimestamp, hand, object ID and kindWhen a hand meets a brush, a clipper or a surface
instance_masksTracked object IDs per frame at 848×480Which object is which across frames
action_segmentsstart_ns, end_ns, verb, nounOne labeled span per grooming or cleaning step
depth_mm and depth_confMetric depth with a per-pixel confidence mapWhere depth can be trusted near a table or kennel
Species or breed, behaviour label, force or tactileNot statedNot stated

Delivery formats

Which formats are delivered, and what does each format’s own documentation say?

The delivery formats the site lists. The third column is taken only from the official pages linked under Sources.
FormatDelivered by FirsthandMaintainer documentation
RLDSTFDS-compatible tfrecord shards, one skill line per directoryStores episodic data; a dataset is a tf.data.Dataset of episodes, each containing a dataset of steps
LeRobotParquet plus an mp4 per camera, in the Hugging Face datasets layoutSynchronized MP4 videos or images for vision, plus Parquet files
WebDatasetListed as a delivery formatTar files in which files sharing a basename make up one training sample
HDF5, zarr and Rerun .rrdListed as delivery formatsNot described on this page

Not stated

What does the site not state about pet care?

Details a buyer may ask about and where the answer lives.
TopicOn this siteWhere it is settled
Feeding, bowl-filling, litter or dog-walking rowsNot listed in the catalogWritten skill spec
Pet care captured in a homeNot stated; the in-home page lists laundry, tidying, cleaning and surface resetWritten skill spec
Animal species, breeds and number of animals or homesNot statedWritten skill spec
Pet behaviour labelsNot statedScoped in the spec
Device modelsNot statedWritten skill spec
Force or tactile dataNot statedNot offered as a stated stream
Task-completion labelsNot statedScoped in the spec
Throughput, and which timeline applies to these rowsNot statedQuote
Animal owners or clients in frame, and animal welfareNot stated beyond the general bystander ruleSkill spec
Robot actions or teleoperation dataNot stated; Firsthand captures humans, not robotsYour own retargeting step

FAQ

Egocentric pet care video data, answered.

What is egocentric pet care video data?
Custom first-person video of people grooming, handling and caring for animals and cleaning their spaces, captured by paid, consented contributors to a written skill spec, with synchronized streams, 3D hand pose, contact events and action segments.
Which pet care tasks does Firsthand list?
Two Pet Grooming Salon rows, both Medium and Active collection, and three Veterinary Clinic rows named "Animal handling," "Kennel cleaning" and "Post-procedure care," all Available on request.
Does Firsthand list feeding a pet, a litter box or walking a dog?
No. The catalog has no row for feeding a pet, filling a bowl, cleaning a litter box or walking a dog. Its feeding and pen rows are farm rows for livestock. If you need any of these, say so in the spec.
Is pet care captured in homes?
The site does not list a pet care row in a home. Its in-home page describes capture in real homes with laundry, tidying, cleaning and surface reset. If you need pet care in a home, say so in the brief.
What streams and labels come with a pet care episode?
Ten hardware-synchronized streams aligned under 2 ms, 3D hand pose for both hands, contact events and action segments with a start, an end, a verb and a noun. No species, behaviour, force or tactile label is stated.
How is privacy handled around people and animals?
Every contributor signs a written release, and faces and screens are blurred irreversibly, with a reviewer confirming no un-consented person is identifiable. Footage with bystanders who cannot be de-identified is discarded. The site makes no animal-welfare claim, so settle owner and client handling in the spec.
How fast can a custom pet care dataset be collected?
From a signed spec to a first validated batch, a median of 48 hours where coverage is deep and three to four weeks where it is thin. The site does not say which applies to these rows, so ask when you request the quote.
Do you capture robot or teleoperation data for pet care?
No. Firsthand captures humans, not robots. Episodes carry human hand pose and human action labels, so using them for a specific robot means your own retargeting step. The license is perpetual and buyer-owned, and the executed order form governs.

Sources

Where are the delivery formats on this page documented?

Request a custom pet care dataset.

Tell us the setting, the order of steps and the privacy rule your model needs to see. We will quote reach, timeline and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.