Comparison

Custom vs Off-the-Shelf Robotics Datasets

When a public dataset is enough, and when a custom, on-demand batch is the only fit.

Short answer

Off-the-shelf datasets like Ego4D, EgoDex and EgoScale are ready now and free or public-licensed, but few permit commercial use and none targets a specific skill or environment. Custom collection is commissioned to a written spec — a named skill, environment and camera setup ����� delivered on a buyer-owned commercial license with a documented consent chain.

Spec comparison

Custom collection vs off-the-shelf datasets

DimensionOff-the-shelf public datasetCustom collection
LicensingVaries by dataset; several are non-commercial (CC BY-NC, CC BY-NC-ND) and restrict redistribution — see /compare/public-dataset-licensesPerpetual, irrevocable, buyer-owned commercial license — see /guides/buyer-owned-training-data
Task / environment coverageFixed at release; broad daily-activity or single-domain (e.g. kitchen-only for EPIC-Kitchens), not built to a specific skillCollected to a written skill spec in the named environment on demand
Sync & formatSync method and error not documented as hardware-triggered on most public egocentric corporaHardware-triggered on one PTP clock; delivered in RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd
Provenance & consentDocumentation varies by dataset and is not always published per participantWritten release per participant; consent artefacts and a data card delivered per batch — see /provenance
TurnaroundAvailable immediately once license terms are confirmedCollected on demand per spec; timeline set per engagement

Evaluation criteria

Eight things to check on any vendor.

Does a public dataset already cover your skill and environment?
Ego4D and EgoScale offer broad scale for pretraining; EgoDex offers strong hand pose. None is built to a specific manipulation skill in a specific environment — check /compare/best-egocentric-video-datasets-for-robotics before assuming a gap needs custom capture.
Does the license allow what you need?
CC BY-NC and CC BY-NC-ND datasets prohibit commercial training. Confirm current license text before building a roadmap around any public corpus — see /compare/public-dataset-licenses and /guides/research-only-vs-commercial-dataset-licenses.
Do you need synchronized depth, IMU or 3D hand pose?
Manipulation and whole-body policies often need metric depth and hand pose the public corpora do not carry throughout. Custom collection ships these as standard streams.
Do you need buyer-owned rights to the data and derived models?
A public dataset's terms apply to everyone who uses it. Custom collection is delivered on a license written for your engagement — see /guides/buyer-owned-training-data.
Can you combine both?
A common pattern is broad pretraining on a public corpus, then fine-tuning on a smaller custom batch collected to the target skill and environment.

Red flags

Walk away when you see these.

  • Assuming "public" means "commercially licensed" — several of the largest egocentric datasets are non-commercial.
  • Committing to custom collection before checking whether an existing public dataset already covers the skill and environment.
  • Mixing data with different sync guarantees into one training run without checking each source's method.
  • Building a product roadmap around a dataset before confirming its current license terms, which can change between releases.

Scoring template

Score candidates against your skill spec.

Copy this table, weight each criterion for your use case, and score each vendor on the same free or paid sample.

CriterionWeight (1–5)Off-the-shelfCustom collection
Does a public dataset already cover your skill and environment?———
Does the license allow what you need?———
Do you need synchronized depth, IMU or 3D hand pose?———
Do you need buyer-owned rights to the data and derived models?———
Can you combine both?———

FAQ

Common questions.

When should I use an off-the-shelf dataset instead of custom collection?

When a public corpus like Ego4D or EgoScale already covers your task domain broadly enough for pretraining, and its license permits your intended use. See /compare/best-egocentric-video-datasets-for-robotics for what each public dataset is actually good for.

When does custom data collection make more sense than a public dataset?

When you need a specific skill in a specific environment, synchronized depth/IMU/hand pose the public corpora do not consistently carry, or a commercial license and buyer-owned rights a public dataset cannot grant. See /custom-collection for how a written spec becomes a delivered batch.

Can I combine public datasets with custom-collected data?

Yes. A common pattern is broad pretraining on a large public corpus, then fine-tuning on custom, spec-fit data. Firsthand delivers custom batches in RLDS, LeRobot and WebDataset so they mix cleanly with public-format data.

Is custom-collected data always commercially licensed?

On Firsthand, yes — every custom batch ships on a perpetual, irrevocable, buyer-owned commercial license with per-participant consent artefacts and a data card. Public datasets vary; several common ones are non-commercial. See /guides/buyer-owned-training-data.

How fast can I get a custom dataset compared to downloading a public one?

A public dataset is available as soon as you confirm the license fits. Custom collection is collected to your spec on demand, so timeline is set per engagement — request a spec at /custom-collection to get a timeline for your case.

Judge it on your own skill spec.

Get the free 40-episode sample pack, or send us your target skills and hours for a scoped quote.