Now recruiting capture teams worldwide. Get paid to record first-person video of real work.

Apply to capture

Task family

Stereo Gem Setting and Engraving Data

Seat a stone in its setting and push or bead the prongs over it, or cut letters and patterns into metal with a graver or a rotary tool under magnification: gem setting and engraving are the two Hard catalog rows where the fingers, a small piece and a fine tool share one close view. This page covers the stereo and MCAP side of gem setting robot training data for those two rows only: what a calibrated stereo pair adds to stereo hand engraving video, what an egocentric stone setting dataset can hold, what MCAP is according to its own documentation, and what the site does not state. We run custom jewelry bench data collection fast and on demand against a spec you write, as collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.
Catalog rows
Gem setting and Engraving, in Jewelry & Metalsmithing Studio
Skill and status
Both Hard; both Available on request
Capture setup
Phone (head-mounted) / multiview rig, as the catalog lists; stereo through the general stereo offer
Container
MCAP (.mcap), open source

Why stereo and MCAP here

What do a stereo pair and an MCAP file add to gem setting and engraving video?

01

Depth recovered from the frame pair

The site states that a stereo pair at human-eye spacing makes depth recoverable from every frame pair, so the stone, the setting, the fine tool and both hands sit in one frame. The site gives no depth accuracy figure for these rows and does not state how depth behaves on metal or stones.

02

Fingers hidden by the piece, flagged not guessed

3D hand pose carries a per-joint visibility flag, so a finger folded behind a prong or a graver is marked as hidden rather than silently filled in. Contact events and per-frame instance masks sit alongside it.

03

Seating and closing as separate steps

The Gem setting row names seating a stone and then pushing or beading the prongs, and the Engraving row names cutting letters and patterns. Action segments carry start_ns, end_ns, verb and noun, so each step can be its own labeled span. Which verbs and nouns are used is set in the skill spec.

04

Several timestamped streams in one container

MCAP stores multiple channels of timestamped, pre-serialized data, so a stereo pair, hand pose and IMU can share one file on one log-time axis. Which streams go in the file is set in the skill spec.

Definition

What is stereo gem setting and engraving data, and why does it have its own page?

It is first-person video of a person setting a stone or engraving metal at a jeweler bench, recorded with two calibrated cameras, with depth, hand pose and sensor streams alongside. People reach it through several phrasings: gem setting robot training data, stereo hand engraving video, an egocentric stone setting dataset, or custom jewelry bench data collection at scale. They describe one request from different angles. Stereo describes the capture, and MCAP describes the container. They are separate choices.

The egocentric gem setting and engraving page covers the same two rows as first-person video without making stereo or MCAP its subject, and the stereo jewelry page covers all five bench rows. This page narrows the stereo and MCAP treatment to the two rows about seating stones and cutting metal, so a team scoping only those tasks can read one page. The data is human capture by paid, consented contributors, not robot or teleoperation data, so using it for a specific robot still needs your own retargeting step. Firsthand is not affiliated with Foxglove or the MCAP maintainers.

Catalog rows

Which catalog rows does this page cover, and what is their status?

Two, both in the Jewelry & Metalsmithing Studio environment of the Creative Workshops & Crafts sector, whose listed examples are goldsmith bench, gem setting, wire wrapping, soldering, engraving and polishing. "Gem setting" is described as: "Seat a stone in its setting and push or bead the prongs over it with fine tools." "Engraving" is described as: "Cut letters and patterns into metal with gravers or a rotary tool under magnification."

Both are rated Hard, both list the capture setup "Phone (head-mounted) / multiview rig", and both are Available on request. The site defines Available on request as work that a spec starts, rather than a running capture stream a spec can join. That is a statement about the catalog row, not a promise of a delivery date. The site states no delivered hours and no delivered stereo footage for either row, so this page claims none. The first table below reproduces both rows as the catalog states them.

Capture setup

Is the capture stereo, and what setup do the rows list?

Not as the site states it. The catalog lists "Phone (head-mounted) / multiview rig" for both rows and states no stereo pair for them. Stereo applies through the site’s general stereo offer: a stereo pair is a capture choice agreed in the skill spec and confirmed on a Spec Pilot, not something these rows already run. The site does not state capture at a customer’s own studio, so the bench and setting are agreed in the spec.

The site describes two stereo setups and does not say which one an order for these rows uses. The instrumented tier is a head-mounted stereo rig with a metric depth stream recovered from the calibrated pair rather than from a standalone depth sensor. The off-the-shelf stereo head rig, dataset 06, is dual fisheye cameras at 1080p per eye, a 62 mm baseline, per-unit calibration, a 9-axis IMU and hand-tracking output, shipped as MCAP. The second table below sets them side by side. Camera count, resolution and frame rate for these two rows are Not stated.

Why stereo

Why capture gem setting and engraving in stereo?

Both tasks are fine motion: a stone seated in its setting, prongs pushed or beaded over it with fine tools, a graver or rotary tool cutting into metal. The hands and a small piece do most of the job, and the catalog itself names "fine tools", "gravers" and, for engraving, "under magnification". A stereo pair recovers depth from the calibrated frame pair, so the geometry sits in the same capture that shows the fingers working, and the egocentric view sits close to what a robot onboard camera would see.

The site does not state piece sizes or tolerances, so this page makes no claim about how small the work is. A stereo pair adds depth, not a verdict, and the site lists no setting quality or engraving quality label for these rows.

Difference

How is this page different from the egocentric gem setting and engraving page and the stereo jewelry page?

Four pages sit close to this topic. The egocentric gem setting and engraving page covers the same two rows as first-person video and does not make stereo or MCAP its subject. The stereo jewelry and metalsmithing page covers the stereo and MCAP side of all five bench rows. The egocentric jewelry soldering and polishing page covers the other three rows, Soldering, Polishing and Wire wrapping. The egocentric jewelry and metalsmithing page covers all five rows as a task family.

This page is the one place that puts stereo, MCAP and the two stone and metal rows together as the subject. If you need Soldering, Wire wrapping or Polishing as well, the stereo jewelry page is the better starting point. The third table below sets all five pages side by side.

Steps

Which steps of gem setting and engraving can a stereo spec label?

Each row gives a natural cut. Gem setting seats the stone in its setting and then pushes or beads the prongs over it, so seating and closing are different steps. Engraving cuts letters and patterns into metal with gravers or a rotary tool. A spec that says "set a stone" gives one long action segment. A spec that names seating the stone and then pushing or beading the prongs gives a sequence you can slice by step.

Whether one stone, one cut or a whole session is one episode is a spec decision, not a default, and the site sets no episode length or piece count.

Occlusion and surfaces

What do the hands, the tool and reflective metal do to visibility and depth?

At a jeweler bench the piece is small and held close, and the fingers or the graver can sit between it and the camera. The site states that the hands occlude the work and that fingers disappear behind objects. That is why each hand joint carries a visibility flag, why contact events mark when the hand or a tool meets the piece, and why instance masks are recorded per frame. Firsthand delivers 3D hand pose as handJoints[2][21][3] in metric units in the head-camera frame, two hands of 21 joints each, aligned to depth and RGB.

The site states that glare-heavy and low-texture scenes make single-frame depth worse, and that depth degrades on wet and reflective surfaces, with confidence maps masking low-confidence regions. It does not say whether metal or stones count as reflective for this purpose, or how depth behaves on them, and a lighting setup for these rows is Not stated. The Engraving row says the work is done "under magnification". Whether a magnified view is part of the recording, and what magnification equipment is used, is Not stated, so raise it in the spec if your policy needs it.

MCAP

What is MCAP, per its own documentation?

MCAP is an open source container file format for multimodal log data, supporting multiple channels of timestamped pre-serialized data. It is serialization-agnostic, so messages can be Protobuf, DDS (CDR), ROS, JSON and more. Its design is row-oriented and append-only, it stores schemas alongside the data, and it offers an optional index plus optional LZ4 or Zstandard chunk compression. Each message carries a log time and a publish time, stored as uint64 nanoseconds since a user-understood epoch.

Reader and writer libraries exist for C++, Go, Python, Rust, Swift and TypeScript, and the mcap CLI can inspect, merge and split files. The foxglove/mcap repository is MIT-licensed; that is the MCAP project licence, not the licence of a Firsthand delivery. The fourth table below lists these facts with the official source for each. The MCAP hub page covers the format in full.

Streams

Which streams can ship in an MCAP delivery of gem setting and engraving data?

The site states MCAP delivery in two places. The off-the-shelf stereo head rig, dataset 06, ships as MCAP, and a custom order is packaged in the format you name. For these rows the site states hand pose, a stereo-derived depth stream with confidence maps, IMU, contact events, action segments, per-frame instance masks and one task instruction per episode, but it does not state which of those are channels in an MCAP file, how they are named, what encoding they use or at what rate.

No topic name, message schema or rate is stated on this page, and none should be assumed. Name the streams that matter in the skill spec and confirm them on a Spec Pilot batch rather than assuming them. The fifth table below sets each stream beside what the site states about it, and about its place in an MCAP file.

Synchronization

How are the streams synchronized and calibrated?

The wider stack is ten streams, hardware-triggered onto one PTP clock domain and aligned under 2 ms, so depth, motion and hand pose line up with the same video frame rather than being approximated afterwards. For the stereo head rig the site states hardware triggering with a 2.0 ms cross-stream ceiling. How that maps to message times in an MCAP file is not stated.

The rig is calibrated twice per session, before capture starts and after it ends, and an episode is accepted only if RMS reprojection stays under 0.28 px. Calibration is shipped with the episode; whether it sits inside the MCAP file or beside it is set in the spec.

Quality gates

What does QA reject, and how is privacy handled?

Episodes are machine-checked at ingest against stated reject criteria, listed in the sixth table below, and a human reviewer then checks each episode against the task spec. For these tasks, the spec decides what the manipulated object is: the stone, the setting, the prongs or the piece being engraved. A reject log ships with every batch, and rejected items are recaptured at our cost. The site does not state how often a small piece leaves the view at a bench, and it states no blur or sharpness rule.

For every delivered episode the site states that faces, plates and screens are detected and irreversibly blurred at ingest, that a reviewer confirms the result before anything ships, and that footage that cannot be de-identified is discarded. Every episode links to a signed contributor release through a documented consent chain, the anonymization record ships with the data, and an undocumented bystander is a stated reject criterion. The site states no studio-specific bystander rule, no torch, flux, chemical or injury safety guidance and no protective equipment rule, and this page gives none. This is not legal advice, and the executed agreement controls.

Scale

How does custom collection work at scale for jewelry bench data?

The site lists no off-the-shelf gem setting or engraving dataset, so this work is custom collection. It is custom collection at scale through a network of thousands of capture providers, for a consistent, recurring data flow to labs.

From signed spec to first validated batch, the timeline is a median of a median of 48 hours where coverage is deep, and three to four weeks where it is thin and contributors need to be recruited first. The site does not say whether the jewelry studio counts as deep or thin coverage, so ask which timeline applies when you request the quote. On-demand top-ups run against the same spec and accept criteria. The site states no throughput, provider count or cadence for these rows.

Delivery

How is the data delivered, and who owns it?

MCAP is one packaging option. Delivery can also be RLDS, LeRobot, WebDataset, HDF5, zarr or Rerun .rrd, and the site does not state that an MCAP file is exported from the same canonical episodes as those formats, so confirm that in the spec.

Every batch is validated against signed accept criteria before it ships, and collections are billed per validated hour. The license is perpetual, irrevocable and worldwide, with the data buyer-owned and non-exclusive by default, and exclusivity is available as a separate term. Price, minimum order and batch size are not published and are set in your quote.

The spec

How do you start a stereo gem setting and engraving pilot?

Describe the two tasks and where each starts and ends, what counts as the object and as a finished step, the setting and lighting, and the privacy rule for the studio. Then name the streams you want in the file, the topic naming and message encoding your reader expects, and whether calibration ships inside the file or beside it.

We turn that into a written spec covering tasks, environments, capture tier, annotation depth and accept criteria, then quote reach, timeline and price before any capture begins. A Spec Pilot, a small and fast first batch, proves the spec and accept criteria on real footage before you scale. Rejected items are recaptured at our cost, and every collection ships under a perpetual, buyer-owned commercial license.

At a glance

What you get.

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

Catalog rows

Which catalog rows cover gem setting and engraving?

The two rows in the Jewelry & Metalsmithing Studio environment, reproduced as the catalog states them.
Task (as listed)Description (as listed)EnvironmentSkillCapture setupStatus
Gem settingSeat a stone in its setting and push or bead the prongs over it with fine tools.Jewelry & Metalsmithing StudioHardPhone (head-mounted) / multiview rigAvailable on request
EngravingCut letters and patterns into metal with gravers or a rotary tool under magnification.Jewelry & Metalsmithing StudioHardPhone (head-mounted) / multiview rigAvailable on request

Capture setups

What capture setups does the site state, and which apply to these rows?

What the catalog lists for the rows, set against the two stereo setups the site describes elsewhere. The site does not say which one an order for these rows uses.
SetupWhat the site statesStatus for gem setting and engraving
Catalog capture setupPhone (head-mounted) / multiview rigListed on both rows
Instrumented stereo tierHead-mounted stereo rig; metric depth recovered from the calibrated pair rather than a standalone depth sensor; 6-DoF IMU data at 200 HzGeneral stereo offer; agreed in the spec and proved on a Spec Pilot
Stereo head rig (dataset 06)Dual fisheye, 1080p per eye, 62 mm baseline, per-unit calibration, 9-axis IMU, hand-tracking output; shipped as MCAPOff-the-shelf dataset; not a jewelry dataset
Multiview rigAdds synchronized third-person angles when the spec asks for themListed in the catalog setup; angles set in the spec
Camera count, resolution, frame rate for these rowsNot statedAgreed in the spec

Comparison

How does this page compare with the neighbouring jewelry pages?

The four existing pages closest to this topic, set against this page by main topic and rows covered.
PageMain topicRows or tasks coveredHow it differs from this page
This pageStereo and MCAP treatment of gem setting and engravingGem setting, Engraving; both HardThe narrow stereo view of the two stone and metal rows
Egocentric gem setting and engraving dataSeating a stone and cutting metal in first personGem setting and Engraving; both HardSame two rows; stereo and MCAP are not its subject
Stereo jewelry and metalsmithing dataThe stereo and MCAP side of jewelry workAll five rowsBroader; start here if you need Soldering, Polishing and Wire wrapping too
Egocentric jewelry soldering and polishing dataJoining, finishing and forming metal piecesSoldering, Polishing, Wire wrappingCovers none of the two rows on this page
Egocentric jewelry and metalsmithing dataThe whole jewelry bench as a task familyAll five rowsBroader first-person page; stereo is not its subject

MCAP at a glance

What does the official MCAP documentation state?

Each property with what the MCAP documentation says and where it says it. These are facts about MCAP, not about a Firsthand delivery.
PropertyWhat the MCAP documentation statesOfficial source
What it isAn open source container file format for multimodal log data, with multiple channels of timestamped pre-serialized datamcap.dev
SerializationSerialization-agnostic: Protobuf, DDS (CDR), ROS, JSON and moremcap.dev
Write designRow-oriented and append-onlymcap.dev
SchemasStored alongside the datamcap.dev
Index and compressionOptional index; optional LZ4 or Zstandard chunk compressionmcap.dev
File identityExtension .mcap; registered media type application/vnd.mcapMCAP specification
Timestampslog_time and publish_time per message, uint64 nanoseconds since a user-understood epochMCAP specification
AttachmentsAuxiliary artifacts such as text, core dumps or calibration dataMCAP specification
Libraries and CLIC++, Go, Python, Rust, Swift and TypeScript; CLI to inspect, merge and split filesfoxglove/mcap on GitHub
Licence of the projectMIT Licensefoxglove/mcap on GitHub

Stream map

How do the stated streams map to gem setting, engraving and an MCAP file?

The streams the site states for Firsthand collections, what each carries in a bench episode, and what the site states about it in MCAP. “Not stated” means the site does not say.
Stream or itemWhat it carries in these episodesIn an MCAP delivery, as the site states it
Stereo pairThe stone, setting, tool and both hands from two calibrated camerasDataset 06 is stated as shipped as MCAP; channel layout not stated
CalibrationMeasured twice per session and shipped with the episodePlacement in the file not stated
3D hand pose, per-joint visibilityTwo hands of 21 joints, with a flag for joints hidden by the piece or toolChannel layout and joint order not stated
IMUHead and wrist motionChannel layout and rate not stated
Depth with confidence mapsGeometry recovered from the stereo pairNot stated
Contact events and action segmentsWhen a finger or tool meets the piece; seating, closing and cutting as stepsNot stated
Task instructionOne per episodeNot stated
Topic names, schemas, encoding, ratesSet by the buyer specNot stated; agreed in the skill spec

Quality gates

How do the stated reject criteria apply to gem setting and engraving?

The reject criteria the site states for every episode, and what the site does and does not state about each at a jewelry bench.
Reject criterionStatus on this siteAt a jewelry bench
Manipulated object out of frame for more than 15 percent of the episodeStatedApplies to every episode; the spec decides whether the object is the stone, the setting or the piece being engraved
More than 35 percent invalid depth pixels in the manipulation regionStatedApplies to every episode; depth behaviour on metal and stones is Not stated
Sync breach beyond the ceiling for more than three consecutive framesStatedApplies to every episode
Calibration drift beyond tolerance (RMS reprojection under 0.28 px)StatedApplies to every episode
Undocumented bystanderStatedApplies to every episode; the episode is rejected
Mismatch against the named skill specStatedChecked against the two tasks and steps your spec names
Blur or sharpness ruleNot statedSet in the spec if your policy needs one

What is not stated

Which gem setting and engraving details does the site not state?

Fields the site does not state for these rows, and where each one is settled.
ItemStatus on this siteWhere it is settled
Stone types, metal types, tool brands, gem or metal gradesNot stated; rows name a stone, its setting, prongs, metal, gravers and a rotary tool onlyThe written spec
Magnification level and equipmentNot stated beyond the words "under magnification" in the Engraving rowThe written spec
Piece sizes, tolerances and number of pieces or episodesNot statedThe written spec
Stereo pair on these rowsNot stated for the rows; offered generallyThe written spec, proved on a Spec Pilot
MCAP topics, schemas, encodings and ratesNot statedThe written spec
Labels for stone, setting or engraving qualityNot statedThe written spec, if needed
Force or tactile data on jewelry rowsNot statedThe written spec, if needed
Safety practice, torch or chemical guidance, certificationNot statedThe written spec
Throughput, provider counts and capture timelineNot statedQuoted against your spec

Example footage

What does head-mounted stereo capture look like?

One real clip already published on this site, shown as a format and rig example: a head-mounted stereo capture with hands in frame. It does not show gem setting or engraving, and it is not an MCAP file.

egocentric_stereo_sample.mp4 · head-mounted stereo · hands in frame · 1920 × 1080 web preview · rig example, not a jewelry clip

No gem setting or engraving clip is published on the site, so this is the nearest stereo clip, labelled as a rig example. Request a sample to see delivered files. See stereo sample page, stereo + wrist-cam example videos, request an egocentric data sample.

FAQ

Gem setting robot training data, answered.

What is stereo gem setting and engraving data?
First-person video from two calibrated cameras of a person seating a stone and pushing or beading its prongs, or cutting letters and patterns into metal, with depth and 3D hand pose alongside, collected to a written spec.
Which catalog rows does it cover?
Gem setting and Engraving, both Hard, in the Jewelry & Metalsmithing Studio environment, captured by head-mounted phone or multiview rig and listed as Available on request.
Is the capture on these rows stereo?
The catalog lists a head-mounted phone or multiview rig and states no stereo pair for these rows. A stereo pair is offered through the general stereo offer and would be agreed in the written spec and proved on a Spec Pilot.
What does MCAP add?
MCAP is an open container for multiple channels of timestamped, pre-serialized data, so a stereo pair, hand pose and IMU can share one file. Topic names, schemas, encodings and rates are not stated on the site and are agreed in the spec.
How does this differ from the egocentric gem setting and engraving page?
That page covers the same two rows as first-person video. This page covers the stereo and MCAP side of those two rows. The stereo jewelry page covers all five bench rows.
Does the site state stone or metal types, magnification, tool brands or safety practice?
No. The rows name a stone, its setting, prongs, metal, gravers, a rotary tool and magnification only. Types, grades, magnification levels, brands, tolerances and safety practice are Not stated, and this page gives no safety guidance.
How is privacy handled?
Faces, plates and screens are detected and irreversibly blurred at ingest, and a reviewer confirms the result. Each episode links to a signed contributor release, and the anonymization record ships with the data.
How fast can a custom dataset be collected, and how do you start?
Where coverage is deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, and these rows are quoted against your spec. Describe the tasks and steps you need, and a Spec Pilot proves the accept criteria before you scale.

Sources

Where is MCAP documented?

Request a custom stereo gem setting and engraving dataset.

Tell us the two tasks and where each starts and ends, the setting and lighting, the privacy rule for the studio, the streams you want in the file and the format your reader expects. We will quote reach, timeline and price against a written spec.