Task family

Egocentric Data Center and IT Hardware Task Video Data

Patching and dressing cables, swapping drive, fan and power supply modules, seating memory and cards, and mounting rack rails, recorded by a multiview rig with handheld grippers against a spec you write, for data center robot training data and fast, on-demand custom technician data collection.
Catalog rows
Twelve, in the Office & IT sector
Streams
Ten, synced under 2 ms
First batch
Median 48 h where coverage is deep
License
Buyer-owned

Requirements

What does data center task data need?

01

A named rack and bench task list

Patching, dressing, seating, swapping and mounting are different sequences, so a spec names each task and where it happens.

02

The capture mode set per task

The catalog lists a multiview rig with handheld grippers for every row, so the spec states which streams that mode carries.

03

Step boundaries on the same clock

Where the spec asks for them, contact events and action segments mark when a part is seated and where each step ends, aligned to video and depth.

04

Hidden parts recorded as hidden

Where hand pose is part of the spec, a per-joint visibility flag records which joints were hidden behind a part or a cable.

05

Rights you can ship on

A perpetual, buyer-owned commercial license backed by a documented consent chain.

Why it matters

What is egocentric data center and IT hardware task data, and why does it need its own page?

Egocentric data center and IT hardware task data is real-world video of work at a server rack and a hardware bench. It is recorded against a written spec, with depth, contact events and frame-accurate action segments aligned on one hardware clock where the spec includes them. The tasks it covers are the ones the site states in its task catalog: twelve rows in a Data Center & IT Hardware Bench environment, from patching network cables to swapping a power supply module.

The cable routing and wiring page covers cable work across several settings, and the electronics and device repair page covers consumer device repair. This page covers rack and bench work only.

Setting

Which data center and bench tasks can be captured?

The site states rack and bench work in its task catalog under the Office & IT sector. The Data Center & IT Hardware Bench environment lists its examples as "Server rack plus hardware bench: modules, cabling, drivers", and it holds twelve rows.

Every row uses the same capture mode, a multiview rig with handheld grippers. Nine rows are rated Easy and three are rated Medium: clipping cage nuts and a panel, inserting a transceiver and fiber, and reseating an add-in card. All twelve are listed as Available on request.

Cables

How are the cabling and connector rows described?

Four rows cover cables and connectors. The catalog descriptions read "Dress a cable bundle to uniform pitch with ties", "Seat power cables and locking clips", "Seat a transceiver and connect an LC fiber" and "Insert and route Ethernet patch cables cleanly." They are rated Easy, Easy, Medium and Easy.

Cable lengths, cable counts, port counts and the layout of the rack are Not stated, and so is any measure of a clean result.

Modules

How are the module swap and seating rows described?

Five rows cover modules and cards: "Remove and insert a drive caddy in a bay", "Unbracket, reseat, and secure an add-in card", "Insert memory modules into slots until they click and latch", "Release and replace a hot-swap fan" and "Replace a hot-swap power supply." Only the add-in card row is rated Medium; the other four are Easy.

Server models, bay and slot counts, and the order of the steps are Not stated.

Mounting and labeling

How are the mounting and labeling rows described?

Three rows cover mounting and marking: "Clip cage nuts and mount a blanking panel" (Medium), "Fasten rail brackets with a driver" (Easy) and "Label a unit and scan the barcode" (Easy). The mounting rows name a driver, but the site states no tool model, torque or fastener type.

Scanner type and label formats are Not stated.

What is not covered

Which neighbouring tasks are not data center rows?

Routing and clipping cables through harnesses and wiring outlets sit on the cable routing and wiring page, and repairing consumer devices sits on the electronics and device repair page. Board-level assembly sits on the electronics assembly page. This page lists them as neighbours and does not count them as data center rows.

Tasks people often expect here, such as racking a full server into a cabinet, configuring a switch or decommissioning hardware, are not stated as catalog rows.

Why it is hard

Why is rack and hardware work hard for robot learning?

The catalog describes steps that end in a physical seat: memory inserted "until they click and latch", a drive caddy removed and inserted in a bay, an add-in card unbracketed, reseated and secured. Lighting, rack density, reach and cable congestion are Not stated. What the site does state is what egocentric video puts into the training distribution: hands entering the frame from below, occlusion during grasp and motion blur during reach.

The site also states why a hand pose stream matters. RGB alone leaves a model to infer 3D hand structure it cannot see reliably through occlusion and motion blur. Firsthand delivers 3D hand pose as handJoints[2][21][3] in metric units in the head-camera frame, with a visibility flag per joint, aligned to depth and RGB. Whether that stream is populated for the staged gripper capture mode is Not stated, and is agreed in the spec.

Capture setup

How is rack and bench work captured?

The catalog describes the mode as "a staged working set recorded by a multiview rig while the operator performs the task with handheld grippers, so demonstrations map onto a robot end effector." The site states a head camera at 3840 × 2160 and 60 fps for its instrumented rig, but no camera count, resolution or frame rate for the rack rows, so the capture tier is agreed in the spec.

The site states no gripper model, jaw type or end-effector mapping for these rows. Whether a head-mounted capture mode can replace the gripper mode for them is Not stated, and is settled in the written spec.

Streams and labels

What does each episode contain?

Each episode follows the Firsthand episode schema: ten streams synced under 2 ms, with head and wrist RGB, depth, 3D hand pose with per-joint visibility, contact and grasp events, and frame-accurate action segments. For rack and bench work, contact events mark when a part meets a bay, slot or rail, and action segments mark each step.

The site does not state which of those streams the staged gripper mode populates for each row. Object labels use the terms your spec sets. Force or tactile data, and success or quality labels for a seated card, a latched module or a dressed bundle, are Not stated.

Gloves

Can tactile gloves be used for rack and bench work?

The site offers a tactile glove tier as a pilot-ready option. The glove signal is time-synced to a head-mounted stereo camera by hardware timestamps and an IMU, and each glove is calibrated every session.

The site does not state that the glove tier has been used on any rack row, and every rack row lists handheld grippers as its capture mode. Treat force and tactile data as Not stated for these rows unless a spec adds the glove tier and agrees the fit with you.

Setting and privacy

Where is it captured and how are sensitive screens and labels protected?

The catalog places the rows in a server rack plus hardware bench environment. The site names no data center, colocation facility, customer or operator, and it does not state capture at a customer own site or facility. Environment, access and schedule are agreed in the spec, and the number of sites is Not stated.

Every episode links to a signed contributor release through a documented consent chain. Faces, plates and screens are detected and irreversibly blurred at ingest, a reviewer confirms the result before anything ships, and the anonymization record is delivered with the data. An undocumented bystander is a stated reject criterion. How asset tags, serial numbers, barcodes and cable labels are handled is Not stated, so name them in the spec.

Quality gates

How are rack and bench episodes checked for lost views?

Episodes are machine-checked at ingest against the stated reject criteria, listed in the table below, and a human reviewer then checks the result.

The site states no rule for how often a part or port leaves the view in a rack, and no blur or sharpness rule. A rejected item goes to the reject log and is recaptured at our cost.

Delivery

How is data center task data labeled and delivered?

Delivery formats are RLDS, LeRobot and WebDataset, plus HDF5, zarr and Rerun .rrd. The format table below sets each against what its official documentation states.

Every batch is validated against signed accept criteria before it ships, with a reject log, and delivery is rolling, per validated batch.

Fast · on demand

How fast can a custom data center dataset be collected?

Where coverage is already deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, because vetting operators there is the bottleneck, and we quote that up front.

On-demand top-ups run against the same spec and accept criteria after each training run. The site states no capture timeline for the twelve rows beyond a quote against your spec.

The spec

How do you start a pilot?

You describe the rack and bench tasks, the sequence and the capture mode your policy needs. We turn that into a written spec covering tasks, environments, capture tier, annotation depth and accept criteria, then quote reach, timeline and price before any capture begins.

A Spec Pilot, a small and fast first batch, can prove the spec and accept criteria before you scale. Billing is per validated hour, and every collection ships under a perpetual, buyer-owned commercial license.

At a glance

What you get.

Every collection runs through the same seven-stage end-to-end custom collection pipeline. End-to-end custom data collection is a managed service that takes an AI data need from problem to owned dataset in a single accountable pipeline.

Catalog rows

Which catalog rows cover data center and IT hardware work?

The twelve rows in the Data Center & IT Hardware Bench environment, with the catalog description and skill rating as listed. All use the multiview rig plus handheld grippers capture mode and are listed as Available on request.
Catalog taskCatalog descriptionSkill
Apply + scan asset tagLabel a unit and scan the barcode.Easy
Cable-comb dressingDress a cable bundle to uniform pitch with ties.Easy
Clip cage nuts + panelClip cage nuts and mount a blanking panel.Medium
Connect C13/C14 powerSeat power cables and locking clips.Easy
Hot-swap drive caddyRemove and insert a drive caddy in a bay.Easy
Insert SFP+ + fiberSeat a transceiver and connect an LC fiber.Medium
Patch RJ45 cablingInsert and route Ethernet patch cables cleanly.Easy
Reseat PCIe cardUnbracket, reseat, and secure an add-in card.Medium
Screw-mount rack railsFasten rail brackets with a driver.Easy
Seat RAM DIMMsInsert memory modules into slots until they click and latch.Easy
Swap fan moduleRelease and replace a hot-swap fan.Easy
Swap PSU moduleReplace a hot-swap power supply.Easy

Streams and tasks

How do the stated streams map to rack and bench tasks?

Streams the site states for custom collections, set against what each carries in a rack or bench episode. Whether the gripper mode populates each is Not stated.
Stream or labelStatus on this siteWhat it carries in a rack or bench episode
Head and wrist RGB, depthStated; ten streams synced under 2 msKeeps the part, the port and the hands on one timeline
3D hand pose, per-joint visibilityStated; two hands of 21 joints, with a visibility flag per jointCarries how the fingers hold a part and which joints were hidden
Contact and grasp eventsStatedMarks when a part meets a bay, slot or rail
Action segmentsStated; frame-accurateSeparates dressing, patching, seating, swapping and mounting steps
Object labelsSet by your specNames the parts and steps in the terms your policy uses
Force or tactile dataGlove tier stated; use on rack rows Not statedAdded only if a spec includes the glove tier

Quality gates

How do the stated reject criteria apply to rack and bench work?

The reject criteria the site states for every episode, and what the site does and does not state about each for rack and bench work.
Reject criterionStatus on this siteOn rack and bench work
Manipulated object out of frame for more than 15 percent of the episodeStatedApplies to every episode; how often a part leaves the view in a rack is Not stated
More than 35 percent invalid depth pixels in the manipulation regionStatedApplies to every episode; depth behaviour on rack hardware is Not stated
Sync breach beyond the ceiling for more than three consecutive framesStatedApplies to every episode
Calibration drift beyond toleranceStatedApplies to every episode
Undocumented bystanderStatedApplies to every episode; the episode is rejected
Mismatch against the named skill specStatedChecked against the task and steps your spec names
Blur or sharpness ruleNot statedSet in the spec if your policy needs one

What is not stated

Which data center details does the site not state?

Rack and bench fields the site does not state, and where each one is settled.
ItemStatus on this siteWhere it is settled
Hardware models, server types and tool listsNot stated beyond the terms in the catalog rowsThe written spec
Rack, bay and slot counts, and facility typesNot statedThe written spec
Cable lengths, counts and port countsNot statedThe written spec
Torque, fastener types and label formatsNot statedThe written spec
Handling of asset tags, serial numbers and barcodesNot statedThe written spec
Number of sites or episodesNot statedThe written spec
ThroughputNot statedQuoted against your spec
Force or tactile data on rack rowsNot statedThe written spec, if needed
Success or quality labels, robot resultsNot statedThe written spec, if needed

Formats

Which formats carry data center task data?

Delivery formats stated on the site, set against what each format official documentation states where the documentation was read.
FormatWhat the official documentation statesUsed for here
RLDSA dataset is retrieved as episodes, and each episode holds a dataset of steps (RLDS repository README)Episode-based training loaders
LeRobotLeRobotDataset v3.0 is a standardized format for robot learning data, including multi-camera video, with many episodes stored per Parquet or MP4 file (LeRobot documentation)LeRobot dataset format and tooling
WebDatasetTar files in which files that belong together share a basename, split into numbered shards (WebDataset README)Sharded streaming for large training runs
HDF5 and zarrStated by Firsthand onlyArray storage for custom pipelines
Rerun .rrdStated by Firsthand onlyMulti-stream synchronized playback for review

FAQ

Data center robot training data, answered.

What is egocentric data center and IT hardware task video data?
Real-world video of server rack and hardware bench work, such as patching cables, swapping hot-swap modules, seating memory and mounting rails, recorded against a written spec.
Which data center and IT hardware tasks does the site state?
The catalog lists twelve rows in a Data Center & IT Hardware Bench environment, covering cables and connectors, drive, fan, power supply, memory and card swaps, rack rails, cage nuts and asset tags. Nine are rated Easy and three Medium, and all are Available on request.
Does the site state hardware models, rack types, facility types or tool lists?
No. A driver is named in one row, but hardware models, server types, rack and bay counts, facility types and tool lists are Not stated, and the site does not state capture at a customer own site or facility.
Is rack and bench data captured from a first-person view?
The catalog lists a multiview rig with handheld grippers for every row, a staged working set where the operator performs the task with grippers. The first-person head-mounted mode is listed for other rows, and whether it is offered for these is Not stated.
Are force data or tactile gloves included?
Not stated for rack rows. The site offers a tactile glove tier as a pilot-ready option, but it does not state that the tier has been used on rack or bench work. The site states hand pose, depth, contact events and action segments.
How are sensitive screens and labels handled?
Faces, plates and screens are detected and irreversibly blurred at ingest, a reviewer confirms the result, and the anonymization record ships with the data. How asset tags, serial numbers and barcodes are handled is Not stated, so name them in the spec.
How fast can a custom data center dataset be collected, and how do you start?
Where coverage is deep, the first validated batch lands in a median of 48 hours from signed spec. Thin environments typically take three to four weeks, and the rack rows are quoted against your spec. Describe the tasks and capture mode you need, and a Spec Pilot proves the accept criteria before you scale.

Sources

Where are the delivery formats documented?

Request a custom dataset.

Tell us the rack and bench tasks, the sequence and the capture mode your policy needs. We will quote reach, timeline, and price against a written spec, with a first validated batch in a median of 48 hours where coverage is deep.