Hand Pose · Physical Intelligence — Perit

What gets captured, and why it is worth having.

Environment

Workshop bench, window light

Captured with

Marker gloves, two wrist cameras, head-mounted RGB

Task

Thread a nut and tighten a bracket

Monocular and depth rigs estimate hand pose; this one records it. Thin marker gloves and two wrist-mounted cameras see the fingers from below and behind, so a grasp inside a drawer or a hand wrapped around a jar still has 21 keypoints per frame, with a confidence value where a marker was briefly lost.

The same rooms, tasks and people as the egocentric line, with the dexterous work pulled forward: fastening, peeling, threading, pouring — the tasks where a policy fails because the hand it learned from was half hidden.

What it trains

How it is captured, and what you receive.

How it is captured

What you receive

Where it is recorded, and what people are asked to do.

Tasks are recorded where they actually happen — not in a studio dressed to look like a kitchen. Hover a room to see the kind of setting the protocol calls for.

Kitchens

Living rooms and bedrooms

Offices

Retail and small shops

Warehouses and light industrial

Workshops and labs

Agriculture and outdoor

Client-defined and confidential

Deliverables, and the labels you can add.

Deliverables

Annotation add-ons

How a pilot runs

  1. Day 0: Brief
    The task family, the environments, the rig, the sensors, the episode count. One page, agreed before anything is bought or anyone is recruited.
  2. Week 1: SOP and kit
    A written capture protocol — framing, lighting, where a task starts and ends, what counts as a failed take — and the kit list. Operators are trained and tested on it before a single episode is paid for.
  3. Week 2: Pilot episodes
    A small batch, ten to thirty episodes, delivered with QC status and a quality report. This is where the protocol breaks — on purpose, and cheaply.
  4. Ongoing: Review and scale
    You review the pilot, we fix the protocol, then the run scales on a weekly delivery cadence with the same report attached to every batch.

Turnaround

What QC checks, every time.

Hand Pose samples, cut to your spec.

Hand-pose episodes carry the glove calibration for the session, so we send them against a signed sample agreement.