Teleoperation · Physical Intelligence — Perit

What gets captured, and why it is worth having.

Environment: Small robotics workshop, LED work lamp
Captured with: Bimanual leader–follower arms, two camera views
Task: Stack three bowls

Teleoperation is the embodiment-matched end of the spectrum: the demonstration is performed on the robot the policy will run on, so there is no transfer gap to close. It is slower and dearer per episode than human video, which is why the protocol matters — every episode has to count.

Operators pass the same calibration gate as the rest of the bench, on the task and the rig, before a paid episode is recorded. Interventions and failed takes are logged, not discarded, because they are training data too.

What it trains

How it is captured, and what you receive.

How it is captured

Primary rig: Bimanual leader–follower arms (ALOHA-class)
VR rig: Headset and controllers driving a single or dual arm
Your robot: Bring-your-own-stack, driven by our trained operators
Cameras: Wrist, front and overhead RGB, 2–4 synchronised streams
Logging: Joint state, gripper state and leader commands per step
Operators: Calibrated on the task and the rig before a paid episode

What you receive

Where it is recorded, and what people are asked to do.

Tasks are recorded where they actually happen — not in a studio dressed to look like a kitchen. Hover a room to see the kind of setting the protocol calls for.

Kitchens

Living rooms and bedrooms

Offices

Retail and small shops

Warehouses and light industrial

Workshops and labs

Agriculture and outdoor

Client-defined and confidential

Deliverables, and the labels you can add.

Deliverables

Annotation add-ons

Labelled on the same bench as our speech work, to a written guide, behind the same calibration test.

How a pilot runs

  1. Brief: The task family, the environments, the rig, the sensors, the episode count. One page, agreed before anything is bought or anyone is recruited.
  2. SOP and kit: A written capture protocol — framing, lighting, where a task starts and ends, what counts as a failed take — and the kit list. Operators are trained and tested on it before a single episode is paid for.
  3. Pilot episodes: A small batch, ten to thirty episodes, delivered with QC status and a quality report. This is where the protocol breaks — on purpose, and cheaply.
  4. Review and scale: You review the pilot, we fix the protocol, then the run scales on a weekly delivery cadence with the same report attached to every batch.

What QC checks, every time.

Samples and the other lines

2 teleoperation episodes to watch and download.

Each with the rig, the room, the task and the file list of the full download.