Sample datasets · Physical Intelligence — Perit

Pick a line to see its samples.

Hover a card to play the capture. Lines marked on request are confidential by nature or carry per-session calibration, so their samples are cut to your spec.

Egocentric
3 samples
Monocular first-person RGB with IMU from chest and head mounts, in real homes, shops and depots.
Watch and download

Depth
3 samples
RGB with an aligned per-frame depth map from stereo headsets, LiDAR phones and head-mounted depth cameras.
Watch and download

UMI Gripper
2 samples
Handheld wrist-camera gripper demonstrations with a 6-DoF trajectory and jaw width per frame.
Watch and download

Teleoperation
2 samples
Leader–follower and VR teleoperation episodes with synchronised cameras and per-step state and action logs.
Watch and download

Hand Pose
Head and wrist video with 21 measured keypoints per hand per frame, occlusions included.
Available on request

Tactile
Video with a synchronised per-taxel pressure stream and contact events per finger or jaw.
Available on request

Bring Your Own Rig
Your hardware and format, our crews, rooms and QC — under NDA.
Available on request

Video Annotation
Segments, captions, masks and success labels per episode, in JSON or your schema.
Available on request


What every line is recorded with.

Off-the-shelf where it is good enough, custom where it is not, and yours when the program calls for it. Each card says which lines the device runs on.

Action camera

Chest or head mount. 4K or 1080p, 30 fps, on-device audio. The workhorse of egocentric capture.

EgocentricHand PoseTactile

LiDAR phone

Chest harness or head strap. RGB plus metric depth and a timestamped IMU stream.

EgocentricDepth

Android phone

Head strap or chest mount. RGB with IMU, the cheapest way to put a wide pool on camera.

Egocentric

Custom monocular rig

A single camera module in a printed housing, built to your field of view and mount.

EgocentricBring Your Own Rig

Custom stereo rig

Calibrated stereo pair on a head strap or cap brim, for depth without a headset.

DepthBring Your Own Rig

Depth camera

RealSense-class RGB-D on a head mount, aligned depth at sensor-native resolution.

Depth

Stereo passthrough headset

Quest-class headset with front cameras, for depth capture and VR teleoperation.

DepthTeleoperation

Halo-strap headset

Pico-class headset with a rigid halo, comfortable over long teleoperation sessions.

Teleoperation

UMI-style gripper

Handheld parallel-jaw gripper with a wrist fisheye camera and on-device pose tracking.

UMI Gripper

Tactile glove

Pressure pads on each fingertip and the palm, logged at up to 500 Hz alongside video.

TactileHand Pose

Leader–follower arms

ALOHA-class bimanual rig with wrist, front and overhead cameras and per-step logs.

Teleoperation


What QC checks on every sample and every delivery.

The same ten checks, the same thresholds written into the protocol, on the sample you download and on the ten-thousandth episode.

The task stays in frame; hands and workspace inside the protocol's bounds for the whole episode.

No blown highlights or focus hunting beyond the tolerance set for the room.

No camera whip, no dropped frames; IMU continuous where the rig has one.

Every stream aligned within one frame; timestamps monotonic across cameras, state and action logs.

Start and end states match the SOP; no skipped or reordered steps unless the protocol allows it.

Inside the episode window for the task family; overruns are trimmed to the protocol, not the clip.

Environment, task, rig, operator id, session and consent reference present and valid on every episode.

No bystander faces, screens or documents without consent; blurred where the protocol flags it.

Intrinsics and extrinsics on file per rig and session for depth, stereo and multi-camera capture.

Where annotation is ordered, agreement against the gold set above the threshold before the batch ships.


Need a sample in your task family, on your rig?

Send the task, the room and the format. A sample episode comes back within five working days, cut from the protocol the pilot will run on.