Physical Intelligence pi0: Understand the Robot Model
pi0 is a robot policy that connects visual information and instructions to physical actions. Understand the model, its relationship to openpi, and what an experiment can establish.
Updated 5 min read
Physical Intelligence pi0, written π0 and pronounced pi-zero, is a robot policy: a model that uses observations and instructions to produce robot actions. The original pi0 announcement (opens in a new tab) describes an approach spanning images, text, and low-level motor commands. Its purpose is to control physical behavior, rather than conduct a chat. You can use fenbs to keep your own research and experiment notes as you work out what the model does and which claims you still need to check.
What goes into pi0, and what comes out?
The phrase vision-language-action describes the connection the model is learning. Vision supplies information about the scene. Language supplies an instruction. Action is the physical output the robot is asked to carry out. The original announcement describes learning to produce motor commands from this combination.
That is a different job from recognizing an object in a photograph. A robot must act with a particular body in a changing scene. For a hypothetical sorting task, understanding “put the cup in the container” is only part of the problem; the movements still have to work with the actual cup, container, and machine.
Think of the model as one part of an experiment, rather than the whole robot. You still need to establish how the observations reach it, what the returned actions mean for the selected hardware, and how the experiment is evaluated. An appealing model description does not answer those implementation questions for every possible machine.
Why is it called a generalist policy?
Physical Intelligence describes pi0 as a starting point for different robot tasks and bodies, with either direct prompting or additional fine-tuning for particular applications. Fine-tuning means training the model further for a narrower need. Generalist describes the intended breadth; it does not mean arbitrary hardware will work without adaptation.
A useful way to read that claim is to separate three questions. What did the model learn broadly? What extra task-specific work was done? What did the evaluation actually measure? A specialized result can be valuable while still depending on preparation that a reader would need to reproduce.
For example, suppose you are interested in sorting household objects. A demonstration on a different robot can motivate investigation, but it cannot tell you whether your camera placement, gripper, or object collection is supported. Those details belong in your evaluation question, rather than disappearing behind the word generalist.
The AI models hub covers broader model choices. The same discipline applies here: define the task before deciding whether a model’s strengths matter to you.
How is pi0 different from openpi?
Physical-Intelligence/openpi (opens in a new tab) is the public repository of model code, checkpoints, and examples. pi0 is a model within that work. The repository also covers pi0-FAST and pi0.5, so the original pi0 should not be described as the newest model simply because it introduced the approach.
| Term | What it means | What to record |
|---|---|---|
| pi0 | The original robot policy/model. | Which model family the claim concerns. |
| openpi | The public repository containing model-related code and documentation. | The documentation or code version you read. |
| Checkpoint | A saved model state used for inference or further training. | The exact identifier, rather than only the family name. |
| Inference | Running a model to produce outputs. | The inputs, configuration, and outputs for the run. |
| Fine-tuning | Additional training for a particular need. | The data, starting checkpoint, and resulting saved model. |
Base checkpoints and robot-specific expert checkpoints have different purposes. Follow the repository’s description of the checkpoint you are studying, rather than treating all downloads as equivalent. A result from a particular configuration should remain attached to that configuration when you summarize it.
For the practical repository workflow, use the separate openpi guide. For the general software question of running language models on your own hardware, see self-hosted AI models. Neither question should be confused with understanding what this robot policy controls.
Can you test the model without a robot?
The documented Simple Client example (opens in a new tab) provides a way to test policy inference without a robot. That is a useful boundary: a successful software exchange can show that a model receives inputs and returns outputs, but it does not demonstrate physical task success.
Keep those outcomes in separate sentences. “The inference example returned an output” describes a software result. “The robot completed the sorting task” requires a different experiment and evidence. Combining them into “the model works” hides the distinction the next reader needs most.
Before running anything, read the current Installation and Model Checkpoints sections. The repository documents an Ubuntu environment and suitable NVIDIA hardware, with different resource needs for inference and fine-tuning. Use that documentation for the current requirements rather than assuming a laptop can run every workflow.
This guide explains the documented options; it does not report a model run or a robot experiment. When you do run a supported example, save your actual result and error output rather than copying the expected result from the instructions.
What belongs in a useful experiment record?
Choose vocabulary that makes a later comparison possible. A note saying “tried pi0” leaves too many questions. A useful note says which checkpoint, which example, what inputs were supplied, and what happened. Keep raw artifacts in their appropriate storage and write a short explanation beside the references.
- Question: the specific thing this run is meant to establish.
- Setup: model, checkpoint, code version, configuration, hardware, and relevant environment details.
- Inputs: dataset or observation source and the instruction used.
- Method: whether you performed inference, additional training, simulation, or a physical test.
- Result: what you observed, how you judged it, and where the outputs are stored.
- Limits: failures, missing checks, and conditions the result does not cover.
- Next step: one concrete change or question for the next session.
Change one meaningful condition at a time when your goal is to understand its effect. If the checkpoint, input data, and scoring method all change, you may observe a difference without knowing why. The guide to AI model comparison develops that general evaluation habit.
Keep your own summary and next step in fenbs, so a fresh assistant helping with the research can start from the actual result rather than an optimistic shorthand.
How to keep robot-model notes with fenbs
Save the useful explanation so you can carry on from exactly where you left off, on another device or in another AI. Keep the language simple enough that you can understand it after a few weeks away from the experiment.
- Create a free account.
- Write what you are trying to learn about the model and add the public source links you used.
- After reading or testing, save your own short summary. Include the exact model or checkpoint and say which checks you actually completed.
- Write the next step and anything still unanswered before you stop. Correct the note when new evidence changes your conclusion.
fenbs keeps your research and experiment notes. It does not serve robot policies, train pi0, or replace the storage for datasets and checkpoints. Use the robotics tools for those jobs and keep only the explanatory record here.
Never lose the work you did in an AI session
After a useful AI session, save it in fenbs: the key observations, findings, research and context. Then carry on from exactly where you left off, on any device and in any other AI. The next AI you connect reads it at the start of the session, so you never have to explain the same problem again.
Create a free accountFree for up to 5 people and 50 open tasks · No credit card · Works with Claude, ChatGPT, Cursor and more