PaperOpen-Loop Execution
Revisiting Open-Loop Execution in Robotics: Toward Reactive, Higher-Performing Policies
Claim tested: Longer observation histories combined with shorter open-loop execution improve real-robot task success over short-history, long-execution Diffusion Policies, with the action prediction horizon held fixed.
Tested
Result
Improvement over baseline
Inconclusive
- Reported
- +10 pts
- Ours
- +6 pts
- Gain vs baseline
- 95% CI, −7 pts to +18 pts
- Paper's reported gain
- No difference
Success rate
- Reported
- 88%
- Ours
- 45%
- Measured on our stations
- 95% CI, 36%–54%
- Reported in the paper
Across iterations
- Iteration 1vs Short context, long execution+1 pts
- Iteration 2vs Short context, long execution−1 pts
- Iteration 3vs Short context, long execution+6 pts
By task
| Task | BaselineShort context, long execution | MethodOpen-Loop Execution | Improvement |
|---|---|---|---|
| e01Open the toolbox with a screwdriver | 17%5/30 | 10%3/30 | −7 pts−25 to +12 |
| e02Place loaded boxes in container (bimanual) | 3%1/30 | 40%12/30 | +37 pts+16 to +55 |
| e03Pour screws into the funnel | 80%24/30 | 77%23/30 | −3 pts−24 to +17 |
| e04Datum-corner alignment | 57%17/30 | 53%16/30 | −3 pts−27 to +21 |
| All tasks | 39%47/120 | 45%54/120 | +6 pts−7 to +18 |
| Reported in the paper | 78% | 88% | +10 pts |
Rollouts
One clip per environment from this entry's evaluation, beside where each evaluation episode placed the environment's objects, coloured by its rating. Use the button beside each environment to open its evaluation dataset in the dataset viewer.
e01Open the toolbox with a screwdriver BaselineShort context, long execution5/3017%
Show in dataset viewer of Short context, long execution on Open the toolbox with a screwdriverMethodOpen-Loop Execution3/3010%
Show in dataset viewer of Open-Loop Execution on Open the toolbox with a screwdrivere03Pour screws into the funnel BaselineShort context, long execution24/3080%
Show in dataset viewer of Short context, long execution on Pour screws into the funnelMethodOpen-Loop Execution23/3077%
Show in dataset viewer of Open-Loop Execution on Pour screws into the funnel- Held-out benchmark environment
e02Place loaded boxes in container (bimanual) BaselineShort context, long execution1/303%
Show in dataset viewer of Short context, long execution on Place loaded boxes in container (bimanual)MethodOpen-Loop Execution12/3040%
Show in dataset viewer of Open-Loop Execution on Place loaded boxes in container (bimanual) - Held-out benchmark environment
e04Datum-corner alignment BaselineShort context, long execution17/3057%
Show in dataset viewer of Short context, long execution on Datum-corner alignmentMethodOpen-Loop Execution16/3053%
Show in dataset viewer of Open-Loop Execution on Datum-corner alignment
Implementation Details
What we changed
We reproduced the paper’s real-robot comparison: a Diffusion Policy with 2 history frames that executes 0.8 s of each plan, against one with 8 history frames that replans every 0.3 s. Both arms predict 1.5 s of actions, plus the past actions in their history window. We ported the authors’ DINOv3 encoder, cross-attention U-Net and double encoder from their released code, and verified exact numerical parity with it. Both arms use this architecture and the same training recipe, so they differ only in history length and execution horizon. Adaptations to our platform:
- The method replans every 0.3 s instead of 0.2 s, because observation delay and inference together take about 220 ms on our system.
- Both arms run asynchronously on the station’s blend runtime, which crossfades into each new plan over 400 ms. At this latency the paper’s 180 ms interpolation never takes effect. Image embeddings are cached between replans.
- Both arms use real-time chunking at serving time, which steers each new plan toward the actions already committed. We adapted it from flow matching to the policy’s 10-step DDIM sampler; the paper does not use it.
- Actions run at 30 Hz instead of 10 Hz, with all horizons matched in seconds.
- Actions are per-step end-effector pose deltas anchored to the robot’s commanded pose, with absolute gripper widths. The commanded pose is also a model input. In training the anchor is the previous recorded action, because our datasets do not store the commanded pose. The paper does not specify its delta reference.
- The control uses the method’s architecture and is trained for 200k steps, instead of the paper’s simpler single-encoder baseline trained for 400k steps. Both arms train at batch 48 with the authors’ EMA.
- Checkpoints are selected by validation DDIM MSE among the 5 best, without hardware screening.
- Evaluation covers 4 tasks with 30 paired placements per arm.
Prompt summary
Add serving-time Real-Time Chunking to both arms, adapted from the paw-policy-toolkit DiT Flow example to DDIM-10 with guidance in the target-anchored delta space and the gripper handled separately, without retraining. Unit-test it, replay offline and serve-validate with under 30 ms of added latency. Re-run the 8 evals on blend-short with the same setup as 3140–3147, replan 9/24 and the stop rule, and compare success and average progress against the no-RTC round.
Response summary
To=2 vs To=8 with RTC: push 17/30 vs 16/30, toolbox 5/30 vs 3/29, boxes 1/30 vs 12/30, pour 24/30 vs 23/30; +5.8 pp success for To=8 (p = 0.36), +5.1 pp progress (p = 0.28). RTC closed the toolbox progress gap; the boxes lead comes from the To=2 arm collapsing (10/30 → 1/30).
Conclusion
With RTC, longer history performed better (+5.8 pp success, +5.1 pp average progress), but not significantly (p = 0.36); most of the gain comes from boxes. Concluded.