Poke &Wiggle
Papers
Paper

Open-Loop Execution

Revisiting Open-Loop Execution in Robotics: Toward Reactive, Higher-Performing Policies

Claim tested: Longer observation histories combined with shorter open-loop execution improve real-robot task success over short-history, long-execution Diffusion Policies, with the action prediction horizon held fixed.

Tested

Paper
arXiv⁠ (opens in a new tab)
Code
GitHub⁠ (opens in a new tab)
Venue
—
Authors
Michael Zeng et al.
Farm tasks
7
Evaluation
780 episodes (390 for baseline, 390 for method)

Result

Improvement over baseline

Inconclusive

Reported
+10 pts
Ours
+6 pts
−200+20+40+60
  • Gain vs baseline
  • 95% CI, −7 pts to +18 pts
  • Paper's reported gain
  • No difference

Success rate

Reported
88%
Ours
45%
0%20%40%60%80%100%
  • Measured on our stations
  • 95% CI, 36%–54%
  • Reported in the paper

Across iterations

  1. Iteration 1vs Short context, long execution+1 pts
  2. Iteration 2vs Short context, long execution−1 pts
  3. Iteration 3vs Short context, long execution+6 pts
−200+20+40+60

By task

TaskBaselineShort context, long executionMethodOpen-Loop ExecutionImprovement
e01Open the toolbox with a screwdriver17%5/3010%3/30−7 pts−25 to +12
e02Place loaded boxes in container (bimanual)3%1/3040%12/30+37 pts+16 to +55
e03Pour screws into the funnel80%24/3077%23/30−3 pts−24 to +17
e04Datum-corner alignment57%17/3053%16/30−3 pts−27 to +21
All tasks39%47/12045%54/120+6 pts−7 to +18
Reported in the paper78%88%+10 pts

Rollouts

One clip per environment from this entry's evaluation, beside where each evaluation episode placed the environment's objects, coloured by its rating. Use the button beside each environment to open its evaluation dataset in the dataset viewer.

  1. e01Open the toolbox with a screwdriver
  2. e03Pour screws into the funnel
  3. Held-out benchmark environment
    e02Place loaded boxes in container (bimanual)
  4. Held-out benchmark environment
    e04Datum-corner alignment

Implementation Details

What we changed

We reproduced the paper’s real-robot comparison: a Diffusion Policy with 2 history frames that executes 0.8 s of each plan, against one with 8 history frames that replans every 0.3 s. Both arms predict 1.5 s of actions, plus the past actions in their history window. We ported the authors’ DINOv3 encoder, cross-attention U-Net and double encoder from their released code, and verified exact numerical parity with it. Both arms use this architecture and the same training recipe, so they differ only in history length and execution horizon. Adaptations to our platform:

  • The method replans every 0.3 s instead of 0.2 s, because observation delay and inference together take about 220 ms on our system.
  • Both arms run asynchronously on the station’s blend runtime, which crossfades into each new plan over 400 ms. At this latency the paper’s 180 ms interpolation never takes effect. Image embeddings are cached between replans.
  • Both arms use real-time chunking at serving time, which steers each new plan toward the actions already committed. We adapted it from flow matching to the policy’s 10-step DDIM sampler; the paper does not use it.
  • Actions run at 30 Hz instead of 10 Hz, with all horizons matched in seconds.
  • Actions are per-step end-effector pose deltas anchored to the robot’s commanded pose, with absolute gripper widths. The commanded pose is also a model input. In training the anchor is the previous recorded action, because our datasets do not store the commanded pose. The paper does not specify its delta reference.
  • The control uses the method’s architecture and is trained for 200k steps, instead of the paper’s simpler single-encoder baseline trained for 400k steps. Both arms train at batch 48 with the authors’ EMA.
  • Checkpoints are selected by validation DDIM MSE among the 5 best, without hardware screening.
  • Evaluation covers 4 tasks with 30 paired placements per arm.

See the code changes on GitHub⁠ (opens in a new tab)

Prompt summary

Add serving-time Real-Time Chunking to both arms, adapted from the paw-policy-toolkit DiT Flow example to DDIM-10 with guidance in the target-anchored delta space and the gripper handled separately, without retraining. Unit-test it, replay offline and serve-validate with under 30 ms of added latency. Re-run the 8 evals on blend-short with the same setup as 3140–3147, replan 9/24 and the stop rule, and compare success and average progress against the no-RTC round.

Response summary

To=2 vs To=8 with RTC: push 17/30 vs 16/30, toolbox 5/30 vs 3/29, boxes 1/30 vs 12/30, pour 24/30 vs 23/30; +5.8 pp success for To=8 (p = 0.36), +5.1 pp progress (p = 0.28). RTC closed the toolbox progress gap; the boxes lead comes from the To=2 arm collapsing (10/30 → 1/30).

Conclusion

With RTC, longer history performed better (+5.8 pp success, +5.1 pp average progress), but not significantly (p = 0.36); most of the gain comes from boxes. Concluded.