PaperActionMap (50 demos per task)
ActionMap: Robot Policy Learning via Voxel Action Heatmap
Claim tested: ActionMap's voxel action heatmap head improves real-robot task success over OpenVLA-OFT's standard action regression head.
Tested
Result
Improvement over baseline
Not replicated
- Reported
- +33 pts
- Ours
- +2 pts
- Gain vs baseline
- 95% CI, −7 pts to +12 pts
- Paper's reported gain
- No difference
Success rate
- Reported
- 47%
- Ours
- 12%
- Measured on our stations
- 95% CI, 7%–21%
- Reported in the paper
Across iterations
- Iteration 1vs OpenVLA-OFT+14 pts
- Iteration 2vs OpenVLA-OFT+2 pts
By task
| Task | BaselineOpenVLA-OFT | MethodActionMap (50 demos per task) | Improvement |
|---|---|---|---|
| e01Clamp electrical component | 0%0/30 | 0%0/30 | 0 pts−11 to +11 |
| e02Pour screws into the funnel | 7%2/30 | 20%6/30 | +13 pts−5 to +31 |
| e03Datum-corner alignment | 23%7/30 | 17%5/30 | −7 pts−27 to +14 |
| All tasks | 10%9/90 | 12%11/90 | +2 pts−7 to +12 |
| Reported in the paper | 13% | 47% | +33 pts |
Rollouts
One clip per environment from this entry's evaluation, beside where each evaluation episode placed the environment's objects, coloured by its rating. Use the button beside each environment to open its evaluation dataset in the dataset viewer.
e02Pour screws into the funnel BaselineOpenVLA-OFT2/307%
Show in dataset viewer of OpenVLA-OFT on Pour screws into the funnelMethodActionMap (50 demos per task)6/3020%
Show in dataset viewer of ActionMap (50 demos per task) on Pour screws into the funnel- Held-out benchmark environment
e01Clamp electrical component BaselineOpenVLA-OFT0/300%
Show in dataset viewer of OpenVLA-OFT on Clamp electrical componentMethodActionMap (50 demos per task)0/300%
Show in dataset viewer of ActionMap (50 demos per task) on Clamp electrical component - Held-out benchmark environment
e03Datum-corner alignment BaselineOpenVLA-OFT7/3023%
Show in dataset viewer of OpenVLA-OFT on Datum-corner alignmentMethodActionMap (50 demos per task)5/3017%
Show in dataset viewer of ActionMap (50 demos per task) on Datum-corner alignment
Implementation Details
What we changed
We replaced only OpenVLA-OFT’s L1 regression head with the paper’s voxel heatmap head, and trained both on the same 50 demonstrations per task with the paper’s real-robot recipe. Both heads match the official code. The final round re-evaluates these same models on the station’s blend runtime instead of the synchronous one. Differences from the paper:
- Two arms and three cameras. Each step predicts 14 action values instead of 7, and ActionMap has one heatmap branch per arm on a shared trunk.
- Delta actions on absolute targets. Both heads predict per-step deltas that are added to the measured pose, with normalization ranges fitted per chunk position. Rotations are rotation vectors instead of Euler angles.
- Scarce data. Each task’s 50 training episodes are a fixed, seeded subset of the 276 to 288 available demonstrations, stratified by which arm moves.
- Training budget. Both heads train for 4,000 steps at a constant learning rate of 5e-4 and batch 64, without a validation split.
- Chunk timing. Chunks are 16 steps at 30 Hz, about the paper’s 0.5 s horizon.
- Blend execution. The final round requests each next chunk 800 ms ahead and crossfades into it over 600 ms. Because a chunk lasts only 533 ms, a new request starts as soon as the previous one returns, instead of each chunk executing in full before replanning as OFT does.
- Evaluation. Each task runs 30 placements with one trial each, instead of the paper’s 10 trials.
- Hardware. The pour pair trained on four A100s and the other pairs on four H100s, always the same within a task.
Prompt summary
Re-evaluate the six existing models on the blend runtime (AIS blend 85mm) in a new project, with everything else unchanged. (A retraining step with full-data and 50-episode arms, a decaying LR and a validation split was started and then discarded.)
Response summary
On blend, ActionMap vs L1 success: pour 6/30 vs 2/31, push 5/30 vs 7/30, clamp 0/30 vs 0/30 (+2.2 pp, p = 0.80); average progress +16.7 pp (p < 0.001), from better grasps.
Conclusion
Success lead mostly gone on blend, but the progress gain held (+16.7 pp, significant). Concluded: partially reproduced.