Poke &Wiggle
Papers
Paper

SMILE

SMILE: Smooth Motion for Improved Long-Horizon VLA Execution

Claim tested: SMILE's B-spline coefficient prediction improves real-robot task success over raw-action SmolVLA at matched prediction and execution horizons.

Tested

Paper
arXiv⁠ (opens in a new tab)
Code
—
Venue
—
Authors
Jongwoo Park et al.
Farm tasks
5
Evaluation
540 episodes (270 for baseline, 270 for method)

Result

Improvement over baseline

Not replicated

Reported
+11 pts
Ours
0 pts
−200+20+40+60
  • Gain vs baseline
  • 95% CI, −9 pts to +9 pts
  • Paper's reported gain
  • No difference

Success rate

Reported
80%
Ours
22%
0%20%40%60%80%100%
  • Measured on our stations
  • 95% CI, 16%–29%
  • Reported in the paper

Across iterations

  1. Iteration 1vs SmolVLA0 pts
  2. Iteration 2vs SmolVLA+6 pts
−200+20+40+60

By task

TaskBaselineSmolVLAMethodSMILEImprovement
e01Clamp electrical component3%1/303%1/300 pts−14 to +14
e02Place loaded boxes in container (bimanual)10%3/307%2/30−3 pts−20 to +13
e03Place spray bottles upright, nozzle forward (bimanual handover)47%14/3050%15/30+3 pts−21 to +27
e04Pour screws into the funnel50%15/3050%15/300 pts−24 to +24
e05Put tools in standing toolbox0%0/300%0/300 pts−11 to +11
All tasks22%33/15022%33/1500 pts−9 to +9
Reported in the paper69%80%+11 pts

Rollouts

One clip per environment from this entry's evaluation, beside where each evaluation episode placed the environment's objects, coloured by its rating. Use the button beside each environment to open its evaluation dataset in the dataset viewer.

  1. e04Pour screws into the funnel
  2. Held-out benchmark environment
    e01Clamp electrical component
  3. Held-out benchmark environment
    e02Place loaded boxes in container (bimanual)
  4. Held-out benchmark environment
    e03Place spray bottles upright, nozzle forward (bimanual handover)
  5. Held-out benchmark environment
    e05Put tools in standing toolbox

Implementation Details

What we changed

We compare SMILE with raw-action SmolVLA to test whether predicting B-spline coefficients improves real-robot task success at matched prediction and execution horizons. No official code is released, so we reimplemented SMILE’s action interface from the paper on SmolVLA’s pretrained backbone. The action expert denoises 8 cubic B-spline control points that are decoded into the action chunk. Both models predict relative translation and rotation-vector actions with absolute gripper widths and use matched training settings within each task.

  • Prediction length. Both models predict 50 action steps, following the SmolVLA recipe. This prediction length is not confirmed in the SMILE paper.
  • Synchronous execution. Both models execute 15 actions per plan, 0.5 seconds at 30 Hz, and the station waits for each plan to finish before requesting the next.
  • Episode-end supervision. We fit splines only to valid samples and supervise only the coefficient directions they determine, filling unconstrained directions with the dataset mean. This retains partial windows in both arms; full windows use the paper’s coefficient-space loss.
  • Fine-tuning budget. Both arms use batch 64, learning rate 1e-4 and at least 20k steps or three epochs, whichever is greater, without image augmentation or a validation split. Exact parity cannot be established because the paper does not report a complete training recipe.

See the code changes on GitHub⁠ (opens in a new tab)

Prompt summary

Test whether SMILE's B-spline coefficient prediction improves real-robot task success over raw-action SmolVLA at matched horizons on 5 tasks, replacing only SmolVLA's action interface and using synchronous fixed-horizon execution for both arms. Use delta translation and rotation-vector actions with an absolute gripper, F=50 and H=15 at 30 Hz, dataset-level coefficient normalisation, validity masking at episode boundaries, and batch 64 with lr 1e-4 for at least 20k steps. Finish the sync comparison by requesting the missing evals.

Response summary

Sync, matched horizons: SmolVLA vs SMILE pour 15/30 vs 15/30, boxes 3/30 vs 2/30, toolbox 0 vs 0, spray 14/30 vs 15/30, clamp 1/30 vs 1/30; 22.0% vs 22.0% success, +3.2 pp progress (p = 0.41).

Conclusion

Level on success under synchronous execution; floor tasks fail at grasp placement, which the action representation does not address. Moved to blended execution next.