Poke &Wiggle

Leaderboard

Model

Gemini 4 Argon

Google DeepMind

#3

Rank · PAW-GEN-10-Agentic

Model information

Website
Website⁠ (opens in a new tab)
Released
September 2026

PAW-GEN-10-Agentic

Share of episodes rated Ok or Excellent.

Summary

Overall Success
35%
Evaluations
900
NominalEvaluated on the placements the model was trained on.InterpolationEvaluated on unseen placements between the training placements.ExtrapolationEvaluated on unseen placements outside the training placements' convex hull.
EnvironmentNominal · D10Trained on ~10 demonstrations per environment.Interpolation · D10Trained on ~10 demonstrations per environment.Extrapolation · D10Trained on ~10 demonstrations per environment.
Basic skills
Sort screws into bins80%#395% CI 63%–90%77%#495% CI 59%–88%27%#495% CI 14%–44%
Datum-corner alignment47%#395% CI 30%–64%27%#495% CI 14%–44%3%#395% CI 1%–17%
Pour screws into the funnel100%#195% CI 89%–100%97%#195% CI 83%–99%93%#195% CI 79%–98%
High precision
Connect DC jack87%#195% CI 70%–95%80%#195% CI 63%–90%47%#195% CI 30%–64%
Route cable through closed hoops3%#295% CI 1%–17%17%#295% CI 7%–34%0%#295% CI 0%–11%
Put tools in standing toolbox3%#295% CI 1%–17%0%#395% CI 0%–11%0%#295% CI 0%–11%
Bimanual
Place loaded boxes in container (bimanual)3%#395% CI 1%–17%7%#495% CI 2%–21%3%#395% CI 1%–17%
Place spray bottles upright, nozzle forward (bimanual handover)83%#495% CI 66%–93%90%#395% CI 74%–97%60%#495% CI 42%–75%
Tool use
Open the toolbox with a screwdriver0%#395% CI 0%–11%0%#295% CI 0%–11%0%#295% CI 0%–11%
Clamp electrical component7%#395% CI 2%–21%3%#495% CI 1%–17%0%#495% CI 0%–11%
Pooled41%#395% CI 36%–47%40%#495% CI 34%–45%23%#495% CI 19%–28%

Spatial Generalization

Spatial generalization for Gemini 4 Argon: SuccessGemini 4 Argon: Nominal 41% (95% CI 36%–47%), Interpolation 40% (95% CI 34%–45%), Extrapolation 23% (95% CI 19%–28%).Success rate (%)04080Gemini 4 Argon: 41% (95% CI 36%–47%) on NominalGemini 4 Argon: 40% (95% CI 34%–45%) on InterpolationGemini 4 Argon: 23% (95% CI 19%–28%) on ExtrapolationNominalInterpolationExtrapolation

Per Environment (Success)

Model performance by environmentGemini 4 Argon overall: Sort screws into bins 61%, Datum-corner alignment 26%, Pour screws into the funnel 97%, Connect DC jack 71%, Route cable through closed hoops 7%, Put tools in standing toolbox 1%, Place loaded boxes in container (bimanual) 4%, Place spray bottles upright, nozzle forward (bimanual handover) 78%, Open the toolbox with a screwdriver 0%, Clamp electrical component 3%.Sort screws into binse01Datum-corner alignmente02Pour screws into the funnele03Connect DC jacke04Route cable through closed hoopse05Put tools in standing toolboxe06Place loaded boxes in container (bimanual)e07Place spray bottles upright, nozzle forward (bimanual handover)e08Open the toolbox with a screwdrivere09Clamp electrical componente10Basic skillsHigh precisionBimanualTool use

Rollouts

Mid-training dataM0
Task-specific dataD10
SpatialNominal

One clip per environment from this entry's evaluation, beside where each evaluation episode placed the environment's objects, coloured by its rating. Use the button beside each environment to open its evaluation dataset in the dataset viewer.

  1. Sort screws into bins
    Success
    80%
    Progress
    92%
  2. Pour screws into the funnel
    Success
    100%
    Progress
    100%
  3. Connect DC jack
    Success
    87%
    Progress
    94%
  4. Route cable through closed hoops
    Success
    3%
    Progress
    59%
  5. Open the toolbox with a screwdriver
    Success
    0%
    Progress
    20%
  6. Held-out benchmark environment
    Datum-corner alignment
    Success
    47%
    Progress
    47%
  7. Held-out benchmark environment
    Put tools in standing toolbox
    Success
    3%
    Progress
    14%
  8. Held-out benchmark environment
    Place loaded boxes in container (bimanual)
    Success
    3%
    Progress
    74%
  9. Held-out benchmark environment
    Place spray bottles upright, nozzle forward (bimanual handover)
    Success
    83%
    Progress
    89%
  10. Held-out benchmark environment
    Clamp electrical component
    Success
    7%
    Progress
    18%

Success by spatial configuration

e01 · Sort screws into bins
Nominal: 80% (95% CI 63%–90%)Interpolation: 77% (95% CI 59%–88%)Extrapolation: 27% (95% CI 14%–44%)NominalInterp.Extrap.
e02 · Datum-corner alignment
Nominal: 47% (95% CI 30%–64%)Interpolation: 27% (95% CI 14%–44%)Extrapolation: 3% (95% CI 1%–17%)NominalInterp.Extrap.
e03 · Pour screws into the funnel
Nominal: 100% (95% CI 89%–100%)Interpolation: 97% (95% CI 83%–99%)Extrapolation: 93% (95% CI 79%–98%)NominalInterp.Extrap.
e04 · Connect DC jack
Nominal: 87% (95% CI 70%–95%)Interpolation: 80% (95% CI 63%–90%)Extrapolation: 47% (95% CI 30%–64%)NominalInterp.Extrap.
e05 · Route cable through closed hoops
Nominal: 3% (95% CI 1%–17%)Interpolation: 17% (95% CI 7%–34%)Extrapolation: 0% (95% CI 0%–11%)NominalInterp.Extrap.
e06 · Put tools in standing toolbox
Nominal: 3% (95% CI 1%–17%)Interpolation: 0% (95% CI 0%–11%)Extrapolation: 0% (95% CI 0%–11%)NominalInterp.Extrap.
e07 · Place loaded boxes in container (bimanual)
Nominal: 3% (95% CI 1%–17%)Interpolation: 7% (95% CI 2%–21%)Extrapolation: 3% (95% CI 1%–17%)NominalInterp.Extrap.
e08 · Place spray bottles upright, nozzle forward (bimanual handover)
Nominal: 83% (95% CI 66%–93%)Interpolation: 90% (95% CI 74%–97%)Extrapolation: 60% (95% CI 42%–75%)NominalInterp.Extrap.
e09 · Open the toolbox with a screwdriver
Nominal: 0% (95% CI 0%–11%)Interpolation: 0% (95% CI 0%–11%)Extrapolation: 0% (95% CI 0%–11%)NominalInterp.Extrap.
e10 · Clamp electrical component
Nominal: 7% (95% CI 2%–21%)Interpolation: 3% (95% CI 1%–17%)Extrapolation: 0% (95% CI 0%–11%)NominalInterp.Extrap.