Preparing the leaderboard
Loading benchmark results. This can take a little longer after a restart.
Results will appear automatically. You can leave this page open.
Loading benchmark results. This can take a little longer after a restart.
Results will appear automatically. You can leave this page open.
Compare models across
137 specialized benchmarks.
Assess a condition
Select an option
Rate on a scale
| Compare | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 88.99 | 62.60 | 65.22 | 67.74 | 54.83 | 94.00 | 99.34 | 90.99 | TP: 27.36BAP: 26.08B | ||
| 2 | 88.58 | 60.80 | 64.96 | 68.11 | 49.34 | 97.00 | 100.00 | 88.37 | TP: 26.09BAP: 24.81B | ||
| 3 | 87.19 | 59.86 | 64.14 | 67.61 | 47.83 | 96.00 | 100.00 | 85.39 | TP: 26.9BAP: 25.62B | ||
| 4 | 86.73 | 59.59 | 64.63 | 67.22 | 46.92 | 99.00 | 98.68 | 91.14 | TP: —AP: — | ||
| 5 | 82.80 | 58.02 | 58.19 | 64.10 | 51.78 | 94.00 | 98.70 | 93.02 | TP: 25.81BAP: 25.81B | ||
| 6 | 81.75 | 54.56 | 61.38 | 60.70 | 41.61 | 95.00 | 98.03 | 90.19 | TP: 11.91BAP: 11.91B | ||
| 7 | 80.13 | 52.31 | 56.43 | 60.79 | 39.70 | 94.00 | 98.03 | 76.39 | TP: 35.11BAP: 34.6B | ||
| 8 | 77.38 | 48.67 | 53.30 | 58.23 | 34.48 | 92.00 | 95.39 | 76.33 | TP: 8.95BAP: 7.94B | ||
| 9 | 76.21 | 46.68 | 54.77 | 59.92 | 25.36 | 88.00 | 98.03 | 63.84 | TP: 34.66BAP: 34.15B | ||
| 10 | 75.39 | 47.12 | 52.59 | 56.99 | 31.78 | 89.00 | 96.71 | 79.00 | TP: 9.45BAP: 8.43B | ||
| 11 | 75.37 | 48.99 | 52.11 | 56.65 | 38.22 | 91.00 | 94.07 | 81.35 | TP: 9BAP: 7.98B | ||
| 12 | 74.35 | 46.20 | 53.49 | 56.70 | 28.41 | 92.00 | 95.39 | 72.80 | TP: 4.66BAP: 4.66B | ||
| 13 | 74.28 | 50.60 | 51.24 | 61.32 | 39.25 | 52.00 | 80.30 | 31.14 | TP: 395MAP: 343M | ||
| 14 | 73.61 | 47.93 | 55.67 | 54.75 | 33.38 | 92.00 | 94.12 | 87.53 | TP: 11.96BAP: 11.96B | ||
| 15 | 73.42 | 56.88 | 51.48 | 66.91 | 52.26 | 93.00 | 100.00 | 55.91 | TP: 25.64BAP: 24.37B | ||
| 16 | 72.10 | 45.27 | 51.19 | 51.08 | 33.54 | 89.00 | 94.07 | 75.23 | TP: 9.45BAP: 8.43B | ||
| 17 | 72.07 | 52.10 | 55.76 | 55.51 | 45.04 | 93.00 | 96.70 | 67.21 | TP: 7.94BAP: 6.93B | ||
| 18 | 71.69 | 42.84 | 52.40 | 53.99 | 22.12 | 91.00 | 93.43 | 56.82 | TP: 4.21BAP: 4.21B | ||
| 19 | 71.25 | 47.07 | 50.73 | 53.36 | 37.11 | 88.00 | 94.05 | 70.15 | TP: 4.54BAP: 4.54B | ||
| 20 | 71.22 | 44.72 | 49.14 | 53.92 | 31.09 | 87.00 | 92.07 | 68.80 | TP: 9.41BAP: 8.39B | ||
| 21 | 71.00 | 45.52 | 48.86 | 54.82 | 32.88 | 86.00 | 96.04 | 69.84 | TP: 4.21BAP: 4.21B | ||
| 22 | 70.99 | 44.45 | 50.21 | 51.49 | 31.66 | 87.00 | 85.53 | 67.48 | TP: 4.54BAP: 4.54B | ||
| 23 | 70.08 | 42.40 | 50.21 | 56.36 | 20.64 | 87.00 | 96.05 | 70.69 | TP: 7.94BAP: 6.92B | ||
| 24 | 70.02 | 42.79 | 52.93 | 49.07 | 26.36 | 89.00 | 92.10 | 66.70 | TP: 8.92BAP: 8.38B | ||
| 25 | 69.81 | 45.66 | 50.16 | 53.17 | 33.65 | 87.00 | 90.11 | 69.02 | TP: 4.22BAP: 4.22B | ||
| 26 | 69.00 | 45.13 | 51.80 | 49.77 | 33.83 | 92.00 | 93.41 | 74.10 | TP: 4.21BAP: 4.21B | ||
| 27 | 68.62 | 42.33 | 48.48 | 52.03 | 26.47 | 83.00 | 93.44 | 56.06 | TP: 4.21BAP: 3.57B | ||
| 28 | 68.60 | 43.60 | 48.33 | 52.76 | 29.70 | 89.00 | 94.71 | 69.79 | TP: 4.54BAP: 3.9B | ||
| 29 | 67.92 | 41.16 | 49.03 | 52.20 | 22.24 | 91.00 | 93.39 | 67.13 | TP: 4.21BAP: 4.21B | ||
| 30 | 66.87 | 41.14 | 48.93 | 52.84 | 21.65 | 92.00 | 93.39 | 69.64 | TP: 4.21BAP: 4.21B | ||
| 31 | 66.66 | 41.62 | 47.72 | 48.48 | 28.68 | 90.00 | 94.09 | 63.40 | TP: 4.21BAP: 4.21B | ||
| 32 | 66.55 | 41.00 | 48.13 | 53.78 | 21.09 | 81.00 | 94.07 | 65.86 | TP: 4.24BAP: 3.6B | ||
| 33 | 66.12 | 40.48 | 49.93 | 49.01 | 22.51 | 90.00 | 92.77 | 63.18 | TP: 4.21BAP: 4.21B | ||
| 34 | 64.57 | 40.29 | 47.32 | 48.07 | 25.47 | 95.00 | 96.71 | 66.21 | TP: 4.21BAP: 4.21B | ||
| 35 | 62.79 | 40.46 | 42.91 | 51.62 | 26.85 | 31.00 | 57.52 | 8.90 | TP: 68MAP: 42M | ||
| 36 | 62.04 | 37.33 | 47.05 | 45.15 | 19.80 | 78.00 | 93.39 | 59.25 | TP: 4.21BAP: 4.21B | ||
| 37 | 61.85 | 36.46 | 42.77 | 47.49 | 19.11 | 82.00 | 94.12 | 54.13 | TP: 4.54BAP: 3.9B | ||
| 38 | 61.01 | 37.21 | 44.76 | 45.37 | 21.49 | 85.00 | 93.41 | 65.98 | TP: 4.21BAP: 4.21B | ||
| 39 | 60.65 | 36.86 | 44.06 | 46.16 | 20.37 | 81.00 | 94.71 | 49.41 | TP: 4.54BAP: 4.54B | ||
| 40 | 60.26 | 36.01 | 41.04 | 47.54 | 19.45 | 75.00 | 93.41 | 65.84 | TP: 7.57BAP: 6.95B | ||
| 41 | 59.71 | 35.82 | 46.90 | 44.69 | 15.89 | 82.00 | 94.10 | 54.15 | TP: 4.54BAP: 4.54B | ||
| 42 | 56.75 | 32.31 | 40.28 | 43.93 | 12.71 | 81.00 | 92.75 | 49.86 | TP: 4.24BAP: 3.6B | ||
| 43 | 55.41 | 36.64 | 38.37 | 38.63 | 32.92 | 92.00 | 82.23 | 66.95 | TP: 4.03BAP: 4.03B | ||
| 44 | 53.91 | 30.93 | 37.88 | 37.75 | 17.14 | 73.00 | 92.12 | 58.20 | TP: 2.28BAP: 2.01B | ||
| 45 | 53.63 | 31.33 | 37.49 | 41.97 | 14.53 | 76.00 | 92.10 | 48.64 | TP: 4.63BAP: 1.88B | ||
| 46 | 53.39 | 32.05 | 37.89 | 43.10 | 15.16 | 71.00 | 88.82 | 46.12 | TP: 2.21BAP: 1.7B | ||
| 47 | 52.68 | 29.43 | 38.58 | 39.32 | 10.39 | 73.00 | 86.21 | 35.21 | TP: 1.88BAP: 1.88B | ||
| 48 | 52.12 | 34.64 | 38.83 | 39.82 | 25.27 | 71.00 | 85.56 | 40.15 | TP: 1.88BAP: 1.38B | ||
| 49 | 51.08 | 29.10 | 32.24 | 42.67 | 12.40 | 70.00 | 88.16 | 58.80 | TP: 4.02BAP: 3.63B | ||
| 50 | 50.72 | 29.10 | 35.93 | 39.01 | 12.35 | 60.00 | 88.17 | 45.58 | TP: 1.88BAP: 1.37B | ||
| 51 | 49.34 | 27.57 | 31.43 | 35.57 | 15.70 | 15.00 | 39.11 | 2.76 | TP: 17MAP: 4M | ||
| 52 | 46.64 | 25.97 | 31.22 | 34.70 | 12.00 | 64.00 | 84.90 | 32.08 | TP: 853MAP: 597M | ||
| 53 | 45.19 | 25.21 | 29.72 | 37.80 | 8.11 | 70.00 | 88.85 | 33.39 | TP: 2.21BAP: 1.7B | ||
| 54 | 44.99 | 25.52 | 28.05 | 28.08 | 20.43 | 64.00 | 80.94 | 40.24 | TP: 1.74BAP: 1.74B | ||
| 55 | 43.51 | 22.57 | 28.97 | 32.36 | 6.39 | 57.00 | 82.90 | 27.86 | TP: 752MAP: 752M | ||
| 56 | 39.50 | 20.43 | 25.97 | 27.15 | 8.16 | 59.00 | 76.40 | 28.43 | TP: 853MAP: 851M | ||
| 57 | 37.65 | 18.68 | 23.61 | 27.36 | 5.07 | 53.00 | 75.15 | 25.51 | TP: 753MAP: 499M | ||
| 58 | 37.39 | 19.32 | 24.90 | 20.49 | 12.56 | 52.00 | 66.59 | 27.25 | TP: 606MAP: 606M | ||
| 59 | 37.24 | 18.65 | 22.37 | 26.22 | 7.37 | 72.00 | 76.40 | 37.13 | TP: 753MAP: 498M | ||
| 60 | 35.18 | 16.21 | 20.15 | 23.99 | 4.48 | 41.00 | 65.89 | 22.67 | TP: 395MAP: 343M | ||
| 61 | 35.10 | 16.05 | 17.63 | 28.91 | 1.62 | 34.00 | 71.89 | 11.23 | TP: 4.02BAP: 4.02B | ||
| 62 | 34.47 | 16.02 | 18.90 | 23.79 | 5.36 | 57.00 | 77.09 | 22.89 | TP: 853MAP: 597M | ||
| 63 | 33.63 | 15.00 | 20.06 | 18.93 | 5.99 | 22.00 | 58.80 | 14.67 | TP: 421MAP: 370M | ||
| 64 | 33.12 | 14.67 | 18.23 | 23.74 | 2.03 | 30.00 | 73.11 | 14.29 | TP: 607MAP: 451M | ||
| 65 | 33.09 | 15.58 | 13.33 | 31.96 | 1.44 | 41.00 | 85.55 | 11.64 | TP: 4.02BAP: 4.02B | ||
| 66 | 32.67 | 21.02 | 17.61 | 21.15 | 24.31 | 8.00 | 38.45 | 0.00 | TP: 649MAP: 582M | ||
| 67 | 32.07 | 14.07 | 14.69 | 24.03 | 3.51 | 25.00 | 75.08 | 10.59 | TP: 597MAP: 441M | ||
| 68 | 31.89 | 13.36 | 20.19 | 16.31 | 3.58 | 9.00 | 54.83 | 15.67 | TP: 421MAP: 370M | ||
| 69 | 31.39 | 11.28 | 18.10 | 13.61 | 2.14 | 2.00 | 56.25 | 10.23 | TP: 752MAP: 752M | ||
| 70 | 29.87 | 11.57 | 15.03 | 15.55 | 4.13 | 25.00 | 45.68 | 3.59 | TP: 322MAP: 125M | ||
| 71 | 29.33 | 12.43 | 10.94 | 23.10 | 3.25 | 28.00 | 76.40 | 17.10 | TP: 597MAP: 441M | ||
| 72 | 28.56 | 12.51 | 14.33 | 19.50 | 3.70 | 59.00 | 79.75 | 22.71 | TP: 752MAP: 752M | ||
| 73 | 28.40 | 12.11 | 14.51 | 19.39 | 2.43 | 47.00 | 63.98 | 11.63 | TP: 853MAP: 597M | ||
| 74 | 26.84 | 9.28 | 14.01 | 13.03 | 0.79 | 6.00 | 36.67 | 0.75 | TP: 322MAP: 125M | ||
| 75 | 26.02 | 7.85 | 19.52 | 1.05 | 2.98 | 29.00 | 5.43 | 20.53 | TP: 2.52BAP: 2.25B | ||
| 76 | 25.74 | 10.05 | 6.99 | 21.68 | 1.48 | 40.00 | 70.47 | 10.17 | TP: 437MAP: 305M | ||
| 77 | 25.09 | 10.05 | 9.71 | 18.65 | 1.80 | 7.00 | 61.98 | 6.95 | TP: 494MAP: 358M | ||
| 78 | 24.56 | 8.62 | 11.48 | 13.64 | 0.74 | 30.00 | 53.42 | 2.81 | TP: 576MAP: 442M | ||
| 79 | 24.09 | 8.23 | 5.94 | 16.41 | 2.34 | 9.00 | 50.88 | 10.86 | TP: 361MAP: 294M | ||
| 80 | 24.06 | 7.93 | 8.57 | 14.56 | 0.67 | 11.00 | 63.37 | 0.87 | TP: 1.72BAP: 1.72B | ||
| 81 | 23.77 | 7.15 | 14.41 | 5.86 | 1.19 | 9.00 | 21.73 | 3.82 | TP: 7.59BAP: 6.96B | ||
| 82 | 23.68 | 9.56 | 7.33 | 17.67 | 3.68 | 47.00 | 68.54 | 21.68 | TP: 396MAP: 344M | ||
| 83 | 23.60 | 8.31 | 8.44 | 14.48 | 2.02 | 27.00 | 49.54 | 8.44 | TP: 194MAP: 95M | ||
| 84 | 22.40 | 6.36 | 8.56 | 9.66 | 0.86 | 11.00 | 38.55 | 4.19 | TP: 74MAP: 25M | ||
| 85 | 21.85 | 7.44 | 4.57 | 14.25 | 3.50 | 37.00 | 54.14 | 16.73 | TP: 486MAP: 355M | ||
| 86 | 20.46 | 5.96 | 2.90 | 14.79 | 0.20 | 17.00 | 42.46 | 2.12 | TP: 118MAP: 21M | ||
| 87 | 20.45 | 6.52 | 2.46 | 15.54 | 1.57 | 17.00 | 54.19 | 9.51 | TP: 151MAP: 113M | ||
| 88 | 18.24 | 3.33 | 2.03 | 7.95 | 0.00 | 5.00 | 30.86 | 0.00 | TP: 494MAP: 494M | ||
| 89 | 17.68 | 3.26 | 3.03 | 6.47 | 0.27 | 10.00 | 30.72 | 0.77 | TP: 287MAP: 95M | ||
| 90 | 17.20 | 1.16 | 2.80 | 0.67 | 0.00 | 10.00 | 2.42 | 0.00 | TP: 121MAP: 50M | ||
| 91 | 17.07 | 1.38 | 1.49 | 2.65 | 0.00 | 3.00 | 15.10 | 0.00 | TP: 150MAP: 111M | ||
| 92 | 16.41 | 2.49 | 1.57 | 5.74 | 0.16 | 6.00 | 24.83 | 1.26 | TP: 599MAP: 444M | ||
| 93 | 15.97 | 0.60 | 1.45 | 0.34 | 0.01 | 10.00 | 0.00 | 0.08 | TP: 401MAP: 350M | ||
| 94 | 15.28 | 1.92 | 0.00 | 5.75 | 0.00 | 0.00 | 11.22 | 0.00 | TP: 854MAP: 598M |
All benchmarks contribute to this ranking. General columns show the Diverse and Contextual subset already included in the task scores, with no extra weight. This subset does not establish unseen-task generalization.
How a model ranks against other models (0–100; higher is better). 1. Rank models by their adjusted score on each benchmark. 2. Award 100 points to first place and 0 to last, evenly spaced in between. Ties share the average points. 3. Average the points across all benchmarks, with equal weight per benchmark. Tasks with more benchmarks have more weight. General benchmarks count once. Only rank matters, not the size of score gaps. Adding or removing models can change this score. Requires at least two measured models, each with complete results and valid adjusted scores for every benchmark.
Task Avg and task columns are baseline-adjusted scores, not accuracy. 0 means at or below the constant baseline; 100 means the reference ceiling.
Choice: (target mass − baseline) / (1 − baseline). Noul: 2 × balanced accuracy − 1. Score: 1 − MAE / constant baseline MAE.
Clip each benchmark to 0–100, average benchmarks within each task, then average the three tasks equally. Complete measured coverage is required. Baselines are fitted to evaluation targets.
Results prepared: 2026-10-02T21:34:09.142Z
Results source · 25a683e027feS1MB approximates System One capabilities across specialized benchmarks. Scores do not directly measure generalization.