#reportingScaling and efficiency language exceeds testing
The Abstract describes competitive scaling from evidence at two retrofit scales, while the Conclusion describes arbitrary granularity changes from a finite compression experiment. These statements imply broader validation than the experiments provide.
↳ Abstract, final sentence; Conclusion; Fig. 2
#methodological rigourSingle runs leave training robustness unresolved
Benchmark bootstrapping measures variation across selected tasks rather than independent training runs. Related benchmarks, including pass@1 and pass@16 versions of code tasks, also limit the independence of the resampled units.
↳ Table 1; Fig. 2 caption; Methods, Statistical tests
#contributionAggregate parity conceals category performance losses
Bwen scores 60.2 versus Qwen3's 68.2 on Math and 39.6 versus 45.8 on Code pass@1. Character gains also combine architectural changes with synthetic training data, with a matched continued-training control available only for Olmo.
↳ Table 1; Performance after byteification; Methods, Character-level training data