scaling-laws

Neural scaling laws explained: what Kaplan (2020) and Chinchilla (2022) found about parameters, data, and compute, and where the power laws stop working.

What large language models can do, how scale and training methods produced those abilities, and where documented failures remain, with sourced benchmarks.