Artificial Intelligence
Scaling Laws Explained: Why Bigger Models Got Better
Neural scaling laws explained: what Kaplan (2020) and Chinchilla (2022) found about parameters, data, and compute, and where the power laws stop working.
1 article tagged with #compute-optimal
Neural scaling laws explained: what Kaplan (2020) and Chinchilla (2022) found about parameters, data, and compute, and where the power laws stop working.