Sample Efficiency: Humans vs Models
Everyone agrees models need far more data than children. The size of the gap depends entirely on decisions about what to count, and those decisions move the answer by more than the disagreement they are meant to settle. Why there is no single number The comparison sounds like it should reduce to a ratio: tokens seen by a model, words heard by a child, divide. Four things prevent that. The human…
We haven't written up this one. Dev.to has the full story — the link below goes straight to it.