Towards a Physiological Scaling Law: Model Quality vs. Cohort Size for Stochastic Sequence Data
Scaling laws help determine the optimal data size for training large models but are established in domains where the target is deterministic. Physiological signals are different: heartbeat sequences are stochastic, so part of the error is irreducible even with large amounts of data. Metrics such as MAE do not account for non-deterministic behavior, and therefore assessing scaling requires…
We haven't written up this one. bioRxiv has the full story — the link below goes straight to it.