TraceML: An Empirical Analysis of Human-Agent Planning in Machine Learning Development
Large language models write correct code for isolated problems but remain far weaker at autonomous machine-learning development, where an agent must revise data pipelines, models, and validation over hours of feedback, and on most competitions still finishes below strong human competitors. Outcome-based benchmarks record this gap but not its cause, because they grade the final submission and…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
