AREA 1
Learning in networks and populations
Why do enormous networks generalise, and what stays fixed while a population adapts?
Networks large enough to memorise their data still work on data they have never seen. Their error falls as a clean power of data and compute, and full-batch gradient descent drives their curvature to the value at which training should break down, then keeps training there. None of this follows from the rules as written, and no known measure of a solution yet says reliably whether it will generalise. Evolution poses the same question from the other side: what a theory of selection could predict rather than recount, and how rugged real fitness landscapes are.