The Underwhelming Universal Approximation Theorem
Introduction
A research advisor brought up the Universal Approximation Theorem during a meeting once as a fun thought experiment. It stuck with me because I initially found it super interesting that a neural network could do so much, but the more I thought about it, it became a lot more underwhelming.