Deep learning on the brink of expansion