Training Everything All the Time