Sep 5, 2018 · 1 min read
To tack on to the below statement, one interesting idea is to treat nodes as layers and optimize the number of nodes in any given layer rather than stochastically adding/removing individual nodes. That seems to be similar to what was done in Miikkulainen 2017 (Evolving Deep Neural Networks) and Assuncao 2018 (DENSER).