One misconception is that Artificial Neural Networks or Deep Learning are biologically inspired. This is NOT true. It may have thought as being true back in the 1950’s when the Perceptron was first introduced. However, at best, Deep Learning employs a cartoonish version of a neuron and the newer architectures are more computational elements that are very different from what a biological neuron would look like. Nevertheless, it is indeed surprising though that despite being very different from biology, the re…

The Alien Style of Deep Learning Generative Design
1.5K
24
Carlos E. Perez
Nathan Rosquist
Feb 25, 2017 · 1 min read

Although it seems that CNN’s at least are indeed “biologically inspired”: “Convolutional Neural Networks (CNN) are biologically-inspired variants of MLPs. From Hubel and Wiesel’s early work on the cat’s visual cortex [Hubel68], we know the visual cortex contains a complex arrangement of cells. These cells are sensitive to small sub-regions of the visual field, called a receptive field. The sub-regions are tiled to cover the entire visual field. These cells act as local filters over the input space and are well-suited to exploit the strong spatially local correlation present in natural images.” http://deeplearning.net/tutorial/lenet.html

    Nathan Rosquist

    Written by

    Nathan Rosquist

    See responses (1)