The 120 years of Moore’s Law.

“I used to say that this is the most important graph in all the technology business. I’m now of the opinion that this is the most important graph ever graphed.” — Steve Jurvetson

The 7 most recent data points are all NVIDIA GPUs. The fine-grained parallel compute architecture of a GPU maps better to the needs of deep learning than a CPU. There is a poetic beauty to the computational similarity of a processor optimized for graphics processing and the computational needs of a sensory cortex, as commonly seen in neural networks today.

However, most strikingly, is the fact that the Moore’s law has been at works even during the pre-IC era (from mechanical, relay, vacuum tubes, to transistors).