Homepage
Sign in
Get started
Homepage
Deep Learning Patterns, Methodology and Strategy
Patterns
Methodology
Strategy
Deep Learning Playbook
Follow
The Two Phases of Gradient Descent in Deep Learning
The Two Phases of Gradient Descent in Deep Learning
Thanks to great experimental work by several research groups studying the behavior of Stochastic Gradient Descent (SGD), we are…
Carlos E. Perez
Mar 31
Businesses Need Artificial “Specialist” Intelligence, Not the Other Kind
Businesses Need Artificial “Specialist” Intelligence, Not the Other...
Here is the stark reality about businesses, we need specialists to do almost all our jobs. What this means in terms of the development of…
Carlos E. Perez
May 8
Taxonomy of Methods for Deep Meta Learning
Taxonomy of Methods for Deep Meta Learning
Let’s talk about Meta-Learning because this is one confusing topic. I wrote a previous post about Deconstructing Meta-Learning which…
Carlos E. Perez
Mar 5
Latest
Dissipative Adaptation: The Origins of Life and Deep Learning
Dissipative Adaptation: The Origins of Life and Deep Learning
In a previous post, I wrote about Deep Learning not being Probabilistic Induction and actually being something else entirely. However, I…
Carlos E. Perez
Nov 21
Deep Learning in Not Probabilistic Induction
Deep Learning in Not Probabilistic Induction
There is a questionable assumption that is prevalent that Deep Learning is a form of probabilistic or statistical induction. We see this in…
Carlos E. Perez
Nov 21
Deconstructing Randomness as Chaos and Entanglement in Disguise
Deconstructing Randomness as Chaos and Entanglement in Disguise
Here’s a question the perhaps needs to be asked, but hasn’t been asked enough. What is randomness and where does it come from?
Carlos E. Perez
Nov 18
The Shocking Effectiveness of Thermometer Encoding
The Shocking Effectiveness of Thermometer Encoding
Deep Learning architectures are built using real numbers in theory and in practice encodings in 32-bit or 16-bit floating point numbers…
Carlos E. Perez
Nov 16
How Cargo Cult Bayesians encourage Deep Learning Alchemy
How Cargo Cult Bayesians encourage Deep Learning Alchemy
There is a struggle today for the heart and minds of Artificial Intelligence. It’s a complex “Game of Thrones” conflict that involves many…
Carlos E. Perez
Nov 16
Stop Autonomous Weapons Now
Stop Autonomous Weapons Now
Watch this video (by Stuart Russell):
Carlos E. Perez
Nov 13
Is Deep Learning “Software 2.0”?
Is Deep Learning “Software 2.0”?
Andrej Karpathy wrote an article about what he calls “Software 2.0”. Karpathy (Director of AI at Tesla) makes the argument that Neural…
Carlos E. Perez
Nov 12
Revisiting Deep Learning as a Non-Equilibrium Process
Revisiting Deep Learning as a Non-Equilibrium Process
Last year, the best paper award for ICLR 2017 went to “Re-thinking Generalization” by Chiyuan Zhang et al. For a good review, here is a…
Carlos E. Perez
Nov 10
Autoregressive Networks: the Obscure Kind of Generative Network
Autoregressive Networks: the Obscure Kind of Generative Network
Another shocker from the insane world of Deep Learning:
Carlos E. Perez
Nov 6
How to Grow the Innate Machinery for AGI
How to Grow the Innate Machinery for AGI
Gary Marcus and Yann Lecun held a fascinating debate that explored their divergent approaches towards more intelligent machines. I…
Carlos E. Perez
Nov 4
Should Probabilistic Inference be Thrown Under the Bus?
Should Probabilistic Inference be Thrown Under the Bus?
So, what’s Yann LeCun talking about when he says “he’s ready to throw Probability Theory under the bus”?
Carlos E. Perez
Nov 2
These Images are Generated by a Deep Learning GAN
These Images are Generated by a Deep Learning GAN
I am speechless.
Carlos E. Perez
Oct 27
Why AlphaGo Zero is a Quantum Leap Forward in Deep Learning
Why AlphaGo Zero is a Quantum Leap Forward in Deep Learning
The 1983 movie “War Games” has a memorable climax where the supercomputer known as WOPR (War Operation Plan Response) is asked to train on…
Carlos E. Perez
Oct 22
About Intuition Machine
Latest Stories
Archive
About Medium
Terms
Privacy