Self-driving Cars, News, Research

A New Brain-inspired Intelligent System Drives a Car Using Only 19 Control Neurons!

Imitating the nematode’s nervous system to process information efficiently, this new intelligent system is more robust, more interpretable, and faster to train than current deep neural network architectures with millions of parameters.

Image for post
Image for post
Biologically-inspired Neural Networks for Self-Driving Cars — Image from the paper

Deep Neural Networks And Other Approaches

One of the most complicated tasks that machine learning researchers and engineers are currently working on is self-driving cars. This is a task where every option needs to be covered, and completely stable, to be able to deploy it on our roads. This process of training a self-driving car typically requires many training examples from real humans as well as a really deep neural network able to understand these data and reproduce the human behaviors in any situation.

Image for post
Image for post
End-to-end representation of a self-driving algorithm — Image from the paper

Researchers from IST Austria and MIT have successfully trained a self-driving car using a new artificial intelligence system based on the brains of tiny animals, such as threadworms [1]. They achieved that with only a few neurons able to control the self-driving car, compared to the millions of neurons needed by the popular deep neural networks such as Inceptions, Resnets, or VGG. Their network was able to completely control a car using only 75 000 parameters, composed of 19 control neurons, rather than millions!

The Brain-Inspired Intelligent System

Image for post
Image for post
Nematode’s nervous system — Image from Nematode Worm Parks A Car

This is due to the efficient and harmonious way the nematode’s nervous system processes information”. Nematode’s nervous system proves that there is still room for improvement for deep learning models. If nematodes can show interesting behavior while having this extremely small number of neurons after evolving to this near-optimal nervous system structure, we definitely can reproduce this on a machine, too. This neural system allows the nematodes to perform locomotion, motor control, and navigation, which is exactly what we aim for in applications like autonomous driving.

Following this neural system, they “developed new mathematical models of neurons and synapses” called “liquid time constant” or LTC neurons, as Professor Thomas Henzinger said.

One way to make the network simpler was to make it sparse. Meaning that not every cell is connected to every other cell. When a cell is activated, the others are not, which reduces the computation time since all the deactivated cells will not send any output (or a 0 output, which is extremely faster to compute). They also changed the way each cell work. As Dr. Ramin Hasani says, “The processing of the signals within the individual cells follows different mathematical principles than previous deep learning models”.

IST Austria And MIT’s New Intelligent System — NCPs

Image for post
Image for post
End-to-end representation of the architecture — Image from the paper

Which they called a “control system” that steers the vehicle using decisions made by a set of biologically-inspired neurons. This control part is also called neural circuit policy, or NCP. Basically, it translates the data from the compact convolutional model outputs to only 19 neurons in an RNN structure inspired by the nematode’s nervous system controlling the vehicle and allowing it to stay into the lanes. Following the architecture shown above. You can find more details about the implementations of these NCPs networks in their paper or clear guide they made on their GitHub [2].

This is where the biggest reduction in parameters happens. Mathias Lechner explains that “NCPs are up to 3 orders of magnitude smaller than what would have been possible with previous state-of-the-art models” as you can see in table 2 shown below. Both of these systems are trained simultaneously and work together to create this self-driving car.

Image for post
Image for post
Network size comparison — Image from the paper

Being so small, they were able to see where the system was focusing its attention on the images fed. They discovered that having such a small network extracting the most important part of the picture made the few decision neurons focus exclusively on the curbside and the horizon. Which is a unique behavior among artificial intelligence systems that are currently analyzing every single detail of an image, using way too much information than needed.

Image for post
Image for post
Global network dynamics — Image from the paper

Just take a second to look at how little information is sent into the NCP network compared to other types of networks. Just by looking at this image, we can see that it is clearly more efficient and faster to compute than current approaches.

Plus, while noise is a big problem for current approaches, such as rain or snow in lane-keeping applications, their NCP system demonstrated strong resistance to input artifacts because of its architecture and novel neural model keeping their attention on the road horizon even if the input camera is noisy, as you can see in the short video below.

Image for post
Image for post
Robustness demonstrated in a noisy environment — Image from the paper

Conclusion

As it is not already impressive enough, they also made the code publicly available. They even created complete tutorials on how to create/import their new NCP networks using the LTC neurons [3] and how to stack NCP with other types of layers [4]. Everything is available through their GitHub.

Of course, this was a simple overview of this new paper. I strongly recommend reading the paper linked below for more information.

Thank you for reading!

Watch more in a video

If you like my work and want to support me, I’d greatly appreciate it if you follow me on my social media channels:

  • The best way to support me is by following me on Medium.
  • Subscribe to my YouTube channel.
  • Follow my projects on LinkedIn
  • Learn AI together, join our Discord community, share your projects, papers, best courses, find Kaggle teammates, and much more!

References

[2] M. Lechner and R. Hasani, Code for Neural Circuit Policies Enabling Auditable Autonomy, (2020), GitHub

[3] M. Lechner and R. Hasani, Google Colab: Basic usage, (2020), Google Colab

[4] M. Lechner and R. Hasani, Google Colab: Stacking NCPs with other layers, (2020), Google Colab

Towards AI

The Best of Tech, Science, and Engineering.

Sign up for Towards AI Newsletter

By Towards AI

Towards AI publishes the best of tech, science, and engineering. Subscribe with us to receive our newsletter right on your inbox. For sponsorship opportunities, please email us at pub@towardsai.net Take a look

By signing up, you will create a Medium account if you don’t already have one. Review our Privacy Policy for more information about our privacy practices.

Check your inbox
Medium sent you an email at to complete your subscription.

Louis (What’s AI) Bouchard

Written by

I explain Artificial Intelligence terms and news to non-experts. Master student, AI Research Scientist, and YouTube speaker. https://www.youtube.com/c/WhatsAI

Towards AI

Towards AI is a world’s leading multidisciplinary science publication. Towards AI publishes the best of tech, science, and engineering. Read by thought-leaders and decision-makers around the world.

Louis (What’s AI) Bouchard

Written by

I explain Artificial Intelligence terms and news to non-experts. Master student, AI Research Scientist, and YouTube speaker. https://www.youtube.com/c/WhatsAI

Towards AI

Towards AI is a world’s leading multidisciplinary science publication. Towards AI publishes the best of tech, science, and engineering. Read by thought-leaders and decision-makers around the world.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store