‘Active Neural Slam’ Uses Classical and Learning Approaches to Explore 3D Spaces

Synced
Synced
Apr 14 · 4 min read
Image for post
Image for post

Navigation is a key task in building an intelligent agent. Regardless of the task, the core problem for navigation in an unknown environment is exploration, which means how to effectively access as many environments as possible. This is useful for maximizing coverage to provide the best opportunities for finding targets in unknown environments or to effectively pre-map environments in limited time budgets.

The new paper Learning to Explore Using Active Neural Slam from researchers at Carnegie Mellon University, Facebook AI Research, and University of Illinois at Urbana-Champaign, introduces Active Neural SLAM, a modular and hierarchical approach to learning policies for exploring 3D environments.

Previous research has used an end-to-end learning approach to solve this problem. But such end-to-end learning work for exploration relies on the use of imitation learning and millions of experience frameworks. It can be excessively expensive and performance is still no better than traditional methods that require no training at all.

The Active Neural SLAM approach benefits from the strengths of both classical and learning-based methods by using analytical path planners with learned SLAM modules, and global and local policies. This enables the method to retain advantages that learning has to offer while eliminating the problems associated with full-blown end-to-end learning.

Image for post
Image for post
Image for post
Image for post
Overview of the Active Neural SLAM approach

The proposed Active Neural SLAM exploration architecture is composed of a learned Neural SLAM module, a global policy, and a local policy, which are interfaced through a map and an analytical path planner. The learned Neural SLAM module generates free space maps and estimates agent pose based on the input RGB images and motion sensors. These maps and poses are used by the global policy to formulate a long-term goal, which is converted to a short-term goal for the local policy using an analytic path planner. This local policy is trained to navigate to this short-term goal by using learning to directly map original RGB images to the operation that the agent should perform.

Image for post
Image for post
Exploration performance of the Active Neural SLAM (ANS) model and baselines

The Active Neural SLAM model and all baselines of the “Exploration” mission for 10 million frames were trained on the Habitat simulator with the Gibson and Matterport (MP3D) datasets. The proposed model achieved an average absolute and relative coverage of 32.701m2/0.948 as compared to 24.863m2/0.789 for the best baseline. This demonstrates the Active Neural SLAM model is more effective in exhaustive exploration compared to the baseline. The improvement is attributed to a reduction in the horizon of the long-term exploration problem with hierarchical strategy architecture, with the global policies instead taking tens of low-level actions in terms of navigation.

PyTorch implementation of Active Neural SLAM and pretrained models are available on the project’s GitHub. The paper Learning to Explore Using Active Neural Slam is on arXiv.

Author: Xuehan Wang | Editor: Michael Sarazen

Thinking of contributing to Synced Review? Synced’s new column Share My Research welcomes scholars to share their own research breakthroughs with global AI enthusiasts.

Image for post
Image for post

We know you don’t want to miss any story. Subscribe to our popular Synced Global AI Weekly to get weekly AI updates.

Image for post
Image for post

Need a comprehensive review of the past, present and future of modern AI research development? Trends of AI Technology Development Report is out!

2018 Fortune Global 500 Public Company AI Adaptivity Report is out!
Purchase a Kindle-formatted report on Amazon.
Apply for Insight Partner Program to get a complimentary full PDF report.

Image for post
Image for post

SyncedReview

We produce professional, authoritative, and…

Synced

Written by

Synced

AI Technology & Industry Review — syncedreview.com | Newsletter: http://bit.ly/2IYL6Y2 | Share My Research http://bit.ly/2TrUPMI | Twitter: @Synced_Global

SyncedReview

We produce professional, authoritative, and thought-provoking content relating to artificial intelligence, machine intelligence, emerging technologies and industrial insights.

Synced

Written by

Synced

AI Technology & Industry Review — syncedreview.com | Newsletter: http://bit.ly/2IYL6Y2 | Share My Research http://bit.ly/2TrUPMI | Twitter: @Synced_Global

SyncedReview

We produce professional, authoritative, and thought-provoking content relating to artificial intelligence, machine intelligence, emerging technologies and industrial insights.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store