Image for post
Image for post

SpaceNet 7 Results: arXiv Paper and Winning Model Release

Adam Van Etten
Feb 16 · 3 min read

Preface: SpaceNet LLC is a nonprofit organization dedicated to accelerating open source, artificial intelligence applied research for geospatial applications, specifically foundational mapping (i.e., building footprint & road network detection). SpaceNet is run in collaboration by co-founder and managing partner CosmiQ Works, co-founder and co-chair Maxar Technologies, and our partners including Amazon Web Services (AWS), Capella Space, Topcoder, IEEE GRSS, the National Geospatial-Intelligence Agency and Planet.

Building tracking and change detection from moderate satellite imagery is surprisingly tractable, as we’ve demonstrated in the last few DownLinQ blogs. The SpaceNet 7 Multi-Temporal Urban Development Challenge yielded some impressive results, with some interesting phenomena noted in analysis blogs 1, 2. This post serve as the final installment in the SpaceNet 7 analysis series, and we are pleased to announce that the winning models are now available in the open source. Furthermore, our paper on the SpaceNet 7 dataset and initial results can now be found on arXiv. In the sections below we explore performance with an interactive map, and provide details on how to access the models.

1. Winning Models

Recall from our results announcement blog that the top-5 submissions to SpaceNet improved markedly upon the SpaceNet 7 algorithmic baseline, and applied a variety of clever approaches to improve performance. Table 1 below details the specifics of each model, while Figure 1 illustrates the SpaceNet Change and Object Tracking (SCOT) score vs inference speed (for an in-depth analysis of SCOT scores, see our previous blog).

Image for post
Image for post
Table 1. SpaceNet 7 winners (originally presented here).
Image for post
Image for post
Figure 1. Performance vs inference speed for the winning algorithms, up and right is best (originally presented here).

Figure 2 links to an interactive (pan, zoom, hover) map that allows interested users to explore various metrics (F1, Track Score, Change Score, and SCOT) for the winning submission of lxastro0.

Image for post
Image for post
Figure 2. Performance in various cities for the winning SpaceNet 7 model. Click on the image for an interactive map.

Figure 3 below provides an example of the winning model’s ability to correctly track building identifiers over time, as well as catalog change.

Image for post
Image for post

The winning algorithms are available under a permissive license at:

https://github.com/SpaceNetChallenge/SpaceNet7_Multi-Temporal_Solutions

All algorithms leverage Docker for easy deployment, and be either trained on new data or tested using existing model weights.

Quantifying population statistics is fundamental to dozens of the United Nations Sustainable Development Goals, yet many countries lack effective civil registration systems. SpaceNet 7 has demonstrated that identifying, tracking, and detecting change in precise building footprints using moderate resolution (4m) Planet imagery is possible. Tracking urbanization and construction at the unique building level is critical for improving upon existing course population estimates. By tracking unique building identifiers SpaceNet 7 algorithms can determine which exact buildings changed (whose properties such as precise location, area can be correlated with features such as road access, distance to hospitals, etc.), thus providing a much more granular view into population growth. We look forward to improvements upon these techniques permitted and encouraged by the open source nature of the dataset and algorithms.

The DownLinQ

Welcome to the official blog of CosmiQ Works, an IQT Lab…

Adam Van Etten

Written by

The DownLinQ

Welcome to the official blog of CosmiQ Works, an IQT Lab dedicated to exploring the rapid advances delivered by artificial intelligence and geospatial startups, industry, academia, and the open source community

Adam Van Etten

Written by

The DownLinQ

Welcome to the official blog of CosmiQ Works, an IQT Lab dedicated to exploring the rapid advances delivered by artificial intelligence and geospatial startups, industry, academia, and the open source community

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store