CVPR’20: The Garden of Forking Paths: Towards Multi-Future Trajectory Prediction

The Forking Paths Dataset

Human annotation interface.
The first benchmark for quantitative evaluation of the models to predict multi-future trajectories.
Human annotators will observe the scenario for a period of time (the yellow path) and then assume control to navigate to the destination. There is a time limit of 10.4 seconds and the annotation session will restart if the agent collides with others.
We provide a powerful editing interface to easily create, edit and playback scenarios in simulation.

The Multiverse Model

The Multiverse Model for Multi-Future Trajectory Prediction
  • History Encoder computes representations from scene semantics
  • Coarse Location Decoder predicts multiple future grid location sequences by using beam search
  • Fine Location Decoder predicts exact future locations based on the grid predictions
  • Our model achieves STOA performance in the single-future trajectory prediction experiment and also the proposed multi-future trajectory prediction on the Forking Paths Dataset.
Single-Future Trajectory Prediction. The numbers are displacement errors and they are lower the better. For more details see [1].
Multi-Future Trajectory Prediction on the Forking Paths Dataset. The numbers are displacement errors and they are lower the better. For more details see [1].
Qualitative comparison. The left column is from the Social-GAN [2] model. On the right it is our Multiverse model. The yellow trajectory is the observed trajectory and the green ones are the multi-future trajectory ground truth. The yellow-orange heatmaps are the model outputs
Here is the correct prediction. Did you get it right?

--

--

--

Ph.D. from CMU doing Computer Vision. My academic site: https://junweiliang.me/

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Implementing a Monte-Carlo Forecast of the Next Period of an Asset in Superalgos

Cognitive Load and how researchers are estimating it?

Copy/Paste a DataFrame with pd-replicator

Visualize data with Choropleth maps

The Ultimate Interview Prep Guide for Data Scientists and Data Analysts

Domestic Lifetime Gross Prediction for PG-13 Movies

Using AI to understand and extract data from your documents

Data loves to be Portrayed

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Junwei Liang

Junwei Liang

Ph.D. from CMU doing Computer Vision. My academic site: https://junweiliang.me/

More from Medium

Python: more details about function

Why do I receive the error “GETDATA timed out before FRAMES

A Review of PointPillars: Fast Encoders for Object Detection from Point Clouds

Dijkstra’s Algorithm