Waymo Dataset— Using Yonohub to develop, evaluate and benchmark over the cloud (Part 1)
We are pleased to announce the release of Waymo open Dataset blocks on Yonohub. With these blocks, you can use the dataset directly on Yonohub without downloading it or setting up any special environment. Seamlessly integrate your algorithms and blocks and connect them to the dataset. Share and publish your blocks directly on Yonohub to showcase your solution while protecting all IPs. Sign up now and start using the dataset and blocks. You can also run your blocks against other datasets available on Yonohub: nuScenes, KITTI, BDD, Comm.ai, and ApolloScape.
Introduction
Waymo Team is well-known for its development in autonomous vehicles since 2009, and in 2017 they started a limited trial of a self-driving taxi in Arizona state then created a commercial self-driving car service in 2018 called “Waymo One.” Their development in autonomous vehicles is great in terms of reliability of their systems as the system has never been involved in an accident while on autonomous mode ever before.
In October 2018, Waymo celebrated 10 million miles of self-driving in its fleet.
In August 2019, Wamyo released the Waymo Open Dataset, which is the largest multimodal corpus for autonomous driving.
Sensor Layout and Coordinate Systems
The dataset provides a variety of sensor outputs shown in the following figure of sensor configuration on Waymo’s autonomous vehicle:
Dataset camera images are 1920x1280, which is equivalent to Ultra HD resolution and a horizontal field of view (HFOV) of +-25.2 degree.
LiDAR sensors in Waymo open dataset output massive amounts of points and covers each corner around the vehicle with almost no blind spots that the sensor can’t cover. Top LiDAR covers a vertical field of view (VFOV) from -17.6 to 2.4 degrees, and its range is 75 meters and covers 360 degrees horizontally. Front, side left, side right, and rear LiDARs covers a relatively smaller area than the top LiDAR. They all include a vertical field of view (VFOV) from -90 to 30 degrees, and their range is 20 meters, which is smaller than the top LiDAR.
Waymo On Yonohub
Yonohub is the first cloud-based system for designing, sharing, and evaluating autonomous vehicle algorithms using just blocks. Yonohub features a drag-and-drop tool to build complex systems consisting of many blocks, a marketplace to share and monetize blocks, a builder for custom environments, and much more.
I created a Waymo Dataset Player block on Yonohub to ease the development of autonomous vehicles technology, whether you want to benchmark your detection algorithm or perform 3D mapping, localization, image segmentation, etc. The Dataset Player block gives you access to:
- Camera Images: Outputs five images from the five cameras around the vehicle.
- LiDAR data: Outputs five Point Cloud messages, one for each sensor of the five LiDAR sensors.
- 2D Object Bounding Boxes: for each of the five cameras, bounding boxes with labels for the objects are published.
- 3D Object Bounding Boxes: for LiDARs, bounding boxes with labels and metadata such as speed and acceleration in x,y directions are published.
- Vehicle Poses: for each frame, vehicle poses are broadcasted as a transformation from Odom frame to base_link frame.
- Sensors Transformations: for each frame, sensors transformations are broadcasted from base_link to sensor_frame.
Waymo Dataset Player pipeline on Yonohub:
Camera images with drawn bounding boxes in the dashboard:
LiDAR point cloud data as appears on RVIZ:
Here is a quick tutorial on how to create the same pipeline presented above and visualize Waymo data in less than 5 mins:
About YonoHub:
Yonohub is a web-based cloud system for development, evaluation, integration, and deployment of complex systems, including Artificial Intelligence, Autonomous Driving, and Robotics. Yonohub features a drag-and-drop tool to build complex systems, a marketplace to share and monetize blocks, a builder for custom development environments, and much more. YonoHub can be deployed on-premises and on-cloud.
Get $25 free credits when you sign up now. For researchers and labs, contact us to learn more about Yonohub sponsorship options. Yonohub: A Cloud Collaboration Platform for Autonomous Vehicles, Robotics, and AI Development. www.yonohub.com
If you liked this article, please consider following us on Twitter at @yonohub, email us directly or find us on LinkedIn. I’d love to hear from you if I can help you or your team with how to use YonoHub.
References:
[1]- https://arxiv.org/abs/1912.04838
[2]- https://github.com/waymo-research/waymo-open-dataset
[3]- https://yonohub.com/
