Overview – Waymo

Challenge 1

3D Detection

Given one or more lidar range images and the associated camera images, produce a set of 3D upright boxes for the objects in the scene.

2D Detection

Given a set of camera images, produce a set of 2D boxes for the objects in the scene.

3D Tracking

Given a temporal sequence of lidar and camera data, produce a set of 3D upright boxes and the correspondence between boxes across frames.

2D Tracking

Given a temporal sequence of camera images, produce a set of 2D boxes and the correspondence between boxes across frames.

Domain Adaptation

Similar to the 3D Detection Challenge, but we provide additional segments from a new location and only a subset have labels.

Submissions are serialized Submission protobuffers. If there are many predictions, you can shard them across multiple files where each file contains a subset of the predictions. Then tar and gzip them into a .tar.gz file before uploading. See the "Submit to leaderboard" section of the Quick Start for more details.

Sensor data is provided for the Training, Validation, and Test Sets. Labels are provided for only the Training and Validation Sets.
The metrics for each challenge are defined on each challenge’s page.
Each submission must have a method name and a brief description.
Each team (up to 10 members) can submit for evaluation against the Validation Set as many times as desired.
To appear on the leaderboard, teams must submit their results for evaluation against the Test Set.
Each team can submit for evaluation against the Test Set up to 3 times within 30 days. Submission will fail if that number is exceeded. If you are caught using multiple Google accounts for the purposes of circumventing this limit, your submission will be removed and you will be disqualified from the challenges.
Uploading a new submission with the same Google Account and method name as a previous submission will overwrite it.
Try to avoid using the same method name as other methods on the leaderboard.
Do not submit multiple times for the same method with different object types. Combine them into one submission.
Top leaderboard entries and their methods will be manually reviewed by the organizing committee. The organizing committee reserves the right to remove any entry at its discretion.

Money is given to the top three entries on the leaderboard of each of the challenges.
For each challenge, the first place award is $15,000, second place is $5,000, and third place is $2,000.
Submissions must be uploaded by 11:59 PM Pacific time on May 31, 2020 to be eligible for awards.
Each individual can only be a member of one team per challenge.
Each team member must agree to the Official Challenge Rules here.
In order to be eligible for award money, teams must submit a detailed description of their submission in the form of a paper or technical report (1-4 pages long). The report will be made public.
Alphabet employees may appear on the leaderboard, but are not eligible for awards.