Challenges

Timeline

Challenges for awards ran from Thursday, March 19th and closed on Sunday, May 31st. However, the leaderboards are still up for you to showcase your work!

Awards for Each Challenge

First place: $15,000
Second place: $5,000
Third place: $2,000

Submission Format

• Submissions are serialized Submission protobuffers. If there are many predictions, you can shard them across multiple files where each file contains a subset of the predictions. Then tar and gzip them into a .tar.gz file before uploading. See the "Submit to leaderboard" section of the Quick Start for more details.

General Challenge Information

• Sensor data is provided for the Training, Validation, and Test Sets. Labels are provided for only the Training and Validation Sets.
• You may use any Waymo Open Dataset sets (see the Download page) for any of the 5 challenges.
• Submissions may not be created using any data other than the Waymo Open Dataset, except for ImageNet, Coco, and Kitti. You may pretrain on ImageNet, Coco, or Kitti if you wish.
• The metrics for each challenge are defined on each challenge’s page.
• Each submission must have a method name and a brief description.
• Each team (up to 10 members) can submit for evaluation against the Validation Set as many times as desired.
• To appear on the leaderboard, teams must submit their results for evaluation against the Test Set.
• Each team can submit for evaluation against the Test Set up to 3 times within 30 days. Submission will fail if that number is exceeded. If you are caught using multiple Google accounts for the purposes of circumventing this limit, your submission will be removed and you will be disqualified from the challenges.
• Uploading a new submission with the same Google Account and method name as a previous submission will overwrite it.
• Try to avoid using the same method name as other methods on the leaderboard.
• Do not submit multiple times for the same method with different object types. Combine them into one submission.
• Top leaderboard entries and their methods will be manually reviewed by the organizing committee. The organizing committee reserves the right to remove any entry at its discretion.

Additional Information Regarding Awards at CVPR 2020

• Money is given to the top three entries on the leaderboard of each of the challenges.
• For each challenge, the first place award is $15,000, second place is $5,000, and third place is $2,000.
• Submissions must be uploaded by 11:59 PM Pacific time on May 31, 2020 to be eligible for awards.
• Each individual can only be a member of one team per challenge.
• Each team member must agree to the Official Challenge Rules here.
• In order to be eligible for award money, teams must submit a detailed description of their submission in the form of a paper or technical report (1-4 pages long). The report will be made public.
• Alphabet employees may appear on the leaderboard, but are not eligible for awards.

Please see the Official Challenge Rules here.