Skip to main content
Skip to footer
Rides Our service Phoenix San Francisco Los Angeles Austin Rides Our service Phoenix San Francisco Los Angeles Austin Technology Technology About Our History Waymo Leadership Latest Updates Press Resources About Our History Waymo Leadership Latest Updates Press Resources Safety Safety Community Community Voices Community Partners Community Impact Community Community Voices Community Partners Community Impact Careers Benefits Values People Open Roles Careers Benefits Values People Open Roles
Symphony: Learning Realistic and Diverse Agents for Autonomous Driving Simulation Maximilian Igl Daewoo Kim Alex Kuefler Paul Mougin Punit Shah Kyriacos Shiarlis Dragomir Anguelov Mark Palatucci Brandyn White Shimon Whiteson Abstract Simulation is a crucial tool for accelerating the development of autonomous vehicles. Making simulation realistic requires models of the human road users who interact with such cars. Such models can be obtained by applying learning from demonstration (LfD) to trajectories observed by cars already on the road. However, existing LfD methods are typically insufficient, yielding policies that frequently collide or drive off the road. To address this problem, we propose Symphony, which greatly improves realism by combining conventional policies with a parallel beam search. The beam search refines these policies on the fly by pruning branches that are unfavourably evaluated by a discriminator. However, it can also harm diversity, i.e., how well the agents cover the entire distribution of realistic behaviour, as pruning can encourage mode collapse. Symphony addresses this issue with a hierarchical approach, factoring agent behaviour into goal generation and goal conditioning. The use of such goals ensures that agent diversity neither disappears during adversarial training nor is pruned away by the beam search. Experiments on both proprietary and open Waymo datasets confirm that Symphony agents learn more realistic and diverse behaviour than several baselines. Share Links Download PDF ArXiv Copy BibTeX Copied! Publication ICRA 2022 Topics Simulation 2022 ICRA
FAQ Blog Privacy Policy Research Terms Legal Zero Tolerance First Responders Safety Publications Waymo Community Contact Us Notice to CA Residents Sign up for updates to get the latest on Waymo and our technology. Sign up © 2019-2024 Waymo LLC Do Not Sell or Share My Personal Information Waymo may disclose user personal information to third parties to tailor advertising and offers to your interests. Such disclosures may be considered “sales” or “sharing” of personal information under the laws described above. California residents may opt-out of these below. If you opt out, Waymo will not disclose your personal information to third parties for purposes of tailoring advertising or offers to your interests. Note that any choice you make here will only affect this website on this browser and device. To learn more about how your data is shared, view our Privacy Policy page.