Rides
Our service
Phoenix
San Francisco
Los Angeles
Austin
Rides
Our service
Phoenix
San Francisco
Los Angeles
Austin
Technology
Technology
About
Our History
Waymo Leadership
Latest Updates
Press Resources
About
Our History
Waymo Leadership
Latest Updates
Press Resources
Safety
Safety
Community
Community
Careers
Benefits
Values
People
Open Roles
Careers
Benefits
Values
People
Open Roles
Wayformer: Motion Forecasting via Simple & Efficient Attention Networks
Nigamaa Nayakanti
Rami Al-Rfou
Aurick Zhou
Kratarth Goel
Khaled S. Refaat
Benjamin Sapp
Abstract
Motion forecasting for autonomous driving is a challenging task because complex driving scenarios result in a heterogeneous mix of static and dynamic inputs. It is an open problem how best to represent and fuse information about road geometry, lane connectivity, time-varying traffic light state, and history of a dynamic set of agents and their interactions into an effective encoding. To model this diverse set of input features, many approaches proposed to design an equally complex system with a diverse set of modality specific modules. This results in systems that are difficult to scale, extend, or tune in rigorous ways to trade off quality and efficiency. In this paper, we present Wayformer, a family of attention based architectures for motion forecasting that are simple and homogeneous. Wayformer offers a compact model description consisting of an attention based scene encoder and a decoder. In the scene encoder we study the choice of early, late and hierarchical fusion of the input modalities. For each fusion type we explore strategies to tradeoff efficiency and quality via factorized attention or latent query attention. We show that early fusion, despite its simplicity of construction, is not only modality agnostic but also achieves state-of-the-art results on both Waymo Open MotionDataset (WOMD) and Argoverse leaderboards, demonstrating the effectiveness of our design philosophy
Share
Links
Download PDF
ArXiv
Copy BibTeX
Copied!
Publication
ICRA 2023
Topics
Behavior Prediction
2023
ICRA