Optimization-Based Spatiotemporal Trajectory Planning with Behavior Cells for Autonomous Driving

Shihao Li1, Wenshuo Wang1, Zhide Zhang2, Xin Xia2, Boyang Wang1, Chao Lu1, Haiou Liu1,
1Beijing Institute of Technology
2GAC R&D Center

Abstract

Achieving safe and executable trajectory planning in traffic scenarios necessitates considering vital environmental elements, ego behaviors, and vehicle kinematics, which poses challenges of real-time performance and convergence for optimization-based methods. To address these issues, we propose an optimization-based trajectory planning framework that handles environmental elements and provides heuristic behavior constraints at the spatiotemporal drivable domain level, followed by progressively optimization to achieve fast and stable convergence. Specifically, considering vehicle motion capabilities and the tactical decisions for various environmental elements, we first partition the spatiotemporal domain into modular drivable cells with behavior semantics, refer to Behavior Cells (BCs). All feasible candidate behaviors are then rapidly enumerated through BCs combinations. Subsequently, the Finite-Horizon Markov Decision Process (FHMDP) is utilized to model and evaluate each behavior in the spatiotemporal drivable domain, with the optimal BCs combination serving as heuristic constraints. Finally, we utilize a dynamic two-stage optimization approach to progressively satisfy the planning-related requirements, generating trajectories within the selected BCs combination with fast convergence. Simulation in various typical traffic demonstrate that the proposed method showcases stable reliability and real-time performance compared to the baselines under different traffic densities. On-road experiments further validate the effectiveness of the proposed method in real-world traffic scenarios.

Keywords: Autonomous Urban Driving, Trajectory Planning, Driving Behavior, Optimization, Behavior Cells

Method Overview

In this paper, we propose a novel optimization-based trajectory planning framework that directly handles environmental elements and provides heuristic behavior constraints at the spatiotemporal drivable domain level, then efficiently and robustly generates trajectories for specified behaviors through progressive optimization. Firstly, considering the tactical decision patterns for various environmental elements, we divide the spatiotemporal drivable domain of the ego vehicle into different spatiotemporal domain cells, referred to as Behavior Cells (BCs). By combining BCs, we rapidly enumerate a finite set of feasible candidate behaviors. Since BCs simultaneously consider the vehicle's tactical decisions regarding environmental elements and its motion capabilities, behaviors represented by BCs combinations not only can provide collision-free constraints for optimization but also contain the concrete representation of drivability performance. This brings two benefits: on one hand, unreasonable behaviors can be quickly filtered out based on the characteristics of the spatiotemporal drivable domains; on the other hand, it allows us to evaluate and select behaviors directly at the spatiotemporal drivable domain level, enabling to robustly and efficiently provide feasible behavior guidance for trajectory optimization. Finally, we propose a dynamic two-stage optimization algorithm, leveraging a mixed-integer quadratic programming (MIQP) stage and a nonlinear programming (NLP) stage, to progressively satisfy requirements such as kinematics, smoothness, and safety, achieving high efficiency and convergence rates in trajectory generation within the selected BCs combinations. We validate our algorithm in various simulated and real-world urban traffic scenarios. The results demonstrate that our framework can robustly and efficiently generate high-quality trajectories in different traffic densities.



intro_figure_overall_architecture

Overview of the proposed method. (a) Considering the vehicle's motion capabilities, the spatiotemporal domain is partitioned into different modularized drivable domains with behavior semantics, referred to as BCs, \(\mathfrak{B}^{{\pi},i}\), to represent the tactical decisions for various environmental elements on different lanes \(\pi \in \{\mathsf{l},\mathsf{c},\mathsf{r}\}\). (b) By combining the topologically adjacent BCs, all feasible behaviors and their corresponding spatiotemporal drivable domains \(\mathfrak{C}^{i}\) are synchronously enumerated. (c) Each behavior is modeled and evaluated using the FHMDP at the spatiotemporal drivable domain level, and the optimal behavior is provided as heuristic behavioral constraints for trajectory generation. (d) Trajectories are generated progressively within the spatiotemporal drivable domain of the selected behavior through a MIQP and a NLP stage.



RESULTS

Simulations

Interpolate start reference image. We developed a proprietary simulator based on the CommonRoad benchmark to conduct the experiments. The simulation scenarios were derived from publicly released datasets such as NGSIM, OpenStreetMaps (OSM), and partially hand-crafted datasets. To validate the effectiveness and generalizability of our method, our simulation tests were conducted in 8 typical urban driving scenario categories including on-ramp merging, other vehicle merging, static obstacle avoiding, pedestrian crossing, oncoming traffic, unsignalized intersections, signalized intersections, roundabouts.





Ramp Merging

Other Vehicles Converge

Static Obstacle Avoiding



Oncoming Traffic

Pedestrian Crossing

Unsignalized Intersections1



Signalized Intersection1

Roundabout

Dense Road Section



T-intersection

Unsignalized Intersections2

Signalized Intersection2



Experiments

Interpolate start reference image. The experiments rely on the L4-level autonomous driving vehicle, ADIGO PILOT, developed by GAC Group (see in the right figture). ADIGO PILOT is equipped with a sensing suite,including eight cameras, four solid-state lidars, two rotating lidars, six radars, and a fusion positioning system. We integrated the proposed framework into ADIGO PILOT and calculated the trajectory in real-world traffic scenarios based on the perception results from the onboard sensor suites. To demonstrate the effectiveness, flexibility, and robustness of the proposed method, we provide two representative cases to illustrate the performance of our algorithm.









Interpolate start reference image.

Traveling with Illegal Parking Vehicles and Crossing Pedestrain



Interpolate start reference image.

Lane Changing While Another Vehicle Merging