World Model and Large Model Coupling-Driven End-to-End Technology
G-PAL system has introduced the scene generation and generalization capabilities of the world model into the development process of advanced driving assistance functions, thereby achieving efficient and automated iteration of the model. The world model can generalize scenes based on collected data and generate long-tail scenarios of interest, reducing the demand for real-vehicle data collection. The end-to-end model architecture based on the Mixture of Experts (MoE) strategy can reduce the number of activated parameters during model training, enhance training speed, and lower training costs. Through model distillation, the system further reduces the number of parameters in the end-to-end model to enable deployment in real vehicles.
GGPNet: G-PAL Generalized Perception Network
A single neural network achieves multi-task output for 4D imaging radar and camera fusion, unifying perception in both dynamic and static scenario. Leveraging the cross-attention mechanism in Transformer architecture, it efficiently processes complex correlations between visual and 4D imaging radar data, comprehensively enhancing the system’s precision in environment recognition and understanding. This lays a robust perceptual foundation for downstream prediction and decision-making.
Integration Strategy of Predictive Decision-Making Network Model and MCTS Decision Tree
G-PAL has developed a high-efficiency multi-objective joint strategy model that can rapidly generate initial solutions for scenario-level target strategies, significantly enhancing the speed and accuracy of decision-making responses. Additionally, the system has incorporated a backend decision-making mechanism based on Monte Carlo Tree Search (MCTS), which is interpretable and provides safety oversight for multi-vehicle strategies, thereby effectively improving the system's safety and reliability.
360° "Vision+4D mmWave Imaging Radar" Dynamic/Static Perception & General Obstacle Detection
Radar-vision BEV feature fusion + mixed strategies enhances perception performance, demonstrating higher precision-recall rates across diverse weather conditions, road scenarios and traffic participants, while improving target position accuracy , velocity resolution, and heading precision. The vision-radar fused Occupancy framework enables complete 3D scene representation, presenting better generalization capability for irregularly-shaped obstacles and special road structures, while reducing complex rule design requirements and improving general obstacle detection performance.
High-Robustness and High-Reliability Planning and Control Framework
In addition to the predictive decision-making integrated network, G-PAL has developed a highly robust and reliable planning and control component based on optimization theory, which is fully interpretable. By leveraging a data-driven strategy network, the human-like quality of the system has been enhanced. Meanwhile, the robust and reliable planning and control module ensures the safety and functionality of the system’s lower performance bounds. The overall solution balances human-like strategy generation with production feasibility, providing customers with an efficient and comfortable driving experience across all scenarios.
EkaRT: Cross-Domain Multi-Platform Middleware
The middleware provides diversified compatibility with adaptation to seL4/ QNX/ Linux/ Android OS. Its lightweight messaging architecture enables efficient multi-sensors data coordination through low-latency and high-throughput communication. Based on the PTP/ gPTP protocols, EkaRT builds a global clock synchronization network ensuring spatiotemporal consistency for cross-domain collaboration, while deterministic scheduling architecture ensuring dynamic priority allocation for hard real-time tasks. Complete debugging toolchain supports BAG data recording/ playback, visual analytics and anomaly tracing, significantly accelerating development.
Click the left icon to switch
Note: The G-PAL Driving Assistance System involves combined driving assistance functionalities. All demonstrated operations were conducted by professionals under secure conditions, and reproduction attempts are strictly prohibited.