cd /news/autonomous-vehicles/griddriver-on-board-bev-based-langua… · home › topics › autonomous-vehicles › article
[ARTICLE · art-171550] src=arxiv.org ↗ pub= topic=autonomous-vehicles verified=true sentiment=↑ positive

GridDriver: On-Board BEV-Based Language Planning and Reasoning

GridDriver, a BEV-conditioned large language model framework for onboard driving, reached 87.9% PDMS on the NAVSIM benchmark and 57.6% accuracy on nuScenes-QA using a single shared planning and question-answering checkpoint, according to the arXiv paper 2611.21924v1. The system combines lightweight spatio-temporal BEV perception with spatially structured tokens and frame-wise scheduling that interleaves trajectory prediction with asynchronous language generation, achieving 32.7 ms standalone planning latency and 9.4 plans per second in an onboard ROS 2 pipeline. The authors report open-loop onboard operation on a research vehicle and say spatial representation analyses show better geometric information retention than Q-Former compression.

recommendation

For onboard driving LLMs, use spatially structured BEV tokens instead of Q-Former compression and interleave trajectory prediction with asynchronous language generation to hit 32.7 ms planning latency.

more in playbook: Inference and self-hosting
by read1 min views2 publishedNov 18, 2026

arXiv:2611.21924v1 Announce Type: new Abstract: Bird's-Eye-View (BEV)-conditioned large language models (LLMs) enable language-interactive driving, but onboard deployment requires efficient perception and continuous planning alongside autoregressive language generation. We present GridDriver, an efficient BEV-conditioned LLM framework combining trajectory prediction, structured driving indicators, natural-language navigation, driving explanations, and scene question answering. Lightweight spatio-temporal BEV perception and spatially structured tokens provide scene context to a shared LLM, while frame-wise scheduling interleaves trajectory prediction with asynchronous language generation. GridDriver achieves competitive performance on public benchmarks, reaching 87.9% PDMS on NAVSIM and 57.6% accuracy on nuScenes-QA with a shared planning and QA checkpoint. Spatial representation analyses demonstrate improved geometric information retention and trajectory prediction compared with Q-Former compression. The system achieves 32.7 ms standalone planning latency and 9.4 plans/s in an onboard ROS 2 pipeline. We further evaluate planning on our own data recordings and demonstrate open-loop onboard operation on a research vehicle. Across public benchmarks and real-world evaluations, we identify strengths and limitations of the BEV-based approach.

── more in #autonomous-vehicles 4 stories · sorted by recency
── more on @griddriver 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/griddriver-on-board-…] indexed:0 read:1min 2026-11-18 · —