Drive-to-Music: Context-Aware Generative Audio for In-Vehicle Experiences
Article Sidebar
Main Article Content
Abstract
In-vehicle music can serve as an adaptive interface to enhance driver experience, attention, and well-being. We present Drive-to-Music, a context-aware system that generates music in real time from multimodal driving signals. Using dashcam imagery and vehicle telemetry, the system extracts scene semantics and driving context, maps them to high-level musical descriptors, and conditions generative audio models to produce contextually aligned soundtracks. The architecture combines perception and generative components to translate visual and kinematic inputs into structured musical attributes and synthesize audio with low latency. It supports smooth transitions as driving conditions evolve, and to ensure robustness and deployment readiness, we incorporate constraint-based controls and safety checks across the generation pipeline.
Our results demonstrate the feasibility of real-time, context-aware music generation in automotive settings, providing a foundation for personalized and adaptive in-vehicle audio experiences.
Article Details
Copyright (c) 2026 Dragoiu C, et al.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Mitra R, Zualkernan IA. Music generation using deep learning and generative AI: a systematic review. IEEE Access. 2025;13:18079-18106. doi: https://doi.org/10.1109/ACCESS.2025.3531798
Yang LC, Lerch A. On the evaluation of generative models in music. Complete journal or conference publication details are required to finalize this reference.
Jaini S, Katikireddi PM. Music and art generation using generative AI. Int J Sci Res Comput Sci Eng Inf Technol. 2022;8(6):684-690.
Plut C, Pasquier P. Generative music in video games: state of the art, challenges, and prospects. Entertain Comput. 2020;33:100337. doi: https://doi.org/10.1016/j.entcom.2019.100337
Kari M, Grosse-Puppendahl T, Jagaciak A, Bethge D, Schütte R, Holz C. SoundsRide: Affordance-synchronized music mixing for in-car audio augmented reality. In: Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology. New York: Association for Computing Machinery; 2021. doi: https://doi.org/10.1145/3472749.3474780
Çano E, Morisio M. Mood-based on-car music recommendations. In: Proceedings of the ACM conference. Association for Computing Machinery; 2020. Full conference proceedings title, page range, and DOI need verification to complete the NLM reference.
Karageorghis CI, Payre W, Howard LW, Kuan G, et al. Influence of music on driver psychology and safety-relevant behaviours: a multi-study inductive content analysis. Theor Issues Ergon Sci. 2022;23(6):643-662. doi: https://doi.org/10.1080/1463922X.2021.2009933
International Telecommunication Union. Algorithms to measure audio programme loudness and true-peak audio level. Recommendation ITU-R BS.1770-5. Geneva: International Telecommunication Union; 2023. Available from: https://www.itu.int/rec/R-REC-BS.1770-5-202311-I
European Broadcasting Union. Loudness normalisation and permitted maximum level of audio signals. Technical Report EBU R 128, Version 5.0. Geneva: European Broadcasting Union; 2023.
Schmid F, Koutini K, Widmer G. Efficient large-scale audio tagging via transformer-to-CNN knowledge distillation. In: Proceedings of the 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2023. p. 1-5. doi: https://doi.org/10.17023/xe7z-1q61
Amini A, Banaszak A, Benoit H, Böök A, Dakhran T, Duong S, et al. LFM2 technical report. arXiv [Preprint]. 2025. arXiv:2511.23404. Available from: https://arxiv.org/abs/2511.23404
Qwen Team. Qwen3 technical report. 2025. Publication details and a verified source URL should be confirmed.
Google Gemini Team. Gemini 2.5 technical report. 2025. Publication details and a verified source URL should be confirmed.
Hessel J, Holtzman A, Forbes M, Le Bras R, Choi Y. CLIPScore: A reference-free evaluation metric for image captioning. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 2021. p. 7514-7528. Available from: https://aclanthology.org/2021.emnlp-main.595/
ElevenLabs. ElevenLabs [Internet]. Available from: https://elevenlabs.io/
Mubert. Mubert [Internet]. Available from: https://mubert.com/
Stable Audio. Stable Audio [Internet]. Available from: https://stableaudio.com/
Zhu H, Zhou Y, Chen H, Yu J, Ma Z, Gu R, et al. MuQ: Self-supervised music representation learning with Mel residual vector quantization. arXiv [Preprint]. 2025. Available from: https://arxiv.org/abs/2501.01108
Esser P, Kulal S, Blattmann A, Entezari R, Müller J, Saini H, et al. Scaling rectified flow transformers for high-resolution image synthesis. In: Proceedings of the 41st International Conference on Machine Learning. Proc Mach Learn Res. 2024;235:12606-12633. Available from: https://proceedings.mlr.press/v235/esser24a.html
Wu C, et al. Qwen-Image technical report. 2025. Additional publication details and a verified source URL should be confirmed.
Kamath A, Chang KW, Krishna R, Zettlemoyer L, Hu Y, Ghazvininejad M. GenEval 2: Addressing benchmark drift in text-to-image evaluation. arXiv [Preprint]. 2025. Available from: https://arxiv.org/abs/2512.16853