Desay SV, Zhipu team up to develop next-gen AI-powered smart cockpit solution

Shanghai (Gasgoo)- During the AUTO SHANGHAI 2025, Chinese mobility technology company Desay SV and artificial intelligence company Zhipu officially announced a strategic partnership to jointly develop a next-generation AI Native smart cockpit solution, designed to be "soulful and evolvable", according to a post on Desay SV's WeChat account.

The solution will leverage Desay SV's integrated capabilities in hardware architecture, middleware, model development, and upper-layer applications, while incorporating Zhipu's GLM large language models to enable seamless interaction across people, vehicles, and environments.

Integrating large AI models into vehicles is far more complex than a simple technical migration—it involves system-wide engineering challenges spanning hardware adaptation, data processing, algorithm optimization, and compliance with safety standards. By combining Desay SV's robust technical foundation and engineering execution with the comprehensive capabilities of Zhipu's GLM models, the partnership aims to break through the constraints of traditional in-vehicle computing architectures and overcome the systemic bottlenecks of embedding large models in automotive applications.

This collaboration marks the debut of Realtime models—supporting real-time voice interaction—inside a vehicle. Leveraging Desay SV's in-house developed cockpit domain control platform and multimodal sensor fusion technologies, the system enables AI Native's first-ever real-time three-dimensional analysis of environmental context, user status, and vehicle data. At the core is a millisecond-level intelligent interaction hub within the cockpit, capable of translating heterogeneous inputs—including voice commands, gestures, and physiological signals—into precise scenario-based services.

To ensure fluid user experiences, Desay SV has integrated Zhipu's low-latency real-time interaction model, alongside its proprietary spatial voiceprint localization algorithm and attention-tracking system. These technologies enable seamless interaction migration across screens, supported by a deeply optimized cockpit domain control system that creates a full-domain interaction matrix encompassing the instrument cluster, center display, P-HUD, and AR-HUD—allowing intelligent services to intuitively follow the user's gaze.

Emotional interaction represents a major leap in AI evolution. The AI Native smart cockpit offers advanced emotional recognition capabilities, including Zhipu's real-time video call interaction model and Desay SV's unique voice arbitration mechanism to manage multi-source audio conflicts. When combined with biometric signal fusion algorithms, the virtual personal assistant (VPA) gains emotional awareness and proactive care features, delivering human-like services in complex driving environments and transforming the car into a truly empathetic travel companion.

The AI Native solution co-developed by Desay SV and Zhipu made its appearance at the AUTO SHANGHAI 2025 as part of Desay SV's latest Smart Solution 3.0. Unlike conventional in-car human-machine interaction systems, the Smart Solution 3.0 can not only understand voice commands and interpret gestures, but also accurately recognize users' emotions—creating a "warm and emotionally responsive" mobility experience that drew significant attention from industry professionals and tech enthusiasts alike.