Stellantis Files Patent for Virtual Driver Projection to Ease Passenger Anxiety Over Self-Driving Cars

On August 18, Stellantis unveiled a new patent aimed at alleviating passenger anxiety caused by an empty driver's seat by projecting a virtual driver image onto the windshield. The system uses in-cabin projection equipment to generate a virtual driver figure tailored to occupants' positions and gaze directions. Leveraging machine learning, it synchronizes facial expressions, lip movements, and synthesized speech, and directs its gaze toward the relevant passenger during interactions. Passengers can customize the virtual driver's appearance. Additionally, the technology supports remote human driver intervention: when the vehicle exits its operational design domain or encounters an anomaly requiring manual takeover, a live video feed of a remote operator is projected into the cabin via the same system, enabling direct visual and verbal interaction with passengers.