Formula E to launch AI-powered accessible audio race reports

Formula E and Google Cloud are introducing an accessible, AI-powered audio race report with support from the RNIB to allow blind and visually impaired fans to keep track of the championship.

The initial idea stemmed from the AI Hackathon Google Cloud hosted at last year’s London E-Prix; the winning team having used Google tools to create an audio podcast. The event itself was shortlisted in the Pioneering and Innovation section of the Autosport Awards and now the first-place entry is set to be rolled out in time for season 12.

Focus groups organised by the RNIB will take part in user testing of the Formula E and Google Cloud audio race reports this weekend in Berlin and at the season-ending race in London two weeks later.

“At Formula E, we believe the thrill of electric racing should be accessible to everyone,” said series chief executive Jeff Dodds.

“This innovative collaboration with Google Cloud is a fantastic example of how technology can be used for good, creating a brand-new way for blind and visually impaired fans to experience the drama and emotion of our sport.

“By working closely with the RNIB, we are ensuring this innovation is truly inclusive and fit for purpose, so that no fan is left behind.”

The report will be created over several stages, with Google’s Chirp model transcribing the live race commentary with its Gemini model then taking over to analyse the transcript, timing data and race information. It will identify key events and generate a race summary.

That summary is then converted using advanced text-to-speech technology to create an audio report available across audio platforms globally within minutes of a race finishing and in 15 different languages.

“Audio description transforms how blind and partially sighted motorsport fans can fully engage in enjoying the full racing spectacle – taking in the visceral sounds of cars on the track while feeling the passion of the crowd,” said Sonali Rai, RNIB’s media, culture and immersive technology lead.

“RNIB has been working with Formula E and Google Cloud on this AI-powered podcast which promises to give a full picture of the race in an accessible and engaging way for blind and partially sighted racing fans.

“Formula E’s commitment to working directly with the blind and partially sighted community to develop this technology is exactly the right approach and sets a fantastic standard in inclusivity for other sports to follow and stay on track with new advances in innovation.”