(Go: >> BACK << -|- >> HOME <<)
Skip to main content
The VergeThe Verge logo.The Verge homepage
The VergeThe Verge logo.
Google I/O 2024: all the news from the developer conference
See all 61 stories
R
Richard Lawler
Android will use Gemini Nano AI for TalkBack image descriptions.

At Google I/O 2024 today, Google announced a multimodal version of Gemini Nano, allowing the on-device processing-powered AI model to recognize images, sounds, and spoken language in addition to text.

Those multimodal capabilities are also coming to the Android accessibility feature TalkBack, using AI to fill in missing information about unlabeled images, without requiring a connection to the internet.


Animation showing Google Talkback powered by Gemini Nano AI recognizing an image and describing it for a user as “A close-up of a black and white gingham dress. The dress is shor with a collard and long sleeves. It is tied as the waist with a big bow.”
Google notes that “Description of images may vary.”
Image: Google
Most Popular
Most Popular

  1. Xbox Games Showcase 2024: all the news, trailers, and announcements

  2. Microsoft announces a disc-less Xbox Series X console in white

  3. Apple needs to show us the other half of the iPad Pro

  4. Here’s your first look at Starfield’s big expansion

  5. Microsoft Flight Simulator 2024 launches on November 19th

More from this stream Google I/O 2024: all the news from the developer conference

See all 61 stories