Google has unveiled new AI and accessibility features for Android and Chrome, enhancing the user experience for individuals with visual impairments. A key highlight is the integration of Gemini with TalkBack, the Android screen reader, enabling users to interact with images and receive detailed descriptions, even when alternate text is not available.
Previously, TalkBack users could obtain AI-generated descriptions for images, but now they can pose queries to Gemini. For instance, if a friend shares a photo of their new guitar, users can ask about its features, such as brand or colour. Additionally, Gemini can now provide information regarding the entire screen, allowing users to inquire about items in shopping apps, such as material and discounts.
Further developments include enhancements to Expressive Captions, a feature that uses AI to deliver real-time captions. Google is focusing on the nuances of speech, introducing a duration feature. This ensures users can discern variations in speech, such as an enthusiastic “amaaazing shot” in sports commentary or a drawn-out emphasis in everyday conversations. Users will also see new sound labels, identifying actions like whistling or throat clearing.
These updates are accessible to users in the United States, United Kingdom, Canada, and Australia, for devices running Android 15 or higher.
In a move to improve accessibility regarding document handling, Google is simplifying PDF interactions in Chrome. Previously, screen readers could not interact with scanned PDFs, but now Optical Character Recognition (OCR) technology allows Chrome to identify and enable text selection, copying, and searching within these documents.
Additionally, Android users will benefit from the Page Zoom feature on Chrome, which allows custom text resizing without altering webpage layouts. Users can adjust their zoom preferences and apply them consistently across all pages or selectively.
In summary, these updates from Google aim to make digital spaces more inclusive and user-friendly for those with vision impairments, while also enhancing general usability for all users.
Fanpage: TechArena.au
Watch more about AI – Artificial Intelligence
