On Thursday, Google announced the introduction of new AI and accessibility features for Android and Chrome, specifically enhancing the TalkBack screen reader. One of the standout updates involves the integration of Gemini AI, which now allows users to inquire about the content of images and on-screen elements. This enhancement aims to assist individuals who are blind or have low vision by providing AI-generated descriptions for images where alt text is absent.
Previously, TalkBack could generate descriptions, but the latest update enables users to pose specific questions regarding images. For instance, if a friend shares a photo of a new guitar, users can ask about its brand or colour. Additionally, it now accommodates questions about items displayed on the entire screen, making tasks like online shopping more accessible.
Moreover, Google has improved the Expressive Captions feature, which delivers real-time captions, enhancing the communication experience. The update introduces a duration feature that captures the nuances in speech, including elongated sounds or vocal inflections. For example, it can now distinguish between someone excitedly saying, “amaaaazing” and simply saying “no” with emphasis. New sound labels, such as whistling or throat clearing, will also be introduced.
These features are set to roll out in English in Australia, the UK, Canada, and the US for devices running Android 15 and newer.
Google is also enhancing Chrome’s accessibility with better PDF interaction. Previously, screen readers could not interpret scanned PDFs accessed via Chrome; however, with the incorporation of Optical Character Recognition (OCR), users can now highlight, copy, and search for text in these files as effortlessly as with other web pages.
Additionally, the updated Page Zoom functionality on Chrome for Android allows users to increase text size without disrupting the webpage’s layout. This feature provides customization options for zoom levels, either for all visited pages or specific ones, and is easily accessible through the menu in Chrome.
The updates reflect Google’s commitment to improving accessibility and user experience through AI integration across its platforms.
Fanpage:Â TechArena.au
Watch more about AI – Artificial Intelligence
