On Tuesday, Google unveiled three innovative AI experiments designed to enhance language learning experiences and potentially rival Duolingo, leveraging its Gemini multimodal large language model. These experiments aim to offer tailored, context-specific language instruction.
The first experiment, dubbed “Tiny Lesson,” addresses a common frustration for language learners: needing specific phrases in unscripted situations. Users can input a scenario, like “losing a passport,” and receive relevant vocabulary and grammar tips tailored to that context. This feature also provides suggested responses, such as “I don’t know where I lost it” or “I want to report it to the police,” assisting learners in real-life communication.
The second experiment, “Slang Hang,” seeks to help users adopt a more colloquial speaking style. Recognising that traditional language courses often focus on formal language, Google is testing a method to teach users local slang and informal nuances. The feature allows users to view and interact with realistic dialogues, simulating conversations like those between a street vendor and a customer or two friends reuniting. This interactive format enhances understanding by encouraging learners to hover over unfamiliar terms for explanations of their meanings and contextual usage.
However, Google cautions that the experiment may sometimes misrepresent slang or invent words, prompting users to verify these terms with credible sources.
The final experiment, “Word Cam,” brings a visual learning element into play. Users can take photos of objects in their surroundings, which Gemini will then identify and label in the target language. This feature also suggests additional vocabulary related to the items detected, highlighting the gaps in the user’s knowledge. For instance, while a learner may know the word for “window,” they might be unaware of the term “blinds.”
Google aims to leverage these experiments to explore how AI can facilitate dynamic and personalised independent learning experiences. The experiments support a range of languages, including English (with variants for Australia, the UK, and the US), Spanish, French, German, and more. For those interested in trying out these features, they are accessible via Google Labs.
Fanpage:Â TechArena.au
Watch more about AI – Artificial Intelligence
