Google 2024 Unveiled: Uncovering Overlooked AI Innovations

At the latest annual Made by Google hardware event, a flurry of announcements was made, many of which were overshadowed by the more prominent reveals. Among the lesser-highlighted but equally fascinating AI advancements were the Pixel Studio for image creation and Pixel Screenshots for enhanced screenshot management and organization.

Summarizing Conversations with Call Notes

Individuals with fleeting memories might find the Call Notes feature to be of significant benefit.

Exclusively available on the Pixel 9 series, Call Notes automatically records a summary and transcript of your telephone conversations, securely storing them in your phone’s call history.

Concerns regarding privacy are valid, yet Google assures that Call Notes is entirely processed on the device and alerts all call participants when it begins recording—all waiting further scrutiny from security professionals.

Introducing Pixel Studio, an Image Creation Tool

Pixel Studio, a novel app integrated into Pixel 9, Pixel 9 Pro, and Pixel 9 Pro Fold, leverages a sophisticated on-device AI alongside Google’s Imagen 3 cloud-based model. It invites users to craft images through simple prompts, enhancing them with stickers and edits post-creation.

Although Pixel Studio requires internet connectivity, the creations it fosters, from users’ prompts, can be directly shared through Google Messages.

Despite recent issues with generating human faces, Google confirmed that Pixel Studio has restrictions to avoid the production of controversial images, following a direct inquiry from colleague Ivan Mehta.

Searchable Pixel Screenshots

For those who frequently capture screenshots for quick reference, finding a specific image later can be cumbersome due to their non-searchable nature.

Luckily, for future Pixel 9 users, the new Pixel Screenshots app is designed to make this process effortless, using AI to identify text, people, and objects within screenshots, all processed locally on the device.

For example, if you’ve taken numerous screenshots of squirrel-themed gifts for a friend’s birthday, Pixel Screenshots can categorize and make this content readily searchable within the app—merely by querying ‘squirrel’—along with links to the original products and summarized details.

This revolutionary app further extends its utility by facilitating searches for specific items like door codes and addresses across your photos.