Google I/O’s Big Reveals: Pixel Fold, Pixel 7A, Android 14, AI and More – CNET

In addition to the long-awaited Pixel Fold, Google’s first foldable phone, at its Google I/O 2023 developer conference the company showed off other new devices — the Pixel 7A phone and a revamped Pixel Tablet intended for smart home control. Google also delivered updates on its work with AI (and its competitor for ChatGPT, its AI chatbot Bard), augmented reality, Project Starline holographic conferencing and more.

AI and Search updates

Generative AI is the big push this year — so big, that Google used “AI” over 140 times in its two hour keynote. For instance, Gmail’s Help Me Write will automatically create emails based on prompts, incorporating text from previous conversations (among other things). A new Magic Editor in Photos lets you treat elements as objects without having to select them to reposition, and can automatically fill in backgrounds. That’s coming later this year.

For developers, PaLM 2 is Google’s update to its large language processing models, which is trained better on more languages, as well as math and science, and has improved understanding of security and medical concepts. Google’s working on building in watermarking for images that lasts through basic edits and embedding metadata in its generated imagery. The company’s already working on Gemini, the next generation of its LLM.

Its Bard chatbot added coding capability (in other words, creating code based on a prompt) earlier this year, as well as creating explanations of code snippets on the fly. Soon, it will be able to export and run Python code. And run it in dark mode! It will also be able to add those responses to Gmail and Docs. 

Prompting will be integrated into Docs, so, for example, you can enter a prompt in Sheets to help organize info for your biz, or generate an image from within Slides. When collaborating with Bard, it will be able to use Google services, and it will return images in response to Bard prompts. And the side rail prompts can feed a Doc’s contents back in to refine results. All these integrations will be available later this year in a new product called Duet AI for Workspace.

It will be able to streamline research by returning collated results in multiple formats (text or tables, for example). The company cited a bunch of partners, notably Adobe Firefly — such as creating images with Firefly based on Bard prompts. Google is opening up the Bard waiting list to more regions and languages (Japanese and Korean now). Previews of a lot of these will be available via Labs.

Search will also have Snapshots, which is a refinement of its existing search results display, with more consolidated and (hopefully) better results, like on-the-fly buying guides or suggesting travel itineraries. They’re called “search generative experiences” or SGE, and will also be available in Labs.

Tailwind is an experiment generating “notebooks,” like a notebook with study notes that it builds from docs on Google Drive as well as search — it’s also previewable with Labs.

Google also spoke about the downsides of AI and how it’s trying to mitigate them. For instance, there will be two new ways to evaluate the veracity of images. One will be providing similar images used elsewhere for context and using Google Lens to supply additional info. To help prevent deepfakes, it will restrict access to its universal translator along with the aforementioned watermarking support.

Android 14

The next version of Google’s phone and tablet operating system went into beta testing in February with another preview update last month and, as usual, won’t be available until Google ships its phones. The update adds better compatibility for larger-screen devices — foldables and tablets — along with standard refreshes to boost speed, battery life and operation. As Apple did with iPhone 14 and iOS 16, Google also adds support for satellite connectivity.

WhatsApp is coming to Wear OS for watch wearers. Find My Device will add support for more devices, like headphones and tablets.

You’ll be able to get alerts about unknown trackers operating on your phone, plus Google and Apple have teamed up to create a standard for this to work across both iOS and Android (so you’ll be able to tell, for example, if someone’s put an AirTag in your bag even if you have an Android phone).

Android will be able to customize a variety of aspects of your experience. Magic Compose creates messages with different styles, personalizable lock screen widgets, the ability to use emojis to create wallpaper, create 3D representations of 2D photos — Cinematic wallpaper — and (as you’d expect), generative AI-made wallpapers (coming this fall).

Select Pixel phones will get access to the Magic Editor later this year, and Google’s Pixel phones will be first to get a lot of the AI features talked about elsewhere.