6 AI features Google thinks will sell you on its latest Pixel phones (including the Fold)

At last year’s Made by Google event, Google sprinkled artificial intelligence (AI) all through its product choices. So naturally, at this yr’s occasion, the corporate upped the ante on the Pixel 9 phones, unveiling AI options that may assist with calls, picture and video enhancing, and extra.

Additionally: Everything announced at Made by Google 2024

The options use generative AI to deal with on a regular basis ache factors you might have when utilizing your telephone, and consequently, they’ve the potential to raise your on a regular basis smartphone expertise.

Listed below are the six new options, ranked from most helpful to least helpful. 

1. Pixel Screenshots 

You could screenshot one thing with the intention of remembering it later, however it most likely typically will get misplaced amongst the 1000’s of photographs in your picture library. Going ahead, you’ll ask for details about the screenshot and have Pixel Screenshots pull it up for you.

Pixel Screenshots makes use of AI to course of screenshots that will help you discover them later utilizing easy textual content prompts. If you happen to screenshot one thing from a webpage, Pixel Screenshots also can recall the positioning, making certain you by no means lose monitor of an merchandise you have an interest in shopping for.

Additionally: These three AI features sold me on the Google Pixel 9 Pro – and they’re very clever

The brand new function is just like Microsoft’s Recall, which the corporate halted as a result of privateness and safety points. Pixel Screenshots addresses Recall’s faults by solely ingesting screenshots that you just take (versus robotically taking screenshots within the background) and permitting you to toggle it on or off.  

This function is an on-device Pixel unique, so if you wish to strive it, it could be time to modify to a Pixel system. 

2. Name Abstract

Day by day, folks collaborate with colleagues, make appointments, settle disputes, and extra over the telephone. If that sounds such as you, you may profit from having an in depth overview of your calls. That is the place the brand new Name Abstract function is available in.

The function might be turned on inside the name display UI and, as soon as activated, will offer you an in depth AI-powered abstract of the decision’s key factors.

Additionally: Google Meet will take notes for you now, thanks to AI

To handle the privateness considerations that include an AI function listening in on calls, Name Abstract will announce itself on the decision, so all events concerned know that the decision is being ingested and run on-device. 

This function shall be out there at the side of Call Screen, an AI-powered function that Google unveiled in 2023 that allows you to filter out spam and robocalls by declining the decision if spam is detected.

3. Gemini by default

Gemini is changing Google Assistant because the default voice assistant on Pixel telephones, letting you entry a wiser, extra useful assistant simply by urgent and holding the ability button.

Gemini is conscious of your Google apps, that means it could test your calendar to see if you’re free, discover celebration particulars out of your e mail, and extra.

Moreover, Gemini brings an optimized dialog expertise. You may speak with the Gemini voice assistant as if it have been an individual, interrupting it or speaking with pauses, with out compromising its understanding. 

Beginning in the present day, you can even overlay Gemini over prime of your apps to get solutions about what’s in your display. For instance, Google states that customers can ask questions on a YouTube video they’re watching or generate a picture from the overlay and drop it into Gmail.

Additionally: Gemini to replace Google Assistant as Android’s default – but you still have options

Gemini Live, first introduced at Google I/O in Might 2024, can also be now lastly out there for Gemini Superior subscribers on Android telephones. Those that purchase the Pixel 9 Professional will get one yr of free Gemini Superior, together with entry to Gemini Dwell and different deeper AI integrations within the Google Workspace suite.

The Gemini Dwell expertise shall be restricted to its superior voice conversational capabilities, permitting you to have lengthy conversations that embody asking recommendation or answering complicated questions on complicated subjects. The multimodal capabilities demoed at Google I/O that will let you use your digital camera with Dwell are nonetheless not out there. 

4. Auto Body in Magic Editor

Generally, you’ve got the proper picture alternative, however components like area restrictions, restricted mobility, and shutter velocity make it tough to take the best-framed picture and damage the general seize. To handle this, Google is introducing Auto Body in Magic Editor.

Additionally: I’m a diehard Pixel user, but I’m considering a change for two reasons

The function may also help you robotically reframe your picture, recommend the very best crop, and even increase your post-production. Auto Body will work alongside the suite of latest picture enhancing options to make sure best outcomes.

5. Add Me

Ever end up in a scenario the place nobody is on the market to take a photograph of your group, so you are taking one for the staff by getting behind the digital camera? Due to this function, you now not must forfeit your spot within the image — theoretically. 

Additionally: I tested the Google Pixel 9 Pro’s ‘Add Me’ feature and found it crazy clever

Add Me merges a photograph of the group with a photograph of the photographer alone to create a brand new picture of everybody collectively. You may then mix this with the Greatest Take function, launched final yr, to pick your favourite expressions for every individual from a sequence of comparable photographs.

This function is towards the underside of the checklist — not as a result of it is not a neat AI utility, however as a result of its on a regular basis functions stay a bit fuzzy.

6. Reimagine

Just like the function above, Reimagine is supposed to breathe extra creativity into photographs through the use of AI so as to add new parts.

Additionally: The best AI image generators of 2024: Tested and reviewed

If you happen to take a photograph and wish to edit one thing utilizing AI, faucet the world you wish to change and kind what you wish to see. Some examples embody “add sundown” or “make the grass greener.”