The best (and worst) AI phone features in 2024

There isn’t any guesswork required to determine the largest pattern in smartphones this previous yr. Synthetic intelligence led off and completed nearly any dialog centered on the brand new telephones that launched in 2024 — particularly when it got here to the newest fashions from the largest smartphone makers.

The yr started with Samsung saying new Galaxy AI features as a part of the Galaxy S24 launch after which shortly rolling out these AI-powered capabilities to different latest Samsung flagship telephones. (Even the midrange Galaxy A35 options Circle to Search assist, making it one of many few sub-$400 telephones to supply at the very least some AI capabilities.) By the tip of the yr, Apple had gotten into the act, lastly rolling out a collection of AI instruments of its personal. And we’re not accomplished with the Apple Intelligence launch, both, as future iOS 18 updates determine to convey different promised enhancements to the newest iPhones.

Then there’s the Google Pixel telephones, lengthy established because the leaders on the subject of AI options. That lead was solely cemented by the August launch of the Pixel 9 lineup, as the brand new Tensor G4 silicon powering these telephones launched extra AI capabilities to the combo.

So sure, smartphones gained loads of AI superpowers in 2024? However what number of of these powers had been truly tremendous.

I am a little bit of an AI skeptic on the subject of new options, extra inclined to the “No person requested for this” stance than to consider that an AI function is an enormous step ahead. I see the worth in AI on the telephone — something that takes care of repetitive duties or suits into my present workflow will get a thumb’s up. Something that comes throughout a glorified parlor trick with extra sizzle than steak, I can do with out.

Among the many AI options launched to telephones this previous yr, a good quantity wound up impressing me — greater than I’d have guessed after I began jotting down the AI enhancements I appreciated. However there are definitely a couple of that want to return to the drafting board… or possibly not even be on my telephone in any respect. This is one particular person’s tackle the AI options that made the grade in 2024 and those that didn’t impress.

My favourite AI telephone options

Two examples of message summaries using Apple Intelligence

(Picture credit score: Future)

I discover myself on a whole lot of electronic mail chains involving associates, college mother and father and totally different organizations, and I will be trustworthy — a whole lot of occasions I haven’t got the time to learn every message because it is available in. And even worse, I am going to should refer again to an extended string of emails and monitor down the precise one which has the pertinent info, which could be like discovering a needle in a haystack when there’s a whole lot of backwards and forwards to kind by.

That is the way in which issues had been earlier than Apple Intelligence arrived, although. Now, the built-in Mail app has a summary tool on the prime of every message. Faucet it, and you may get a recap of the important thing factors in any electronic mail or string of messages. Even higher, the summaries are fairly correct, so I can make sure that I am getting the gist of what I have to know.

Circle to Search

An image showing the Samsung Galaxy S24 with the Circle to Search feature being used on screen

(Picture credit score: Future)

This search help developed by Samsung and Google made its debut on the Galaxy S24, nevertheless it’s since fanned out to different Android telephones. All it’s a must to do is lengthy press the house button after which circle or faucet the factor you need to search (often a picture, however you may choose textual content, too). You will then get leads to a pop-up window — useful, as a result of you may keep within the app you are already in, with out having to retrace your steps when your search is full.

When Circle to Search debuted, I fearful that it would be a glorified way to push you to e-commerce sites — and certainly, the device could be very useful when you see one thing you need to purchase and monitoring down the place you should buy it. However over the yr, Circle to Search has grown into an amazing device for wanting up issues on the fly with out having to cease and leap to a different app. On-line search could also be degraded lately, however Circle to Search actually helps minimize by the cruft to search out the knowledge you wished.

Pixel Screenshots

Pixel Screenshots on Pixel 9 Pro XL

(Picture credit score: Tom”s Information)

In case you’re like me and you’re taking a whole lot of screenshots in your telephone to recollect issues, the addition of the Screenshots app with the Pixel 9 replace has been a welcome addition to Google’s telephones. Sure, the app is a one-stop repository for all of the screen-grabs you seize in your telephone, nevertheless it would not be that spectacular if that is all Screenshots did. You can too seek for textual content throughout the screenshot, and the AI on board the Pixel is wise sufficient to search out precisely what you are on the lookout for.

Screenshots has different administration instruments that make it an exquisite addition to Google’s telephones. You’ll be able to annotate screenshots, kind them into collections and simply share screenshots with different individuals. However the most effective function is to set a reminder a few explicit screenshot in order that it surfaces at a specific time. When I’ll an occasion, for instance, I can set a reminder for a screenshot with the registration particulars, slightly than have to look by my inbox for the precise electronic mail that has that very same info. Screenshots generally is a actual time-saver, because it suits precisely into how I retailer info for later reference.

Interpreter app

Interpreter app on Galaxy S24 Plus

(Picture credit score: Future)

A lot of cell phones supply translation options, however Samsung’s Galaxy AI has arguably the most effective implementation of it with stay translation by the Interpreter app. In case you do a whole lot of touring, that is a vital device to have at finish, particularly since you may obtain totally different languages on to your Galaxy telephone in order that the function works with out requiring a community connection.

As soon as you’ve got chosen your languages and began a dialog, your Galaxy machine will hearken to what you are saying, then repeat an audible translation that it additionally shows in your telephone’s display screen. If you would like, you can also make the transcript of the interpretation seem the wrong way up on the telephone in order that each you and the particular person you are talking with can see real-time translations with out having at hand the telephone backwards and forwards.

Galaxy AI additionally helps a Live Translate feature for telephone calls that gives on-the-fly translations if you’re speaking on the telephone with somebody who speaks one other language. This device would not work fairly as seamlessly — there’s so much pauses as you wait to listen to the translated speech, and it appears to work greatest when you communicate much less casually. However it’s nonetheless a formidable show of on-device AI working to increase what you are able to do along with your telephone.

Name Notes

Pixel 9 Pro XL Call Notes.

(Picture credit score: Future)

Name recording is now a function on the Telephone app of each main flagship machine. (At the very least it is going to be on Samsung’s Galaxy flagships as soon as One UI 7 will get launched to extra telephones.) And the place there’s name recording, there’s often AI-generated transcripts of telephone calls to go together with these audio information. If that is a function that is necessary to you, you will not discover a higher implementation than Call Notes on Google’s latest Pixel phones.

What I recognize about Name Notes is its abstract function. (iPhones have a summary tool for phone call transcripts, too, although solely on units that assist Apple Intelligence.) With the faucet of a button, the AI on board your Pixel can spotlight the important thing factors of a telephone name, saving you the difficulty of getting to dig by the transcript your self.

After I examined Name Notes for a Pixel 9 Pro review, I discovered the transcript susceptible to misheard phrases, which isn’t an unusual drawback with transcription options on cellular units lately. However the abstract device is correct sufficient that I am assured the standard of Name Notes transcripts will enhance over time.

AI-powered photograph modifying options

Clean Up tool in Photos app running on ios 18.1

(Picture credit score: Future)

Maybe essentially the most welcome addition introduced by AI to any telephone are beefed-up photograph modifying instruments that take among the tougher touch-up work out of your fingers. I do not learn about you, however I am not a educated photograph editor, and I do not need to should study the finer factors of an image-editing app simply to handle some glare in a shot or to make the colours pop a bit of bit extra.

You will discover a cool image-editing capabilities in any of the most effective digital camera telephones that got here out in 2024. (You will additionally discover a couple duds, which we’ll speak about in a bit.) All iPhone 16 models now supply a Clean Up tool in the Photos app that does a stable job of eradicating undesirable objects or individuals from a photograph. Sure, that is a function Android telephones have lengthy had, nevertheless it’s good to lastly see it on at the very least some iPhones. I additionally recognize the edit suggestion function that the Galaxy S24 launched. Once more, I am not an professional at picture modifying, so after I see one thing like a distracting shadow, it is good to show to an AI device if I have to take away a shadow or add a background blur.

Google has been including instruments like this to its Pixel telephones for a number of generations now within the type of issues like Magic Editor and Best Take. And since these options have been such a hitter, it is more durable and more durable for newcomers to make an analogous splash. Nonetheless, the addition of Reimagine to Magic Editor expands that function’s toolkit in a useful manner, providing you with the flexibility to make use of descriptive textual content to direct AI to make tweaks and enhancements to your photos. AI continues to be doing the heavy lifting, however in the end management over the look of your photos continues to be in your fingers.

Instantaneous Sluggish-Mo

Galaxy AI Instant Slow-mo.

(Picture credit score: Future)

Whereas we’re speaking about image-editing instruments, let’s carve out a particular area for my favourite addition — the Instant Slow-Mo functionality that debuted with the Galaxy S24 sequence. A part of the dilemma I face as an beginner photographer is realizing when to plan for an impact forward of time — on this case, realizing after I must be taking pictures slow-motion video as an alternative of capturing video at its commonplace frame-rate. The Instantaneous Sluggish-Mo function takes that guesswork out of my fingers.

Now I can go into the Gallery app on a Samsung flagship telephone and faucet and maintain on the a part of a specific video that I need to decelerate, lifting my finger after I need to pace issues again up. Adjusting the pace of the impact is straightforward, and I may even superb tune when the gradual movement kicks in. Extra importantly, I can seize footage spontaneously with out having to consider what I have to do in put up, because the AI powers of Instantaneous Sluggish-Mo fill within the lacking frames to finish the slow-motion impact.

Sketch to Picture

Samsung clearly had the most effective yr when it comes to AI options, and it did not cease with the Galaxy S24’s arrival manner again in January. The Galaxy Z Fold 6 and Galaxy Z Flip 6 launched us to Sketch to Image, which takes drawings you make in several apps and makes use of generative AI to transform them into sensible illustrations.

Sketch to Picture works greatest if you’ve obtained a modicum of expertise and an S Pen-compatible telephone, however the function additionally helps primitive sketches you make along with your finger. Better of all, Samsung prolonged this functionality to the Galaxy S24, Galaxy S23 and Galaxy S22 in addition to some older foldables, as Samsung has been fairly beneficiant on the subject of delivering new AI capabilities to present fashions.

AI telephone options that missed the mark

An email run through Writing Tools' professional filter and then subjected to the Rewrite tool

An electronic mail transformed utilizing the Rewrite device — up to date model on the suitable (Picture credit score: Future)

I learn a wag on Bluesky dismissing smartphone AI options as glorified spellcheck, and whereas I feel that is a bit harsh in some circumstances, it is uncomfortably near the mark for the Writing Tools introduced via Apple Intelligence. Writing Instruments are supposed to enhance your writing with shortcuts for altering tone in addition to instructions that examine… properly… spelling and grammar. They usually fill that transient within the broadest doable sense, although not all the time in a manner that flatters your writing.

Let’s give some credit score the place credit score is due. In case you’re composing a enterprise letter, the Skilled preset in Writing Instruments is acquainted sufficient with formatting and elegance of this very structured type of writing to transform your draft right into a competently crafted textual content. The Describe Your Change feature added in the iOS 18.2 replace additionally provides you extra ontrol over the modifications in tone that Writing Instruments will impose in your writing — not a nasty improvement within the larger scheme of issues and an indication of how Apple can enhance instruments even after they’re launched.

However different Writing Instruments presets are content material to exchange a couple of phrases with synonyms and strip out any sort of non-public voice out of your writing. The top impact is often textual content that does not learn like a human being composed it — and that is the other impression you must need to make in an electronic mail or a report.

Genmoji

Genmoji creation on an iphone 16

(Picture credit score: Future)

Whereas we’re throwing shade Apple’s manner, let’s avoid wasting raspberries for Genmoji, the device that creates custom-made emoji based mostly on textual content descriptions that you simply supply. The function does what it says within the description: you may certainly inform Apple Intelligence to whip you up an emoji of a fox dressed as an astronaut or a good friend of yours clutching a greenback invoice. However — and I feel this can be a query we have to ask of any AI function — to what function?

I say this as somebody who has little use for emoji: an image could also be value a thousand phrases, however phrases are nonetheless fairly helpful on the subject of speaking with different individuals. However I’ve a tough sufficient time deciphering teeny-tiny emoji in textual content messages that care generally used. I’ve now obtained to determine what somebody messaging me means after they ship me a mushroom carrying a prime hat? Let’s file this one beneath AI occasion methods and spend our time on extra edifying AI capabilities, please.

Picture Playground/Pixel Studio

Different examples of a Pixel Studio image created with text prompts on a Pixel 9 Pro

(Picture credit score: Future)

Whereas we’re with reference to instruments that exhibit the ability of generative AI however serve little sensible function, let’s discuss generative picture creation — options like Image Playground on the iPhone or Pixel Studio on the Pixel 9. With these capabilities, you should utilize textual content prompts to create a picture that matches your description.

On paper, that is an intriguing functionality, and the outcomes from both Picture Playground or Pixel Studio impress up to some extent. However the limitations are so extreme — Apple’s Picture Playground solely helps two totally different kinds for the time being, for instance and the ultimate product so related, that other than texting your output to associates, you seemingly will not have a lot use for the pictures. I used Pixel Studio so much main as much as my Pixel 9 Professional assessment, and since then, I’ve not even touched the function. That is probably not an argument in favor of how important generative picture creation instruments could be on the telephone.

Chat Help

Chat Assist texts for a friend produced on a Galaxy S24

Chat Help adjusting the tone of a textual content message (Picture credit score: Future)

It is solely truthful that we spend a while on Galaxy AI’s lesser capabilities, and for me, that is Chat Assist. Like Writing Instruments on the iPhone, Chat Help appears to fine-tune the tone of any textual content messages you ship — making texts to co-workers sound a bit of extra skilled and texts to family and friends rather less stiff. The top result’s often texts so unnatural, your family and friends will marvel in the event that they’re being texted by your captor.

I took Chat Assist out for a spin earlier this yr to see if messages tweaked by Chat Help got here throughout as ones that I’d have composed by myself. Just a few AI-crafted messages slipped by my take a look at topics, however they had been largely formal ones or ones despatched to individuals who knew me casually. Shut family and friends will spot Chat Help-tweaked texts the second you press ship, so do not even trouble utilizing this function for the commonest type of messaging. And that makes me marvel why it is even included with Galaxy AI in any respect.

Add Me

As adept as Google is at including AI-powered instruments to its telephones, it is due a couple of turkeys of its personal, and this yr’s Add Me addition actually did not measure as much as previous Google updates. In case you’ve forgotten Add me lets you be a part of the group photographs you’ve got taken by letting you hand off the digital camera to another person and utilizing AI to dictate the place you must stand. Add Me then takes the 2 photographs — the one with you, and the one with out — and combines them into one seamless photograph.

It is a stable concept, however the output is not all the time as seamless appropriately, at the very least not after I’ve tried to make use of Add Me. The difficulty lies with handing off the digital camera to another person. Until they angle the telephone in the very same manner and at the very same peak, I’ve discovered my outcomes are usually off — in a single photograph with some members of the family, I ended up wanting like an outsized big dropping in on a group of hobbits.

Perhaps Add Me works extra seamlessly the extra acquainted you get with the function and the extra you are capable of account for any quirks in how totally different individuals body the identical shot. However the outcomes I’ve seen are too erratic for me to belief Add Me.

AI options that want extra work

Digital assistants

Siri asking follow up questions in iOS 18.1 developer beta animation.

(Picture credit score: Future)

Some AI additions to telephones are neither good nor dangerous — they’re simply incomplete. That is how I really feel in regards to the AI enhancements to the digital assistants on board most main flagships, as there have been some robust enhancements previously yr with the extra important additions but to return.

Google’s digital assistant, now changed by Gemini Live, might be the furthest alongside because it’s included Google’s AI chatbot to a powerful total impact. The change has made the Pixel’s on-board assistant simpler to speak to and extra succesful on the subject of understanding the context of your questions. And when you’ve purchased one of many three Pixel 9 Professional fashions, you additionally get a yr of Gemini Superior and its extra complicated options at your disposal.

Siri is getting an Apple Intelligence revamp, too, and thus far that is meant a brand new design — the face of your iPhone flashes when Siri is listening — plus integration with ChatGPT, when you decide in to that. Siri helps extra pure language, however the true enchancment will come when the assistant understands and acts upon no matter occurs to be in your display screen — a function that we’re anticipating to within the coming months. Samsung is promising a lot the identical factor with its One UI 7 replace, which is in beta now forward of its launch alongside the Galaxy S25. That is more likely to happen later this month.

A context-aware assistant is the important thing for a lot of smartphones, so we’ll be higher capable of assess who’s obtained the neatest assistant as soon as that essential piece is in place.

Extra from Tom’s Information

Sensi Tech Hub
Logo