Over the previous few years, Google’s whole schtick with the Pixel lineup has been AI, AI, and a bit extra AI. Often, that’s been closely centered on the cameras.
Nonetheless, with the Pixel 10 lineup, Google is broadening its focus and is sprinkling its AI magic into how you utilize your cellphone.
The Pixel 10 collection arrives with a function referred to as Magic Cue, and it’d simply be essentially the most futuristic tackle contextual AI that I’ve seen on a cellphone thus far. A lot in order that it feels just like the pure evolution of how smarter telephones ought to behave.
Magic Cue isn’t a voice assistant ready for a voice immediate or a substitute for Gemini.
As a substitute, it’s a contextual pop-up that watches what you’re doing in your cellphone, makes use of on-device AI to determine one of the best ways to speed up the duty, and nudges you with simply the correct quantity of knowledge on the proper time.
The device is all about surfacing contextual info on the proper time utilizing the ability of the Tensor G5 chip and Google’s Gemini Nano AI mannequin constructed proper into the cellphone. Right here’s the whole lot it is advisable to find out about it.
How Magic Cue integrates into on a regular basis use
Quick, non-public, on-device
As a part of its Made by Google launch occasion, Google demonstrated a variety of use circumstances for Magic Cue. Of those, one which made speedy sense was pulling up info out of your electronic mail.
Suppose you’re on a name with an airline. You’ll probably be juggling between the dialer, electronic mail app, after which search to drag up a flight reserving.
Magic Cue trims down that course of by a number of steps. It will possibly acknowledge that you’re making a flight-related name and may pull the reserving info proper there in your display screen utilizing contextual cues.
That’s fairly implausible.
Not solely does it facilitate straightforward communication, nevertheless it additionally makes it simpler to herald contextual info with out fixed juggling of apps.
That’s only one facet of Magic Cue demonstrated by Google.
In case you’re texting mates about making dinner plans, Magic Cue can pull eating places that you simply would possibly’ve looked for lately and may even share Google Maps areas with a single faucet.
Not solely does it facilitate straightforward communication, nevertheless it additionally makes it simpler to herald contextual info with out fixed juggling of apps.
Magic Cue makes use of contextual cues to attach the dots throughout apps.
So, for instance, while you decide in, Magic Cue can look via Gmail for affirmation emails, Calendar for upcoming occasions, Google Maps for lately searched areas.
It will possibly even faucet into your Google Photographs library for current pictures and extra to drag in info factors that it might probably floor when wanted.
All this knowledge stays in your cellphone and is processed utilizing the on-device Gemini Nano LLM. Not solely does this assure privateness, nevertheless it additionally retains issues operating quick.
Furthermore, Magic Cue by no means auto-replies or provides in, say, images in your behalf. It solely offers you useful recommendations which you can settle for or deny, which is essential to avoiding mistaken info or, worse, info you don’t wish to exit.
What’s Magic Cue able to?
On-device processing brings advantages and constraints
At launch, Magic Cue will work finest with Google’s first-party apps.
As a part of the Google Pixel 10 launch, the corporate demonstrated the AI add-on working throughout Google’s first-party apps like Gmail, Messages, Calendar, Photographs, and extra.
Nonetheless, Google has additionally confirmed that will probably be opening the door to third-party builders to construct integrations that may tie into Magic Cue.
For markets the place messaging apps like WhatsApp are extra related than customary textual content messaging, assist for Magic Cue will probably be a game-changer.
The cues that you simply see are solely in your system and gained’t switch or sync to different Pixel gadgets and even the Pixel Pill.
Since that is based mostly on on-device intelligence, Magic Cue has sure limitations.
The cues that you simply see are solely in your system and gained’t switch or sync to different Pixel gadgets and even the Pixel Pill.
Equally, it’s not totally rolled into Gemini and operates as its personal distinct AI assistant in your cellphone.
Why Magic Cue could be the way forward for help on telephones
Whereas it’s straightforward to see Magic Cue on the Pixel 10 as little greater than a bunch of shortcuts linked collectively, in follow, it’s so far more than that.
Magic Cue represents a shift from AI as an assistant that you simply name on to an AI that proactively factors you in the precise route and turns into part of your day by day workflow.
From messaging to calling, managing calendar appointments, and extra, Magic Cue makes use of on-device intelligence to supercharge productiveness in a manner that we haven’t seen earlier than.
It’s quick and personal and gives an enormous step past textual content rewriting and picture era.
That is nonetheless the primary model of Magic Cue, and I count on the performance to develop considerably after third-party assist rolls out.
Nonetheless, even in its first iteration, it units the tone for the place AI-enhanced smartphones are heading.
And if it really works in addition to demoed, it could be the primary smartphone AI function that I may name a system vendor.