We look forward to Gemini and Google AI alternatives

In Next Life, Google has previewed various Gemini-branded and optional AI features in its consumer-facing apps. Here is everything that has been presented and when they may become available.

pixel

In late 2023, a Google-produced zoom tool that “intelligently fills the gaps between pixels and predicts fine detail” was teased for the Pixel 8 Pro. Taking advantage of the on-device “custom generative AI image model”, Google describes it as helpful when you lose the zoom.

This is a fantastic utility of Generative AI, which opens up a realm of possibilities for framing and modifying your images. So whatever kind of zoom enhancement you’ve adopted to see the truth of science – that’s ethical – in the phone you’re holding.

In October, Google said it would “happen later.” Next 3 pixel quality drop, still to get it. If the style Google is thinking about is the Gemini Nano with multimodality then it is no longer in the sunlight. At this stage, it would line up nicely with the Pixel 9 Pro as the flagship photo component of that phone.

Google House

In the Google Home app, Generator AI can be used to summarize events into a “streamlined view of what happened recently.” This “quick and easy summary” bullet will put together the usefulness of things, allowing you to find video history clips and even interactively “ask about your home” to get automations. “Experimental features” for Nest Mindful customers are coming in 2024.

Fitbit

Fitbit Labs will let Fitbit’s top-tier customers test and provide comments on experimental AI features.

One such component is a chatbot that allows you to ask questions on your Fitbit information in a herbal and conversational approach. This is “personalized coaching” that takes into account, targeted objectives to generate “actionable messages and guidance”, with responses that can come with customized charts.

• For example, you can take a deeper look at how many active zone minutes (AZM) you get and how that relates to how restful your sleep is.
• “…This model may be able to analyze variations in your sleep patterns and sleep quality, and then suggest recommendations on how you might change the intensity of your workouts based on those insights.”

Behind the scenes, it’s powered by Fitbit built on Gemini and a new privately-owned LLM from Google Analytics. As of March, it’s coming “later this year” to “a limited number of Android users enrolled in the Fitbit Labs program in the Fitbit mobile app.”

google footage

Ask Footage will let you ask questions about pictures and videos in your library. Apart from finding photos, it can extract data and come up with a textual content solution. Powered through Gemini, example questions include “Show me the best photo from each national park I’ve visited” and “What themes should we have for Lena’s birthday parties?” Come with. It can be used to “suggest top pictures” and create captions for them. Ask Footage is an “experimental feature” that may launch soon, with Google already rolling out additional features.

Gmail + Google Workspace

In Gmail for Android and iOS, you’ll find a Gemini button in the top-right corner that lets you grab the mobile same as the side panel to go into full activation. Gmail is also getting relevant Naughty Replies that trade in additional custom designs, graphics, and subtle ideas. It can be introduced in Workspace Labs in July.

At Cloud 2024 in April, Google also previewed a tone prompting capability for Help Me Scribble in mobile Gmail. Meanwhile, an “Instant Polish” component will “turn rough notes into perfect emails with a single click.”

Available on desktop Internet, Side Panel in Gmail, Google Force, and Docs/Sheets/Slides. Gemini is the closest thing to Google Chat for summarizing conversations and resolving questions.

Google Map

Back in February, Google announced that Maps would use LLM to power an “Ask About” chatbot. You will be able to use this to find playgrounds that suit your needs for follow-up questions. It is powered by information about 250 million playgrounds and user-submitted footage, movies and reviews.

chrome

Gemini Nano is coming to desktop Chrome to power browser features like “Help me write.” It should be available on most current computers and desktops.

google seek

But even after launching AI Reviews, Google previewed several then-current features that are coming to Seek Labs for the first time:

• It’s possible for you to whip up a fresh AI assessment and prepare it to be “simple” (just a few sentences) or “broken down” (longer response).
• Multi-step reasoning features will let you ask a complex question in a single attempt instead of breaking it into a few questions.
• Eat and go back and forth making plans
• AI-organized search effect web page
• Search videos: Report a video and ask questions about it

Android

A Gemini Nano with multimodality will launch on the Pixel “later this year” and tool options like on-device/offline talkback details and a real-time rip-off indicator that calls attention to telltale patterns. Google will share more details on this afterlife.

At I/O 2024, Google additionally previewed how the Gemini effect on Android will become an overlay panel in lieu of opening a fullscreen UI. But while still maintaining the context, this will sometimes let you drag and drop the generated symbol directly into the dialog. For Gemini Complex subscribers, the “Ask this Video” and “Ask this PDF” buttons will view Gemini Digest movies and paperwork respectively. It is being implemented “over the next few months.” Additionally, Dynamic Ideas will use the Gemini Nano with multimodality to understand what is in your display:

For example, if you include a Gemini in a conversation talking about pickleball, ideas like “Find pickleball clubs near me” and “pickleball rules for beginners” might come up.

Another addition that may be particularly useful on mobile is the Gemini extension for Google Calendar, Tasks, and Store. This will probably let you whip up an image of a web page with some dates that Gemini will be able to create a calendar event from. In the coming months, a “Utilities” feature will give Mobile Gemini access to Android’s Clock app.

We’re also looking forward to Cellular Gemini arriving on the Pixel Pill this summer.

Gemini

Will a living will let you have two-way conversations with Geminis? To bring the fun together more naturally, Gemini will give brief responses that you will then ask to add fresh knowledge or for clarification. You’ll be able to select from 10 other voices Google is imagining might be useful for preparing for Gemini interviews or practicing pronunciation. It will be available to Gemini Complex participants in the “coming months.”

“Later this year,” Gemini Live will let you inaugurate a live camera technology. Simply focus on something in the real world and ask a question about it. This undertaking is operated by Astra.

There are custom designed variations of Gemstone Gemini that will provide you with a “gym buddy, sous chef, coding partner, or creative writing guide.” Gemini Complex participants will have the ability to create customized gems, giving all customers access to pre-built gems like Reading Tutor.

Simply describe what you need your gem to do and how you want him to respond – like “You are my running coach, give me a daily running plan and be positive, upbeat and motivating.” Gemini will understand those instructions and, with a single click, strengthen them to create a gemstone that fulfills your special wishes.

Gemini Complex users will also find an “immersive planner” that goes beyond simply suggesting activities but actually incorporates matters in progress and interests the public as well as creating a detailed itinerary. Gemini will access aviation/progression details in Gmail, Google Maps suggestions for dining and museums at your resort, and look for alternative activities.