Your Phone Camera Could Be Ctrl+F for the Real World, Thanks to Google



Last month, Google launched Multisearch, an update to the Google search tool and app, that lets users find answers by snapping a picture. This feature works by suggesting similar products based on the image and phrases you provide to search engines – for example: “Can I buy this green?” Then a hat photo.

Let’s say you just finished watching one of the five-minute craft or budget cake decorating videos that pop up on Facebook, and you’d love to get something cheap for your friend’s birthday.

, These are the best Google phones

The idea is that multisearch will be fine-tuned, based on the image you provide, from millions of retailers near you as well as local businesses that Google provides. You will get what you want. Watch the main video below for full details on how Multisearch and future updates will work.

Google’s technology and multi-modal understanding can recognize the visual intricacies of the image you use, and tie it to intent. The tool then scans millions of images, reviews and updates, as well as finding results at nearby food spots and retailer locations with the help of map contributors.



Currently this technology can only recognize objects captured within a single frame, although apparently there may be situations where we need information about an entire scene in front of us such as a pharmacy shelf.

Google is working on an advanced search called Multisearch called Scene Exploration, which lets users pan the camera, ask a question, and quickly find information about multiple objects within a wider scene. Huh.

Scene Exploration Demo at Google I/O 2022 (Image Credit: Google YouTube)

The applications of this innovative tool are limitless and help with everything from daily uses such as shopping lists, supporting minority-owned products, museum or art gallery searches, photography location scouting, assisting conservationists in identifying plant species. can do. who are in crisis, and helping disaster relief workers to quickly retrieve the donations they have received.

Useful insights await you when using your smartphone’s camera in Scene Exploration Mode, and labels hovering over a particular item or product as you pan on a store shelf, to identify whether it’s gluten and dairy-based. is free or involves someone insane.

Scene Exploration operates by using computer vision to quickly connect the multiple frames that make up the scene you are capturing, and identify all of the objects within it. Using Google’s Knowledge Graph, the software will then work to uncover the most useful results based on the keywords or questions you ask when scanning with your smartphone camera.

Google I/O Conference 2022 (Image credit: Google YouTube)

Multisearch will be updated by Google later this year to allow for the collection of local information, which is being referred to as Multisearch Near Me. Users can long press on any image or take a picture in an instant, and Multisearch will do the rest.

Google says it aims to make search more natural and helpful so that users can search the world anywhere, anytime. This innovative technology is definitely a step in the right direction and is a great tool for browsing in person and online as an extension of the Google Lens tool that we already have.

Watch the video below for a brief look at the innovations and products announced from Google I/O 2022.

Today’s best Google Pixel 6 and Google Pixel 6 Pro deals

Read more:

best camera phone
best wireless earbuds
best phablet
google pixel 6 review
google pixel 6 pro review

Source



Related News

Epic is asking a court to block Google from shutting down Bandcamp from the Play Store

Epic Games has filed a motion for a preliminary injunction preventing Google from removing independent music storefront Bandcamp from the Android App Store —

Xbox is catching up to PlayStation

Hello, and welcome to Protocol Entertainment, Your guide to the business of the gaming and media industries. This Friday, we're checking out Microsoft's very

iPhone 14 screen leak shows us what we’re expecting from the four new phones

We've been hearing so many rumors and leaks of the iPhone 14, that none of them are really surprising anymore - but a new one gives us a clear representation

OnePlus 10R launched as a rebranded OnePlus Ace with all its features

OnePlus has announced a new smartphone OnePlus 10R in India. The handset is basically a rebranded OnePlus Ace that was recently launched in China. That's

How to know the password of Windows 10

In this article we show you how to know the Windows 10 key, a key that is necessary to be able to activate Windows 10 and enjoy the updates and configuration