Your Phone Camera Could Be Ctrl+F for the Real World, Thanks to Google



Last month, Google launched Multisearch, an update to the Google search tool and app, that lets users find answers by snapping a picture. This feature works by suggesting similar products based on the image and phrases you provide to search engines – for example: “Can I buy this green?” Then a hat photo.

Let’s say you just finished watching one of the five-minute craft or budget cake decorating videos that pop up on Facebook, and you’d love to get something cheap for your friend’s birthday.

, These are the best Google phones

The idea is that multisearch will be fine-tuned, based on the image you provide, from millions of retailers near you as well as local businesses that Google provides. You will get what you want. Watch the main video below for full details on how Multisearch and future updates will work.

Google’s technology and multi-modal understanding can recognize the visual intricacies of the image you use, and tie it to intent. The tool then scans millions of images, reviews and updates, as well as finding results at nearby food spots and retailer locations with the help of map contributors.



Currently this technology can only recognize objects captured within a single frame, although apparently there may be situations where we need information about an entire scene in front of us such as a pharmacy shelf.

Google is working on an advanced search called Multisearch called Scene Exploration, which lets users pan the camera, ask a question, and quickly find information about multiple objects within a wider scene. Huh.

Scene Exploration Demo at Google I/O 2022 (Image Credit: Google YouTube)

The applications of this innovative tool are limitless and help with everything from daily uses such as shopping lists, supporting minority-owned products, museum or art gallery searches, photography location scouting, assisting conservationists in identifying plant species. can do. who are in crisis, and helping disaster relief workers to quickly retrieve the donations they have received.

Useful insights await you when using your smartphone’s camera in Scene Exploration Mode, and labels hovering over a particular item or product as you pan on a store shelf, to identify whether it’s gluten and dairy-based. is free or involves someone insane.

Scene Exploration operates by using computer vision to quickly connect the multiple frames that make up the scene you are capturing, and identify all of the objects within it. Using Google’s Knowledge Graph, the software will then work to uncover the most useful results based on the keywords or questions you ask when scanning with your smartphone camera.

Google I/O Conference 2022 (Image credit: Google YouTube)

Multisearch will be updated by Google later this year to allow for the collection of local information, which is being referred to as Multisearch Near Me. Users can long press on any image or take a picture in an instant, and Multisearch will do the rest.

Google says it aims to make search more natural and helpful so that users can search the world anywhere, anytime. This innovative technology is definitely a step in the right direction and is a great tool for browsing in person and online as an extension of the Google Lens tool that we already have.

Watch the video below for a brief look at the innovations and products announced from Google I/O 2022.

Today’s best Google Pixel 6 and Google Pixel 6 Pro deals

Read more:

best camera phone
best wireless earbuds
best phablet
google pixel 6 review
google pixel 6 pro review

Source



Related News

NASA’s James Webb Space Telescope is finally ready in place

The alignment of NASA's James Webb Space Telescope is now complete. The observatory is capable of capturing sharp, well-focused images with each of its four

Windows 11 KB5012643 Update Released With Improvements

Windows 11 KB5012643 is now available for download for all users, with a few notable changes and a host of additional bug fixes. The new update is distributed

Android 13 beta hands-on: Just small changes for now

The public Android 13 beta is here, and it's our first chance to see what might be in Google's OS update. We've already learned a bit about what the company

Astronomers are about to make a massive announcement about something in the galaxy

In two weeks' time, the European Southern Observatory (ESO) is going to introduce the world to new information about our galaxy.

Apple loses top spot in China as smartphone sales slump

Two research reports published this week showed that Apple (AAPL) has slipped to third place, behind Chinese Android handset brands.