Your Phone Camera Could Be Ctrl+F for the Real World, Thanks to Google



Last month, Google launched Multisearch, an update to the Google search tool and app, that lets users find answers by snapping a picture. This feature works by suggesting similar products based on the image and phrases you provide to search engines – for example: “Can I buy this green?” Then a hat photo.

Let’s say you just finished watching one of the five-minute craft or budget cake decorating videos that pop up on Facebook, and you’d love to get something cheap for your friend’s birthday.

, These are the best Google phones

The idea is that multisearch will be fine-tuned, based on the image you provide, from millions of retailers near you as well as local businesses that Google provides. You will get what you want. Watch the main video below for full details on how Multisearch and future updates will work.

Google’s technology and multi-modal understanding can recognize the visual intricacies of the image you use, and tie it to intent. The tool then scans millions of images, reviews and updates, as well as finding results at nearby food spots and retailer locations with the help of map contributors.



Currently this technology can only recognize objects captured within a single frame, although apparently there may be situations where we need information about an entire scene in front of us such as a pharmacy shelf.

Google is working on an advanced search called Multisearch called Scene Exploration, which lets users pan the camera, ask a question, and quickly find information about multiple objects within a wider scene. Huh.

Scene Exploration Demo at Google I/O 2022 (Image Credit: Google YouTube)

The applications of this innovative tool are limitless and help with everything from daily uses such as shopping lists, supporting minority-owned products, museum or art gallery searches, photography location scouting, assisting conservationists in identifying plant species. can do. who are in crisis, and helping disaster relief workers to quickly retrieve the donations they have received.

Useful insights await you when using your smartphone’s camera in Scene Exploration Mode, and labels hovering over a particular item or product as you pan on a store shelf, to identify whether it’s gluten and dairy-based. is free or involves someone insane.

Scene Exploration operates by using computer vision to quickly connect the multiple frames that make up the scene you are capturing, and identify all of the objects within it. Using Google’s Knowledge Graph, the software will then work to uncover the most useful results based on the keywords or questions you ask when scanning with your smartphone camera.

Google I/O Conference 2022 (Image credit: Google YouTube)

Multisearch will be updated by Google later this year to allow for the collection of local information, which is being referred to as Multisearch Near Me. Users can long press on any image or take a picture in an instant, and Multisearch will do the rest.

Google says it aims to make search more natural and helpful so that users can search the world anywhere, anytime. This innovative technology is definitely a step in the right direction and is a great tool for browsing in person and online as an extension of the Google Lens tool that we already have.

Watch the video below for a brief look at the innovations and products announced from Google I/O 2022.

Today’s best Google Pixel 6 and Google Pixel 6 Pro deals

Read more:

best camera phone
best wireless earbuds
best phablet
google pixel 6 review
google pixel 6 pro review

Source



Related News

SAR values ​​and smartphones, everything you need to know

The smartphone have been an integral part of our daily life for years: for this reason it is essential to ensure that their use, even in the long term, does

Valve says you shouldn’t fix a steam deck noisy fan like this

The Steam Deck started shipping two months ago today, and it's gotten a lot better since then, but this week may be the best one yet — because we're finally

Apple shares fall after company warns of a potential $8 billion hit from supply constraints

Apple's revenue rose nearly 9% year over year for the quarter ended March, the company said on Thursday, showing strong growth and investors worrying about

Review – Nokia 8.3 5G: the brick that is not the weight

Nokia presented James Bond's new smartphone in September 2020: the Nokia 8.3 5G. Sold at €659, it is the current flagship of the brand. If we still have to

iOS 15.5 beta blocks memories of photos taken in “sensitive” locations

Apple has just made a new adjustment that has been discovered in the beta of iOS 15.5 and that can bring controversy. Turns out we've taken a photo on a site