Google’s life-changing AR smart glasses demo left me stunned



When Viva and Yoshiko, one English speaker and the other a Mandarin Chinese speaker, tried out Google’s prototype smart glasses during a sneak peek at Google I/O 2022, my spine broke. His facial expressions, his sudden ability to communicate meaningfully with someone who previously didn’t fully understand what was being said, struck me greatly. This is an example of the type of technology I really love: one that can change lives.

‘Subtitles for the world’

You’d be forgiven if you missed this particular moment during Google I/O, as it came right at the end of the marathon event, and lasted just a few minutes. The actual smart glasses were not named, only shown in a demonstration video, and were really only revealed as a concept. Google also didn’t show us the interface or indicate that the smart glasses will ever be released as an actual product.

It was not necessary. Google sold the dream, Worn like a normal pair of glasses, the lens includes a small screen that shows a real-time translation of another language in augmented reality (AR), so it overlays what you normally see. Is. Google Product Manager Max Speer summed up the functionality perfectly, saying it was like a “subtitle to the world”. Sitting in front of someone who doesn’t speak the same language as you, Glasses will provide a text-based translation of the conversation as it happens.

You might be thinking that it’s similar to other translation technology—Google’s Pixel Buds, for example, feature translation—but there are some distinct benefits here. For a start, seeing text on a screen inside a pair of glasses means you can maintain eye contact without pressing a button or walking with a long, awkward silence as a machine translates. That’s what is being said. The text is less intrusive than listening to another voice, and because no one hears the translation, it doesn’t sound unnatural.

potential use

Anyone who has traveled abroad, or spent time in communities where languages ​​differ, will immediately understand how to benefit from such technology. I trembled not only because of the joy on the faces of those who tested the glasses, but because I immediately thought about how many times my own life would have changed if I had access to the same technology.



I remember having dinner with a friend in Japan, and although we both had a basic right to each other’s language, the conversation didn’t work out. We ended up using Google Translate on the phone and typing through the app instead of using voice as the atmosphere was quite noisy. It worked and was great fun, but it wasn’t perfect, and was very awkward at times. Smart glasses may have changed that situation completely.

I lived in Greece for many years, and while I understand a considerable amount of Greek, I cannot speak it properly. I wonder how Google’s smart glasses and translation system might have changed my time there? But, as I think about both of these situations and many others I’ve personally come across where smart glasses would have been really helpful, I quickly reach the big hurdle that not only is Google’s prototype glasses, Rather any wearable is translation technology.

The problem with any wearable device that provides visual translation for two people speaking different languages ​​is that all parties are required to own and wear one of them. Conversations are two-way things, and if only one of you understands what is being said, it only becomes useful in situations where feedback is not needed. So, in order for it to work for my scenarios, everyone I know in Japan and Greece has to wear smart glasses with Google’s translate technology. He seems … not likely,

Where they will work without wearing all the parties, is not for translation, but for transcription. Such visual transcription and enhancement can be life-changing for people who are apparently deaf or hard of hearing. My father wears hearing aids, but I know he would benefit from “seeing” the words, and wouldn’t remember the annoying audio feedback that comes with hearing aids in certain situations. It reminds me how transformative products like eSight smart glasses are for the blind and partially sighted.

Maybe not Google Glass 2

As much as I think we’re seeing an early version of Google Glass 2, I don’t think we are. Instead, we’ve seen an amazing demonstration of Google’s rapid progress in the speed and accuracy of its translation and transcription technology.

Demonstrated Google's AR SmartGlass translation feature.

There were many other examples of Google improving language skills during Google I/O 2022. It was announced that 24 more languages ​​have been added to Google Translate to serve 300 million new people worldwide. This takes a total of 133 supported languages ​​and is made possible by a new AI system called zero-shot machine translation, which learns new languages ​​through a combination of existing knowledge and new information, even when the source of that information is limited.

Google’s AI getting better at understanding natural language and the way it’s commonly used, such as with the Look and Talk feature on the Nest Hub Max, was also announced during I/O 2022. Before anyone with a Google Pixel 6 gives a try to Google. The Assistant’s ability to turn your voice into message replies or watch videos with live translation. Both are fast, and shockingly accurate, especially in terms of replying to messages.

I use Google Translate in various devices every day, usually translating Japanese, Korean and Chinese to English. These are very challenging to do, and using them effectively in conversation really requires a knowledge of how language works, or else embarrassing mistakes will be made. To listen and see now how Google is innovating and improving its translation technology means that my world is opening up even more, and I think it’s also a matter of slowly learning those languages. will make it easier.

Integrating Google’s advanced language and translation technology through a pair of smart glasses is exceedingly powerful. If I can immediately understand the benefits it will bring to me and those close to me, then I can only begin to understand the excitement that cannot be heard. You can put the Pixel 7 and Pixel Watch — showcasing such incredible futuristic technology — that’s why I sit for over two hours after Google I/O keynote presentations, and that’s when I start to understand that How potentially transformative all this can be are my bounties.

Editors’ Recommendations

Source



Related News

Toto byl exkluzivní „zvukový bar“ společnosti Apple: prodával se velmi málo, ale dnes je na eBay

Apple has been around longer than you think in the world of hi-fi. There was an Apple speaker many years before the HomePod, which coincidentally has just

Spotify je bezkonkurenční v propojené domácnosti: to je funkce, která ho staví mílovými kroky před konkurencí

Colors and streaming services are for everyone: Spotify, YouTube Music, Apple Music, Amazon Music... they all have their differences and similarities, but if

Vytápění domu svíčkami za méně než 50 centů denně: co je zimní metoda a proč to není dobrý nápad

With the cold waves typical of the time and the price of fuels, it is normal for us to sharpen our ingenuity in search of solutions to have a comfortable

Mám doma neutrální router na vylepšení Wi-Fi sítě a při změně operátora jsem zjistil špatnou zprávu

A few hours ago we have seen the differences that exist between the routers of the operators and the neutral models that we can find in stores. And if I have

Jak změnit kurzor myši ve Wordu? – Přizpůsobte si ukazatel

Po letech, kdy jsem viděl ukazatel Wordu ve formě šipky. Nyní můžeme změnit jeho tvar, barvu, velikost a další. Buď se stejnými nástroji jako