Google I/O 2024: New AI Assistant Can Read Everything Through Your Phone’s Camera

s aadeetya s aadeetya | 05-15 16:10

Google I/O 2024 keynote was surprise, surprise, all about AI. The company has a lot of catching up to do with OpenAI now taking ChatGPT to the 4o version earlier this week. The I/O 2024 keynote has shown us the work Google has been doing behind the scenes with the help of the Google Deepmind AI team.

And one of the products to roll out from the lab is called Project Astra, which is a new-gen AI assistant that promises to integrate AI into mobile devices with spatial understanding and video processing to give you accurate information.

Project Astra – The Everyday AI Assistant

The multimodal from Google is based on Gemini is basically its way of saying to OpenAI that we are here for the battle. So, how does this version of the AI Assistant work? Google is using the camera on your phone to guide the AI assistant to help you understand the things near you. Here’s a quick demo that Google showed at the keynote:

For a long time, we’ve been working towards a universal AI agent that can be truly helpful in everyday life. Today at #GoogleIO we showed off our latest progress towards this: Project Astra. Here’s a video of our prototype, captured in real time. pic.twitter.com/TSGDJZVslg— Demis Hassabis (@demishassabis) May 14, 2024

It can even read a code written on a PC and help you determine its purpose or solve the complex code as well. That’s not all, you can point the camera to the street and ask the AI assistant to tell you where you are located and get more localised details if indeed.

Google says these capabilities via Project Astra will be available in Gemini Live within the main app that will be available later this year. The tech will initially work on the Pixel phones and Google sees the AI assistant coming to more devices, which includes the smart glasses and even TWS earbuds some day.

About the Author
S Aadeetya
S Aadeetya, Special Correspondent at News18 Tech, accidentally got into journalism 10 years ago, and since then, has been part of established media ho...Read More

Disclaimer: The copyright of this article belongs to the original author. Reposting this article is solely for the purpose of information dissemination and does not constitute any investment advice. If there is any infringement, please contact us immediately. We will make corrections or deletions as necessary. Thank you.


ALSO READ

China's Zeekr launches EV in Australia, eyes New Zealand next

Chinese EV maker Zeekr's has begun sales of its first model for Australia. Chinese EV maker Zeekr's ...

Hyundai is for the long haul and do not expect to make quick buck on listing: Dipan Mehta

Dipan Mehta, Director, Elixir Equities.Dipan Mehta, Director, Elixir Equities, says Hyundai compares...

EV chipmaker Wolfspeed set to receive USD 750 million US chips grant

Wolfspeed's devices are used for renewable energy systems, industrial uses and artificial intelligen...

Rio Tinto Q3 iron ore shipments rise, Simandou on track for 2025

Rio said iron ore production from its Iron Ore Company of Canada (IOC) operations fell 11% following...

Hyundai issue is for long-term investors; expect 16-18% growth in next 2-3 yrs: Narendra Solanki

Narendra Solanki, Head Fundamental Research-Investment Services, Anand Rathi Shares & Stock Brok...

Electric car sales have slumped, misinformation is one of the reasons

The politicisation of green initiatives adds to the challenge. When electric vehicles become associa...