Google’s Gemini AI: Exciting, Convenient, and Terrifying for Your Privacy

Google pitches powerful AI-integration with your cell phone at 2024 Google I/O Conference

Marc Strocks
Adventures in Consumer Technology
4 min readMay 23, 2024

--

A toy-like robot faces the camera. Its face is a black screen similar to a computer monitor.
Photo by Possessed Photography on Unsplash

“We’re reimagining Android with Gemini at the core. From your favorite apps to the OS itself, we’re bringing the power of AI to every aspect of the smartphone experience,” announces Google’s Dave Burke to thunderous applause on the 2024 Google I/O mainstage. (Source)

Their most startling demonstration outlined how new Gemini capabilities will cut into Android phones and watch everything you do. The future of AI will operate “at the system level” and be “content aware.” That means it’s ever-present as you use your phone and it understands what you’re doing too.

And thus the future of handheld devices is altered forever. Meanwhile…

In the brain of movie-goers, a bell rings out. Memories of Spike Jonze’s 2015 film Her come flooding back. In this Joaquin Phoenix-led thought experiment, AI assistants explode into every aspect of human life — even family, friendships, and romance. They’re even called OS’s in the film, connecting all your personal tech under one smart infrastructure.

As AI becomes more advanced, Google wants to place more and more of our lives under its control for the sake of novelty and convenience. So do I. I love science fiction. But in the real world: concerns about our security and private conversations are mounting higher than ever in this technological age.

During his demonstration, Google’s Dave Burke set a scenario where he chats idly with a friend about pickleball. As he pulls up a Youtube video on pickleball, Gemini chimes in to offer spark notes on the video. When he opens a PDF, Gemini offers an option to search for answers throughout the full document. Its context awareness means it keeps track of what page he’s on without Dave needing to say anything.

Later, Burke ended his segment by accepting a (scripted) phone call. To audience laughter, the caller tries to scam him into transferring money to them… But thankfully Gemini alerts him to the phony scam. Here comes AI to save the day!

But wait. He never prompted Gemini with any information. He never gave it explicit access to listen to every call he takes, watching for fraud or malice. And yet, now AI will sit on your devices twiddling its thumbs until you give it things to do and tell it more about yourself.

And you’ll have no idea what your personal AI remembers long-term. We’ve joked about massive data surveillance for years. In the 2010’s, memes of “my FBI agent” watching my every move filled internet feeds. But deep down we had a logical argument: no one cares.

No one has the time to meticulously sift through the data of everyone you know, right? It’s too much work. That would take years and amount to so little benefit.

Now, with AI they can.

Our phones are already databases of info about our lives, loves, and pasts. Giving everyone a personal AI assistant to leverage this data opens a whole new world for Google and other corporations.

But even if Google promises security, these databases can be used by others too.

In 2018, updates to and bugs in Google+ API caused large-scale data leaks twice just that year, with over 52 million user profiles potentially being exposed. (Sources: https://archive.is/Y5xC1 & Wired.com)

In 2023, Google Fi cell service was involved in a cyberattack that exposed private information of over 37 million customers. (Source)

From 2020 to this year, Android and Google Chrome have had consistent incidents of severe vulnerability that they’ve struggled to patch out. (Sources: one & two)

And it’s an iceberg. There have been a startling number of similar data leaks in recent years involving big names like Sony, Facebook, Verizon, and Norton Antivirus.

Any info your cell phone keeps track of is not safe, no matter what claims Google makes about “responsible AI” and “keeping your sensitive data private.”

Sure, we can set aside corporate tendencies to sell your data to the highest bidder. We can even say they have our best interests at heart. If so, there will still be leaks of all kinds. Your phone’s new AI functions mean these leaks could expose your private conversations to anyone who cares to listen.

While Google’s claimed aspirations to fundamentally transform user experience may seem bright and exciting, that’s how Silicon Valley talks about everything.

The future is coming at breakneck speed. Beware what your phone knows about you. Watch what you consent to as technology gains a greater hold over our private lives.

--

--

Marc Strocks
Adventures in Consumer Technology

A writer, actor, and graphic designer from Chicago, IL. Traveling the continental US in a van he bought with his loving fiancé!