Gemini's new real-time screen and camera features bring Google’s AI assistant one step closer to becoming truly context-aware and visual.
Gemini, Google’s increasingly powerful AI assistant, is stepping up its game—literally watching and understanding what’s on your phone’s screen and through your camera in real time.
The tech giant has begun a gradual rollout of live video and screen-sharing features for Gemini, first teased last year under “Project Astra.” Now, users with a Google One AI Premium plan are starting to see these capabilities go live on Android devices.
What Can Gemini Do Now?
With the new update, Gemini can now watch your screen in real time and help you out based on what it sees. Planning a trip? It can summarize the travel itinerary you’re looking at. Confused about an app setting? Just ask—no need to switch tabs or copy-paste anything.
But it doesn’t stop at screens. Google is also enabling live camera access, turning Gemini into something closer to a pocket-sized assistant with eyes. During a demo, Gemini was asked to help pick the right paint color for pottery—it scanned the live image and offered contextual advice. That’s not just smart, that’s next-level smart.
Here’s the video!
Rolling Out Quietly But Significantly
Google hasn’t gone full throttle with the rollout yet. As reported by The Verge and Tech in Asia, the features are coming gradually to Android users. The approach is cautious, but the impact could be huge.
"We’re building a future where helpful AI can see and respond to the world just like you do," Google said in a previous keynote, hinting at its vision behind Astra.
The features are not just about flash. These features could mark a major leap forward in AI-human interaction—giving Gemini a better sense of context, visual awareness, and relevance.
Instead of typing long prompts or explaining what’s happening on your screen, it gives you a way to show it. Gemini handles the rest.
Whether it’s troubleshooting, shopping help, or even just identifying stuff around you, Google wants Gemini to be your go-to digital co-pilot. And while it’s still early days Gemini is clearly no longer just about chat. It’s learning to see.
