Google Introduces Real-Time Screen and Camera Analysis for Gemini AI

Google has begun rolling out new AI-powered features for its Gemini Live assistant, allowing it to analyze screens and camera feeds in real-time. The feature, initially available to Google One AI Premium subscribers, enables users to receive instant responses about on-screen content or their surroundings via their smartphone camera. These capabilities stem from Google’s ‘Project Astra’ initiative, first demonstrated a year ago. A user on Reddit reported the feature appearing on their Xiaomi device, confirming its gradual rollout.

Another major addition is Gemini’s live video interpretation, allowing users to ask the AI assistant questions about real-world objects captured by their smartphone cameras. In a demo video, Google showcased how the feature can help users decide on paint colors for pottery by analyzing live video feeds.

This update positions Google ahead of competitors like Amazon, which is still preparing an upgrade for Alexa, and Apple, which has delayed improvements to Siri. While Samsung continues to support Bixby, Gemini remains the default assistant on its devices. The rollout of these advanced AI capabilities underlines Google’s ambition to lead the AI assistant market.