MilikMilik

Gboard’s Next AI Upgrade Aims to Read Your Screen for Smarter, Context‑Aware Replies

Gboard’s Next AI Upgrade Aims to Read Your Screen for Smarter, Context‑Aware Replies
interest|Custom Keyboards

From Simple Suggestions to a Smarter On-Device AI Keyboard

Gboard has long offered basic AI text suggestions, but its upcoming Writing Tools expansion points to a much more capable on-device AI keyboard. Hidden controls discovered in the latest beta show that Google is preparing a system that behaves less like a simple autocorrect engine and more like an expert writing coach. The underlying model, likely Gemini Nano or its successor, is designed to scan what you type and surface three AI-powered refinements as tappable buttons. These shortcuts help you quickly transform your writing without leaving the keyboard. Crucially, the APK teardown hints that processing will happen on-device rather than in the cloud, a shift that promises faster responses and tighter privacy control. While some features may be limited on devices with less RAM, the direction is clear: Gboard AI writing is evolving into a more contextually aware, locally run assistant that lives inside your keyboard.

Custom Prompts in Gboard: Tell the AI Exactly How to Write

One of the most intriguing additions is support for custom prompts in Gboard’s Writing Tools. Today, you can choose from predefined styles like professional, friendly, or emojify. Soon, you may be able to type your own instructions in a dedicated input box labeled “Enter your custom prompt.” The keyboard would then use that guidance to rewrite or improve your text, with your original content and the AI’s response stacked in a window above. This custom prompts Gboard feature could let you request specific tones or tricks, such as “less robotic,” “make a joke,” or “add corporate jargon,” instead of relying solely on generic styles. Although the feature is not fully functional in testing and its reliability remains unknown, it signals a move toward highly personalized AI text suggestions that adapt to your unique voice and communication needs.

Letting Gboard Read Your Screen for Context-Aware Text Suggestions

Beyond rewriting what you have already typed, Gboard AI writing tools are being prepared to understand what you are looking at. Strings found in the beta suggest that Gboard could soon read on-screen content and even access screenshots to draft more relevant replies or messages. With permission, the keyboard may gain access to your screenshots folder, likely focusing on the most recent image, to infer context such as order details, event information, or chat snippets. A similar experience already exists for some users through the combination of Gboard and a dedicated screenshot app, but this new method appears more deeply integrated. Google is also exploring the ability for Gboard to view your ongoing conversations, enabling AI text suggestions that align with the topic, tone, and history of the chat, so replies feel less generic and more naturally in tune with the discussion.

Drafting Entire Messages with On-Device Gboard AI Writing

Gboard’s upcoming features are not limited to polishing what you write; they also aim to help you start from scratch. In addition to existing correction and rewrite options, new controls point to a mode where you describe what you want in a separate input field and let the on-device AI keyboard draft a full message. This mirrors the “Help me write” experience already seen in apps like Gmail and Chrome, but places it directly at the system keyboard level. Combined with screen context and chat awareness, Gboard could generate replies that reference the specific situation you are responding to, not just generic templates. You might, for example, ask it to “draft a polite reminder about our meeting” while it simultaneously reads the conversation thread and tailors the result. If these experiments ship broadly, everyday typing could become more about guiding AI than composing every word yourself.

Privacy, Limitations, and What This Means for Keyboard AI

The shift toward on-device AI keyboard processing is as much about trust as it is about convenience. Google’s internal guidelines for Gboard’s AI emphasize local computation, minimizing the need to upload your text or screenshots to remote servers. This design should alleviate some privacy concerns around letting a keyboard read your screen or conversations, since analysis happens on your phone. However, there are trade-offs. Advanced models require memory, so some of the more ambitious Gboard AI writing capabilities may be restricted on devices with limited RAM. It is also worth remembering that these findings come from an APK teardown, which means features could change, be delayed, or never reach stable release. Still, the trajectory is clear: Gboard is evolving into a highly contextual, on-device assistant that understands your prompts, your screen, and your chats to produce more relevant and personalized AI text suggestions.

Comments
Say Something...
No comments yet. Be the first to share your thoughts!