Copyright newskarnataka
Microsoft has rolled out a major update to its Copilot app on Windows, introducing Vision — a new feature that allows users to interact visually with on-screen apps through text. The update enables seamless switching between text and voice inputs, offering a more flexible and accessible AI experience for users. The new capability, available through the Microsoft Store, is currently being rolled out in phases to all Windows Insider Channels. Vision via text: A new way to interact Until now, Microsoft Copilot Vision primarily functioned through voice commands. Users could share their screen or apps, and Copilot would provide spoken feedback, explanations, or suggestions. With this new feature, Microsoft is making Copilot more inclusive by enabling text-based interaction directly within the same chat window. This means users can type their queries or instructions related to whatever is visible on-screen — from Excel spreadsheets and PowerPoint slides to web pages or applications. Copilot then provides text-based responses that guide or assist users through the task. The feature is particularly useful in quiet workplaces, libraries, or meetings, where speaking aloud may not be ideal. By integrating text alongside voice, Copilot Vision brings more versatility to digital interaction. Seamless switching between text and voice The update also focuses on ease of transition between communication modes. Users can switch instantly from text to voice by pressing the microphone icon during a Vision session, allowing hands-free participation. Similarly, a session can be stopped anytime by pressing the “Stop” or “X” button in the composer window. Microsoft says this flexibility supports its vision for personalised AI experiences, allowing users to interact naturally — whether typing or speaking — without changing how they work. Improvements and current limitations While this update marks a major leap forward, some features remain unavailable in this version. For instance, Copilot currently does not support on-screen highlighting, which would allow the AI to visually draw attention to specific elements on the display. Microsoft, however, emphasised that Vision will continue to evolve based on user input. Insider users are encouraged to share their experiences via the “Give feedback” option in the Copilot app, helping shape future updates to align with real-world needs. Part of a larger AI ecosystem The introduction of Vision with text-in and text-out is part of Microsoft’s broader effort to weave artificial intelligence into its Windows 11 ecosystem and hardware range, including Surface Pro, Surface Laptop, and Surface Laptop Studio 2. By combining visual reasoning with text and voice interactions, Microsoft aims to make Copilot the intelligent assistant for modern computing — capable of understanding context, analysing visuals, and offering actionable insights. Whether assisting in business presentations, creative design, or classroom learning, Copilot’s new multimodal capabilities promise to redefine how users interact with their PCs. The new Microsoft Copilot app (version 1.25103.107 and later) has started rolling out in waves through the Microsoft Store. Since the update is being monitored for performance and feedback, not every Windows Insider will receive it simultaneously. With Vision now supporting both text and voice, Microsoft continues to push towards an AI-driven Windows experience that feels intuitive, adaptive, and human-like — empowering users to engage with technology on their own terms.
