Microsoft has introduced an AI feature called Copilot Vision, which can read and respond to content on websites you're browsing, initially available in a U.S.-only preview.
This tool, part of the Copilot Labs program (which requires a $20/month subscription to the Copilot Pro plan), is capable of analyzing both text and images on web pages. It can answer questions, such as “What’s the recipe for this lasagna?” and provide additional functions like summarizing, translating text, or identifying discounts in online stores. It can even assist with games, offering tips during online matches like those on Chess.com.
Once enabled, Copilot Vision reads along with the user as they browse and provides help when needed, appearing at the bottom of the Microsoft Edge browser. Microsoft emphasizes privacy, stating that data from each session is deleted, and the information processed is not stored or used to train AI models, at least during this preview phase.
Currently, the tool is restricted to a list of pre-approved, popular websites and cannot access paywalled or sensitive content. Microsoft has not specified what constitutes “sensitive” content but has indicated the tool will avoid areas like adult material or graphic violence. The company is being cautious due to ongoing legal challenges, including a lawsuit from The New York Times, which claims Microsoft used its content inappropriately through Bing’s Copilot. Microsoft reassures that Copilot Vision will adhere to website rules and will not scrape data from sites that block AI bots.
The company plans to expand the feature over time based on user and publisher feedback, ensuring it aligns with legal and ethical standards.
Post a Comment