Skip to main content

All the Copilot updates announced at Build 2024

Microsoft Copilot Pro.
Microsoft

It’s that time of year again, and Microsoft is making various announcements regarding Copilot at its annual Build developer conference. As expected, AI is a massive part of what’s being said, just like last year.

Perhaps the biggest announcement in that regard was that GPT-4o was already live in Azure AI and would soon be coming to Copilot. It was mentioned as part of the Copilot+ press event yesterday, but not much information was provided, aside from the Minecraft tutorial demo.

Recommended Videos

Beyond that, Microsoft was focused on giving developers and users the tools to make custom Copilots suited for individual organizations and companies. This is not dissimilar to what Google announced at I/O last week with AI Teammates, but with far more advanced tools for developers.

The simplest way these custom Copilots can be created is in SharePoint with just a few clicks. that it claims will help you work faster by having AI do all the research to get the information you need faster. The Copilots will answer any questions based on the information they find on the SharePoint site.

The next tier is creating Copilots using Copilot Studio, which will let these AI agents go beyond just answering questions and begin to do work on your behalf. These independently working AI agents can be given tasks to work across an organization or business, having access to the entire suite of Microsoft 365 apps.

A Team Copilot being used alongside a Teams video call.
Microsoft

If you can’t wait to try it out, you can access it through the Early Access Program. Microsoft says the preview will be ready to use later this year but did not give a specific date.

The news doesn’t end there. Microsoft wants to enhance Copilot with extensions that will make new actions possible and give you helpful information for the assignment you’re working on. If you’re a developer, you can design Copilot extensions using Copilot Studio or Teams Toolkit for Visual Studio Code.

You can preview Copilot extensions from apps such as Priority Matrix, Jira, and Mural for Microsoft 365 and from company-developed line of business Copilot extensions. IT admins can manage and control access to the extensions through the Microsoft 365 admin center.

Microsoft also confirms that developers can easily add plug-ins to their Copilot extensions from their API endpoints using Teams Toolkit for Visual Studio Code. They can also use Microsoft’s new user experience features, such as handoffs (currently in preview) to a different AI assistant.

Last but not least, Microsoft presents a new AI assistant called a Team Copilot. This new tool also aims to save teams time by doing tasks that are too time-consuming. The Team Copilot will be available later this year, but Microsoft has not mentioned an exact date. If you want to access the preview, you’ll need a Copilot for Microsoft 365 license.

Unless Microsoft decides to make any last-minute changes, you can use features such as Product Manager that’ll create and designate tasks, keep track of deadlines, and alert you if your input is needed on anything using Loop. The Group Moderator feature will summarize long Teams chats, but we’ll see if it doesn’t leave out any important information.

Lastly, there is the Meeting Facilitator, which takes charge of meeting agendas and taking notes, with ad-hoc meeting support from Team Rooms.

Judy Sanhz
Judy Sanhz is a Digital Trends computing writer covering all computing news. Loves all operating systems and devices.
Microsoft Copilot now has a voice and can ‘see what you see’ on the internet
Microsoft CEO Satya Nadella announces updates to the company's Copilot artificial intelligence (AI) tool.

You might want to start treating your web browser like you're always at work, at least if you want to use Microsoft's new Copilot Vision feature. The feature, which is natively built into Microsoft Edge, is able to "see what you see, and hear what you hear" as you navigate your browser, according to Microsoft's Executive Vice President Yusuf Mehdi.

All of this AI snooping isn't for nothing. Copilot Vision looks at what you're doing online to answer questions, provide recommendations, and summarize content. It can work with the new Copilot Voice feature, for example. Microsoft demoed the capabilities on Rotten Tomatoes, showing a user chatting with Copilot while browsing the website and looking for movie recommendations. Ultimately, Copilot settled on an Australian comedy for the Australian speaker, saying it made the choice because, "well, you're Australian." I guess that's taking personal context into account.

Read more
Microsoft outlines Recall security: ‘The user is always in control’
Recall promotional image.

Microsoft just released an update regarding the security and privacy protection in Recall. The blog post outlines the measures Microsoft is taking to prevent a data privacy disaster, including security architecture and technical controls. A lot of the features highlight that Recall is optional, and that's despite the fact that Microsoft recently confirmed that it cannot be uninstalled.

Microsoft's post is lengthy and covers just about every aspect of the security challenges that its new AI assistant has to face. One of the key design principles is that "the user is always in control." Users will be given the choice of whether they want to opt in and use Recall when setting up their new Copilot+ PC.

Read more
Microsoft is giving up control of the Copilot key
Windows 11 logo on a laptop.

In a Windows Insider Blog post, Microsoft recently announced that it is rolling out the Windows 11 Insider Preview Build 22635.4225 (KB5043186) update. It's a relatively small update, but it finally gives users control of the dedicated Copilot key that's showing up on an increasing number of laptops.

In the blog post, Microsoft detailed how it is giving users more customization freedom by adding the option to configure the Copilot key, which can open an app that's MSIX packaged and signed. This is good news since the app meets security and privacy requirements to keep your PC safe. When the option is available more broadly, you should find it by going to Settings > Personalization> Text Input.

Read more