Skip to main content

Microsoft may have ignored warnings about Bing Chat’s unhinged responses

Microsoft’s Bing Chat is in a much better place than it was when it released in February, but it’s hard to overlook the issues the GPT-4-powered chatbot had when it released. It told us it wanted to be human, after all, and often broke down into unhinged responses. And according to a new report, Microsoft was warned about these types of responses and decided to release Bing Chat anyway.

According to the Wall Street Journal, OpenAI, the company behind ChatGPT and the GPT-4 model powering Bing Chat, warned Microsoft about integrating its early AI model into Bing Chat. Specifically, OpenAI flagged “inaccurate or bizarre” responses, which Microsoft seems to have ignored.

Bing Chat saying it wants to be human.
Jacob Roach / Digital Trends

The report describes a unique tension between OpenAI and Microsoft, which have entered into somewhat of an open partnership over the last few years. OpenAI’s models are built on Microsoft hardware (including thousands of Nvidia GPUs), and Microsoft leverages the company’s tech across Bing, Microsoft Office, and Windows itself. In early 2023, Microsoft even invested $10 billion in OpenAI, coming just short of purchasing the company outright.

Recommended Videos

Despite this, the report alleges that Microsoft employees have issues with restricted access to OpenAI’s models, and that they were worried about ChatGPT overshadowing the AI-inundated Bing Chat. To make matters worse, the Wall Street Journal reports that OpenAI and Microsoft both sell OpenAI’s technology, leading to situations where vendors are dealing with contacts at both companies.

The biggest issue, according to the report, is that Microsoft and OpenAI are trying to make money with a similar product. With Microsoft backing, but not controlling OpenAI, the ChatGPT developer is free to make partnerships with other companies, some of which can directly compete with Microsoft’s products.

Based on what we’ve seen, OpenAI’s reported warnings held water. Shortly after releasing Bing Chat, Microsoft limited the number of responses users could receive in a single session. And since then, Microsoft has slowly lifted the restriction as the GPT-4 model in Bing Chat is refined. Reports suggest some Microsoft employees often reference “Sydney,” poking fun at the early days of Bing Chat (code-named Sydney) and its responses.

Jacob Roach
Lead Reporter, PC Hardware
Jacob Roach is the lead reporter for PC hardware at Digital Trends. In addition to covering the latest PC components, from…
ChatGPT’s Advanced Voice Mode just came to PCs and Macs
ChatGPT Advanced Voice Mode Desktop app

You can now speak directly with ChatGPT right on your PC or Mac, thanks to a new Advanced Voice Mode integration, OpenAI announced on Wednesday. "Big day for desktops," the company declared in an X (formerly Twitter) post.

Advanced Voice Mode (AVM) runs atop the GPT-4o model, OpenAI's current state of the art, and enables the user to speak to the chatbot without the need for text prompts.

Read more
Your ChatGPT conversation history is now searchable
ChatGPT chat search

OpenAI debuted a new way to more efficiently manage your growing ChatGPT chat history on Tuesday: a search function for the web app. With it, you'll be able to quickly surface previous references and chats to cite within your current ChatGPT conversation.

"We’re starting to roll out the ability to search through your chat history on ChatGPT web," the company announced via a post on X (formerly Twitter). "Now you can quickly & easily bring up a chat to reference, or pick up a chat where you left off."

Read more
GPT-5: everything we know so far about OpenAI’s next frontier model
A MacBook Pro on a desk with ChatGPT's website showing on its display.

There's perhaps no product more hotly anticipated in tech right now than GPT-5. Rumors about it have been circulating ever since the release of GPT-4, OpenAI's groundbreaking foundational model that's been the basis of everything the company has launched over the past year, such as GPT-4o, Advanced Voice Mode, and the OpenAI o1-preview.

Those are all interesting in their own right, but a true successor to GPT-4 is still yet to come. Now that it's been over a year a half since GPT-4's release, buzz around a next-gen model has never been stronger.
When will GPT-5 be released?
OpenAI has continued a rapid rate of progress on its LLMs. GPT-4 debuted on March 14, 2023, which came just four months after GPT-3.5 launched alongside ChatGPT. OpenAI has yet to set a specific release date for GPT-5, though rumors have circulated online that the new model could arrive as soon as late 2024.

Read more