Captionbot is another AI from Microsoft, and it's not doing so hot either

By Lulu Chang April 17, 2016

microsoft captionbot screen shot 2016 04 17 at 3 26 32 pm — Image used with permission by copyright holder

You’d think that after its last AI chat bot fiasco, Microsoft would’ve learned its lesson — or at least waited a bit longer before introducing another monster to the world. Luckily for us, history has a tendency to repeat itself, and the company’s latest creation is a sometimes hilarious entity known as Captionbot. The premise is simple — recognize the contents of a photo, and come up with an appropriate caption. But alas, while the concept may be straightforward, the execution isn’t always so cut and dry. And social media has been quick to point out all of Captionbot’s faux pas.

In one case, the artificial intelligence system thought that Michelle Obama was a cellphone. And there’s also the time when the dress that launched a thousand debates (you know, the blue and black or white and gold dress) confuses the bot as much as it confused all of us. The system thought the dress was a cat wearing a tie (or in some cases, a suitcase).

Recommended Videos

The bot also looks to be attempting to rewrite history, absolutely refusing to identify Hitler as the infamous Nazi leader he was. When CNNMoney fed the AI photos of the dictator and swastika, more often than not, Captionbot responded, “I really can’t describe the picture” alongside a confused emoji. Strangely enough, it could identify other famous Nazis like Joseph Mengele and Joseph Goebbels.

Osama bin Laden is another infamous face Captionbot can’t recognize, although it is unclear whether this is due to restrictions Microsoft put in place to prevent Tay-esque disasters from taking place. “We have implemented some basic filtering in an effort to prevent some abuse scenarios,” a spokesperson noted of the limitations.

You can upload your own photos for Captionbot to analyze, but proceed at your own risk. Sometimes, this bot gets it very, very wrong. Just check out a couple of our favorite examples below.

#captionbot thinks Michelle Obama is a cell phone. pic.twitter.com/FtC6tP6Ben

— David Sim (@davidsim) April 14, 2016

Captionbot.ai 's view of my avatar: pic.twitter.com/OUctTxhx0p

— Richard Gadsden (@po8crg) April 14, 2016

https://twitter.com/ralphharrington/status/720544025649025024?ref_src=twsrc%5Etfw

Topics

Former Digital Trends Contributor

Fascinated by the effects of technology on human interaction, Lulu believes that if her parents can use your new app…

Computing

‘Massive copyright violation’ threatens one of the world’s hottest AI apps

Perplexity on Nothing Phone 2a.

Perplexity bills itself as an AI-empowered direct alternative to Google.

Whereas Google operates a search engine, Perplexity aims to operate an AI answer engine that allows users to "ask any question." It then "searches the internet to give you an accessible, conversational, and verifiable answer," per the company FAQ. If that sounds like an AI-enhanced version of search, you'd be right.

Computing

AI-controlled robots can be jailbroken, and the results could be disastrous

The Figure 02 robot looking at its own hand

Researchers at Penn Engineering have reportedly uncovered previously unidentified security vulnerabilities in a number of AI-governed robotic platforms.

"Our work shows that, at this moment, large language models are just not safe enough when integrated with the physical world," George Pappas, UPS Foundation Professor of Transportation in Electrical and Systems Engineering, said in a statement.

Computing

Microsoft Copilot: how to use this powerful AI assistant

Man using Windows Copilot PC to work

In the rapidly evolving landscape of artificial intelligence, Microsoft's Copilot AI assistant is a powerful tool designed to streamline and enhance your professional productivity. Whether you're new to AI or a seasoned pro, this guide will help you through the essentials of Copilot, from understanding what it is and how to sign up, to mastering the art of effective prompts and creating stunning images.

Additionally, you'll learn how to manage your Copilot account to ensure a seamless and efficient user experience. Dive in to unlock the full potential of Microsoft's Copilot and transform the way you work.
What is Microsoft Copilot?
Copilot is Microsoft's flagship AI assistant, an advanced large language model. It's available on the web, through iOS, and Android mobile apps as well as capable of integrating with apps across the company's 365 app suite, including Word, Excel, PowerPoint, and Outlook. The AI launched in February 2023 as a replacement for the retired Cortana, Microsoft's previous digital assistant. It was initially branded as Bing Chat and offered as a built-in feature for Bing and the Edge browser. It was officially rebranded as Copilot in September 2023 and integrated into Windows 11 through a patch in December of that same year.