Skip to main content

Digital Trends may earn a commission when you buy through links on our site. Why trust us?

OpenAI’s new tool can spot fake AI images, but there’s a catch

Images generated by artificial intelligence (AI) have been causing plenty of consternation in recent months, with people understandably worried that they could be used to spread misinformation and deceive the public. Now, ChatGPT maker OpenAI is apparently working on a tool that can detect AI-generated images with 99% accuracy.

According to Bloomberg, OpenAI’s tool is designed to root out user-made pictures created by its own Dall-E 3 image generator. Speaking at the Wall Street Journal’s Tech Live event, Mira Murati, chief technology officer at OpenAI, claimed the tool is “99% reliable.” While the tech is being tested internally, there’s no release date yet.

OpenAI Dall-E 3 alpha test version image.
MattVidPro AI

If it is as accurate as OpenAI claims, it may be able to offer the public the knowledge that the images they are seeing are either genuine or AI-generated. Still, OpenAI did not appear to reveal how this tool will alert people to AI images, whether by using a watermark, a text warning, or something else.

It’s worth noting that the tool is only designed to detect Dall-E images, and it may not be able to spot fakes generated by rival services like Midjourney, Stable Diffusion, and Adobe Firefly. That might limit its usefulness in the grand scheme of things, but anything that can highlight fake images could have a positive impact.

Continuing development

Cartoon characters hooked to their phone.
Dall-E / OpenAI

OpenAI has launched tools in the past that were designed to spot content put together by its own chatbots and generators. Earlier in 2023 the company released a tool that it claimed could detect text made by ChatGPT, but it was withdrawn just a few months later after OpenAI admitted it was highly inaccurate.

As well as the new image-detection tool, OpenAI also discussed the company’s attempts to cut down on ChatGPT’s tendency to “hallucinate,” or spout nonsense and made-up information. “We’ve made a ton of progress on the hallucination issue with GPT-4, but we’re not where we need to be,” Murati said, suggesting that work on GPT-5 — the follow-up to the GPT-4 model that underpins ChatGPT — is well underway.

In March 2023, a slate of tech leaders signed an open letter pleading with OpenAI to pause work on anything more powerful than GPT-4, or risk “profound risks to society and humanity.” It seems that the request has fallen on deaf ears.

Whether OpenAI’s new tool will be any more effective than its last effort, which was canceled due to its unreliability, remains to be seen. What’s certain is that development work continues at a fast pace, despite the obvious risks.

Alex Blake
In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he…
The ChatGPT app for Mac just got this helpful new feature
The OpenAI desktop app showing the text input window

OpenAI's recently released Mac desktop app is getting a bit easier to use. The company has announced that the program will now offer side-by-side access to the ChatGPT text prompt when you press Option + Space.

The desktop version offers nearly identical functionality to the web-based iteration. Users can chat directly with the AI, query the system using natural language prompts in either text or voice, search through previous conversations, and upload documents and images for analysis. You can even take screenshots of either the entire screen or just a single window, for upload.

Read more
ChatGPT Advanced Voice mode: release date, compatibility, and more
Nothing Phone 2a and ChatGPT voice mode.

Advanced Voice Mode is a new feature for ChatGPT that enables users to hold real-time, humanlike conversations with the AI chatbot without the need for a text-based prompt window or back-and-forth audio. It was released in late July to select Plus subscribers after being first demoed at OpenAI's Spring Update event.

According to the company, the feature “offers more natural, real-time conversations, allows you to interrupt at any time, and senses and responds to your emotions.” It can even take breath breaks and simulate human laughter during conversation. The best part is that access is coming soon, if you don't have it already.
When will I get Advanced Mode?
Introducing GPT-4o

Read more
An accurate ChatGPT watermarking tool may exist, but OpenAI won’t release it
chatGPT on a phone on an encyclopedia

ChatGPT plagiarists beware, as OpenAI has developed a tool that is capable of detecting GPT-4's writing output with reportedly 99.99% accuracy. However, the company has spent more than a year waffling over whether or not to actually release it to the public.

The company is reportedly taking a “deliberate approach” due to “the complexities involved and its likely impact on the broader ecosystem beyond OpenAI,” per TechCrunch. "The text watermarking method we’re developing is technically promising, but has important risks we’re weighing while we research alternatives, including susceptibility to circumvention by bad actors and the potential to disproportionately impact groups like non-English speakers,” an OpenAI spokesperson said.

Read more