Editorial illustration for OpenAI contract workers review ChatGPT chats; users can disable default setting
OpenAI Contract Workers Review ChatGPT Chats
Hundreds of contract workers are reading real ChatGPT conversations as part of OpenAI's effort to fine-tune the chatbot's behavior, according to a 404 Media investigation based on leaked internal documents and interviews with sources familiar with the work. These reviewers score ChatGPT's responses on a scale of one to seven, flagging things like excessive flattery or responses that come across as too human. The workers are recruited through a company called Crossing Hurdles, which markets itself as "connecting skilled professionals with the future of AI work," and paid through Mercor, an AI training firm. One North America-based reviewer told 404 Media they make more than $50 an hour for the work.
The prompts they review are anonymized, but that doesn't mean they're scrubbed of sensitive information. Some of the conversations 404 Media examined show users asking ChatGPT directly to keep what they're discussing private, seemingly unaware that a human being might end up reading it anyway. OpenAI does run a privacy filter over these chats, but the company itself acknowledges the filter isn't foolproof. That gap between what users assume and what actually happens is where the story starts.
OpenAI employs hundreds of contract workers who read real ChatGPT user conversations to improve the chatbot's responses, according to a 404 Media investigation.
Why this matters
For anyone building on top of ChatGPT or feeding it business data, this is a reminder that "AI training" often means actual people, contracted and paid to skim, reading your prompts and scoring them one to seven. That's not a criticism of OpenAI's methodology; human review is how these models get less sycophantic and more useful. But the default setting matters.
"Improve the model for everyone" is on unless a user switches it off, which means the people least likely to know about data review, casual users, small business owners pasting client details into a chat window, are the ones most exposed. Developers integrating ChatGPT into products should be explicit with their own users about this, not assume OpenAI's defaults do the explaining. Temporary chat mode is the closer analogue to a private session, but it's still opt-in, still buried in a menu.
If you're handling anything sensitive through ChatGPT, the safe assumption is that a contractor might read it unless you've actively said otherwise.
Common Questions Answered
How many contract workers does OpenAI employ to review ChatGPT conversations?
According to a 404 Media investigation, OpenAI employs hundreds of contract workers who read real ChatGPT user conversations as part of their effort to fine-tune the chatbot's behavior. These workers are recruited through a company called Crossing Hurdles and score ChatGPT responses on a scale of one to seven.
What specific issues do ChatGPT reviewers flag when scoring responses?
Contract workers reviewing ChatGPT conversations flag issues such as excessive flattery and responses that come across as too human. This scoring process helps OpenAI identify and reduce sycophantic behavior in the chatbot's outputs.
Can ChatGPT users disable the default setting that allows their conversations to be reviewed?
Yes, users can disable the default setting that allows their conversations to be reviewed by contract workers. However, the article notes that 'Improve the model for everyone' is enabled by default, meaning users must actively switch it off to prevent their conversations from being reviewed.
Why does OpenAI use human reviewers to evaluate ChatGPT conversations?
Human review is essential for making ChatGPT less sycophantic and more useful by identifying problematic response patterns. The contract workers' scoring and feedback directly contribute to improving the chatbot's behavior and overall quality for all users.
What should users know about feeding business data into ChatGPT given this review process?
Users building on top of ChatGPT or feeding it business data should be aware that 'AI training' often involves actual contract workers reading their prompts and scoring them. This means sensitive business information may be reviewed by human contractors unless users explicitly disable the default data improvement setting.
Further Reading
- OpenAI's 'Project Lily' pays humans to read ChatGPT prompts - AI Weekly
- OpenAI hires contractors to review ChatGPT user chats - Crypto Briefing
- Hundreds of contractors are reportedly reading real ChatGPT conversations - The Next Web
- Humans may be reading your ChatGPT prompts — here’s how to stop it - Tom's Guide
- Data Controls FAQ - OpenAI Help Center