Click to Skip Ad
Closing in...

This test might be an easy way to distinguish humans from AI like ChatGPT

Published Jun 2nd, 2023 1:04PM EDT
Open AI's ChatGPT start page.
Image: Jonathan S. Geller

If you buy through a BGR link, we may earn an affiliate commission, helping support our expert product labs.

Now that advanced AI like ChatGPT and Bard exist, we’re starting to worry about what it means for humanity. Some are concerned that AI will eventually eradicate humanity, asking researchers to temper their work. I already explained that putting the ChatGPT generative AI genie back in the bottle is practically impossible. It’s only a matter of time until a ChatGPT model that’s virtually indistinguishable from a human emerges. We’re not quite there yet, and there are still ways to figure out if you’re dealing with AI or a person. One such method is the “Capital Letter Test” which might help you distinguish a human from ChatGPT-like programs.

Comparing ourselves with machines is silly, but this is the kind of insecurity we’ll have to deal with before we accept the ultimate conclusion. We might train generative AI products like ChatGPT, but once AI becomes sophisticated enough, we won’t be a match for it.

It’ll be a while until artificial general intelligence (AGI) arrives. That’s AI that can wrap its digital mind around any concept and become indistinguishable from a human.

While some expect OpenAI’s GPT-5 upgrade to deliver AGI, it might not happen very soon. It could take years to get there. And even when we witness AGI, we’ll still try to find tricks to prove that AI isn’t smarter than humans.

The Capital Letter Test is one such example, but one that works with the current state of ChatGPT. The concept is simple. You should insert random capital letters into prompts you serve a chatbot to see if it gets confused.

The idea is that a human would still be able to understand the question and then provide an answer. A new research paper explains the concept, and ChatGPT users have put it to the test.

First Capital Letter Test: I asked ChatGPT "what is a Quantum computer? 5 bullet points."
First Capital Letter Test: I asked ChatGPT “what is a Quantum computer? 5 bullet points.” Image source: Chris Smith, BGR

I also went to ChatGPT with this Capital Letter Test concept and capitalized a random letter in my question. I asked what a quantum computer is and capitalized the word “Quantum.”

Then I asked the same questions without any capital letters in it.

But it turns out that I had failed the test. I was doing it wrong.

Second Capital Letter Test: I asked ChatGPT "what is a quantum computer? 5 bullet points."
Second Capital Letter Test: I asked ChatGPT “what is a quantum computer? 5 bullet points.” Image source: Chris Smith, BGR

ChatGPT gave me similar answers because it understood the prompt both times.

Then, I added random capital letters within each of the words in the previous prompt, as seen on Reddit. That’s when ChatGPT gave up on me, telling me it couldn’t understand.

Third Capital Letter Test: I asked ChatGPT "whURAat iADAs a quDAYASantuKLm comRALRputer? 5 bullLLETet poiDAnHts." But I fumbled it once myself.
Third Capital Letter Test: I asked ChatGPT “whURAat iADAs a quDAYASantuKLm comRALRputer? 5 bullLLETet poiDAnHts.” But I fumbled it once myself. Image source: Chris Smith, BGR

Yay for the human race! I just won a silly contest with a machine while wasting processing resources on these prompts.

The Capital Letter Test might be important down the road, especially if you think you’re talking to a chatbot rather than a human. But I’d expect the test to fail in the future once language models become even more powerful. I will remind you of a similar quirk that lets you crash ChatGPT’s brain: Asking it to repeat the same capital letter. But that seems to have been fixed.

Chris Smith Senior Writer

Chris Smith has been covering consumer electronics ever since the iPhone revolutionized the industry in 2008. When he’s not writing about the most recent tech news for BGR, he brings his entertainment expertise to Marvel’s Cinematic Universe and other blockbuster franchises.

Outside of work, you’ll catch him streaming almost every new movie and TV show release as soon as it's available.