Future Tech

What Is The Turing Test And Will It Ever Be Beaten?

Joel Lee 27-06-2014

Is it possible for artificial intelligence to match human intelligence? It’s a tricky question that involves philosophy, psychology, computer science, and every topic in between. Whenever there’s talk about human-level machine intelligence, the Turing Test is never too far behind.


Earlier this month, Internet journalists exploded in a frenzy of excitement when a London-based computer program, named Eugene Goostman, seemingly passed the Turing Test Smart TV Hack, Popcorn Time VPN, Turing Test Chatbot, CIA Tweets [Tech News Digest] Smart TV flaws, a Popcorn Time VPN, the chatbot that beat Alan Turing, the CIA joins Twitter, the first Vine from space, a Street View of the World Cup, and Microsoft's vision of the present... Read More . But what does that mean? Why are people so excited over it? And is it as noteworthy as it might first appear?

The Turing Test: What Is It?


Despite its name, the Turing Test is not a true test – at least, not in the common sense of the word. It’s actually more of a thought experiment that was put forth by Alan Turing, a highly influential mathematician (and one of the most famous geeks 10 Famous Geeks Who Changed The World (Not Who You Think) If I have seen further it is by standing on ye shoulders of Giants. So, said the genius called Isaac Newton. What was true of one of the most brilliant minds of history should be... Read More ) who formalized many of the concepts that led to the birth of computer science.

The Turing Test is a set of guidelines that are meant to determine whether or not a machine is indistinguishable from a human. It tries to answer the question, “Can machines think?” We don’t know the answer yet, but Turing believed it was possible.

The standard interpretation of the Turing Test is a kind of game:

  • You are interrogating two people.
  • Person A is a machine. Person B is a human.
  • You can only communicate with them using text.
  • By asking questions, determine which one is machine and which one is human.

At this time, the standard game length for the test is five minutes and the conventional criteria for passing the test requires the machine to fool at least 30% of all human interrogators. Turing predicted that any machine to do that could be “smart” enough to be labeled as a “thinking machine.”

Potential Drawbacks of the Turing Test


There are a number of problems with the Turing Test, however, and many arguments have popped up over the years regarding the design of the test and whether it truly assesses the thinking capacity of artificial intelligence.

The most obvious issue is the arbitrary nature of the testing criteria. Why is there a five-minute limit and why is the fooling rate of interrogators set at 30%? Why not ten minutes and 50%?


The truth is, those numbers were derived from Turing’s prediction about the future state of artificial intelligence Giovanni Idili of OpenWorm: Brains, Worms, and Artificial Intelligence Simulating a human brain is a ways off, but an open-source project is taking vital first steps, by simulating the neurology and physiology of one of the simplest animals known to science.   Read More . He never meant for them to be explicit thresholds. However, for now, those numbers are good enough as a target to reach.

Another major problem: a machine being indistinguishable from a human does not necessarily indicate intelligence. In other words, does the Turing Test actually test a machine’s ability to think for itself OR a machine’s ability to imitate human behavior?

It’s a subtle difference with huge implications. After all, a chatbot with enough lines of code could conceivably imitate human conversation without ever being truly intelligent. This brings up a subsequent question. Is external behavior enough to indicate internal thoughts?

The last major drawback to note is the lack of a control group. By definition, the Turing Test results are based on a group of interrogators, but not every interrogator in the group is equal. Though Turing does specify that the criteria are only relevant for “average interrogators,” it’s still unclear what “average” means.


Can The Turing Test Be Passed?


Let’s return to the earlier-mentioned Eugene Goostman program that supposedly passed the Turing Test. Does this now mean we can create human-like robots that are sentient and self-aware? Not quite.

One of the main criticisms against Eugene Goostman was the deceptive lowering of Turing Test criteria. The developers claimed the computer to be a 13-year-old boy who does not natively speak English and lives far enough away from modern society to be ignorant of topics such as geography, pop culture, etc.

In other words, they cheated. By framing Eugene Goostman in this context, interrogators did not have to hold the machine’s responses to a normal standard. After all, many modern chatbots are able to hold similar conversations. The difference with Eugene Goostman is that the narrative context surrounding the machine allowed the hiccups in conversation to be more believable.


So maybe Eugene Goostman didn’t properly pass the Turing Test. How about in the future? When will we see a machine pass it? Is it even possible?

Perhaps the better question is whether the Turing Test is still a valid measure of artificial intelligence. Many believe that the Test only encourages human imitation rather than true thinking intelligence. In fact, other AI tests have been designed 7 Amazing Websites To See The Latest In Artificial Intelligence Programming Artificial Intelligence is not yet HAL from the 2001: The Space Odyssey…but we are getting awfully close. Sure enough, one day it could be as similar to the sci-fi potboilers being churned out by Hollywood.... Read More in recent years that are more sophisticated and specific.

The Turing Test might be iconic, but maybe it’s time that we shelve it and move on.

Image Credits: android head Via Shutterstock, Turing Captcha Via Shutterstock, AI Conversation Via Shutterstock, Artificial Mind Via Shutterstock

Affiliate Disclosure: By buying the products we recommend, you help keep the site alive. Read more.

Whatsapp Pinterest

Leave a Reply

Your email address will not be published. Required fields are marked *

  1. Ego Ostman
    July 1, 2014 at 12:23 am

    Hey you commentators sure are wide awake today. Please to meet you. Let's Facebook sometime. I speak Swahili.

  2. dragonmouth
    June 27, 2014 at 11:20 pm

    OTOH, there many humans who would fail the Turing Test.

  3. Guy M
    June 27, 2014 at 9:00 pm

    I remember watching Bletchley Circle and explaining the Turing Test to my wife. I had the thought at the time that all one had to do was create a program that represented a person with limited and predictable responses. I even said a 12-year old boy would be ideal because they never really answer questions with much more than one word and find silly innuendo in everything.

    • Joel L
      June 30, 2014 at 4:09 am

      Haha, funny stuff. If you went through with it, maybe it would've been you to have set the blogosphere ablaze. You'd be famous!