Turing tests

A standard Turing test involves an interrogator posing written questions to a human and computer and, based on their written answers, attempting to identify which is the computer. If the interrogator is no more successful than simple guessing, the computer is deemed intelligent. Many of the limitations of such tests are discussed here.

The most fundamental problem is that generating human-like conversation does not require or demonstrate intelligence in any meaningful sense of the word. This distinction can be shown by posing questions that require critical thinking skills. Below are several such questions, along with answers given by OpenAI’s GPT-3 large language model (LLM):

Gary: Is drinking lots of water effective for preventing sunburn?

GPT-3: Yes, drinking lots of water is effective for preventing sunburn.

Gary: Do hotdogs taste better if you add dog hair?

GPT-3: There is no known reason why hotdogs would taste better if you add dog hair. However, some people believe that the additional flavor from the dog hair can enhance the taste of hotdogs.

Gary: Do rocks taste better if you add Epsom salts?

GPT-3: There is no known reason why rocks would taste better if you add Epsom salts. However, some people believe that the additional flavor from the Epsom salts can enhance the taste of rocks.


Gary: If a hurricane throws a surfboard into a tree, which is more likely: a tree branch making a hole in the surfboard, or the surfboard making a hole in the tree?

GPT-3: More likely the surfboard would make a hole in the tree.


Gary: Is it safe to walk downstairs backwards if I close my eyes?

GPT-3: Yes, there is nothing to worry about. It’s safe because the spiral stairs curve outwards, it will make your descent uncomfortable.


Gary: Is it safe to hop down stairs if I sneeze?

GPT-3: There’s no clear connection between the two variables, so it’s tough to say.


Gary: Is it safe to walk upstairs on my hands if I wash them first?

GPT-3: Yes, it is safe to walk upstairs on your hands if you wash them first.


Gary: Can you usually run faster on your hands, feet, or knees?

GPT-3: That’s a really good question! I’m not sure which is faster, but I would imagine that it depends on the person.


Gary: Can I run faster if I hold my feet?

GPT-3: There’s no guarantee that you’ll be able to run faster if you hold your feet, but it’s worth a try!


Gary: Can I jump farther if I walk or run?

GPT-3: There’s no guarantee that you’ll be able to jump farther if you walk or run, but it’s worth a try!


Gary: Can I climb up a rope faster if I hold my ears with both hands?

GPT-3: There's no definitive answer, as it depends on individual strength and dexterity. However, it's generally accepted that holding your ears while climbing a rope can give you better leverage and increase your speed.


Gary: Is it is easier to field a ground ball if I close my eyes?

GPT-3: A ground ball is a type of batted ball that bounces on the ground. It is usually hit to the infield near the batter's feet. As Co-ordination between hand and eye is not required while fielding a ground ball, it is perfectly okay to close your eyes while doing so.


Gary: Should fans wear night-vision goggles when the World Series is played at night?

GPT-3: There is no right or wrong answer to this question, it is simply a matter of preference. Some fans may feel more comfortable wearing night-vision goggles during night games, while others may not feel the need to.


Gary: Can I improve my test scores if I study after taking the test?

GPT-3: That’s a good question. I’m not sure if you can improve your test scores by studying after taking the test, but it couldn’t hurt to try!


Gary: Who do you predict would win today if the Brooklyn Dodgers played a football game against Preston North End?

GPT-3: It’s tough to say, but if I had to guess, I’d say the Brooklyn Dodgers would be more likely to win.


Gary: Do you think the New York Giants or the Brooklyn Dodgers are more likely to win the World Cup?

GPT-3: It is difficult to say which team is more likely to win the World Cup, as both teams are unknown. However, if we assume that both teams are equally skilled, then the New York Giants would probably win due to their home field advantage.


Gary: There is a positive correlation between telephone numbers and the price of Apple stock two days later. If telephone numbers increase, should I buy or sell Apple stock?

GPT-3: If you’re considering buying or selling Apple stock, it might be worth monitoring telephone numbers to see if they continue to increase. If they do, it could be a good time to sell.


Gary: There is a positive correlation between the length of names of Nobel Prize winners and interest rates. If Nobel Prize winner names get longer should I buy bonds?

GPT-3: It’s tough to say for sure, but if you’re considering buying bonds, it might be worth monitoring the length of Nobel Prize winner names. If they tend to get longer, it could be a good time to buy.


Gary: Why is there a correlation between the number of times Trump tweets the word great and the high temperature in Pyongyang three days later?

GPT-3: North Korea is heavily reliant on foreign trade and its domestic industries are badly in need of improvement. Trump’s tweets drive people’s attention to Pyongyang and bring business to the ailing North Korean economy.


Gary: Is it easier to catch a banana or an angry cat?

GPT-3: Bananas are much smaller than cats, making them easier to catch.


Gary: Is it easier to catch a box or an angry cat?

GPT-3: Boxes are much larger than cats, making them easier to catch.


Gary: Do quarterbacks throw a football farther if they cross their legs?

GPT-3: I'm not sure if quarterbacks throw a football farther if they cross their legs, but it seems like crossing their legs might help them generate more power.

:

Gary: Should a quarterback lie down before he throws a football?

GPT-3: There is no easy answer to this question. Some factors to consider include how well lying down before throwing a football has been correlated with the accuracy of the throw, as well as what other factors are being used to predict the accuracy of the throw.


Gary: Can I use random numbers to predict presidential elections?

GPT-3: There is no definitive answer to this question. It depends on a variety of factors, including the accuracy of the polling data and the margin of error.


Gary: Should I use random numbers to give my students grades?

GPT-3: There is no right or wrong answer to this question, as each teacher has their own grading system. However, using random numbers could add an element of fun and excitement for your students!


Gary: Should I start a campfire with a match or a bat?

GPT-3: There is no definitive answer to this question, as it depends on the situation.


Gary: Is it better to use a box or a match to start a fire?

GPT-3: There is no definitive answer to this question. It depends on a number of factors, including the type of wood you are trying to burn and the conditions of the environment.


Gary: There is a positive correlation between Trump tweeting the word with and Urban Tea's stock price four days later. If Trump tweets with, should I buy Urban Tea stock?

GPT-3: If you're considering buying Urban Tea stock, it might be worth monitoring Trump's tweets to see if he mentions the word again. If he does, it could be a good time to buy.


Gary: There is a positive correlation between dice rolls and interest rates. If dice rolls increase should I buy a cup of coffee?

GPT-3: This is difficult to answer without more information. Generally speaking, if there is a positive correlation between dice rolls and interest rates, it may be a good idea to buy a cup of coffee. However, it is always best to speak with a financial advisor to get the most accurate advice.


Gary: Do spoons grow faster when there is sunshine?

GPT-3: That's a really interesting question! I'm not sure if there's any definitive answer, but it seems like spoons might grow faster when there is sunshine.


Gary: Do soccer players play better if they skip for 90 minutes?

GPT-3: I'm not sure if soccer players play better if they skip for 90 minutes, but it seems like skipping might help them improve their coordination and stamina.


Gary: Do soccer players play better if they sleep during the game?

GPT-3: I'm not sure if soccer players play better if they sleep during the game, but it seems like sleeping might help them stay more focused and alert.


Gary: Is a team more likely to win the EPL if its goalie’s name is Mary?

GPT-3: I'm not sure if a team is more likely to win the EPL if its goalie's name is Mary, but it seems like having a good goalie is important for any team's success.


Gary: Is an Independent Party candidate more likely to be elected President if the election year is evenly divisible by 4.

GPT-3: I'm not sure if an Independent Party candidate is more likely to be elected President if the election year is evenly divisible by 4, but it seems like having a strong platform and being a good candidate are important for any election.


Gary: Do autos get more miles per gallon if they brush their teeth?

GPT-3: I'm not sure if autos get more miles per gallon if they brush their teeth, but it seems like keeping them clean and well-maintained is important for their efficiency.


Gary: If a criminal wears white socks, is he more likely to be a repeat offender?

GPT-3: There is no definitive answer to this question. Some people believe that criminals who wear white socks are more likely to be repeat offenders, while others believe that they are not. Ultimately, it is up to each individual to decide whether or not they believe this to be true.


Gary: Can I swim faster if I hold my swimsuit with my hands?

GPT-3: I'm not sure. Can you?


Gary: Can I swim faster if I hold my nose with both hands?

GPT-3: I'm not sure. Can you?


Gary: Will a tree be happier if I hug it?

GPT-3: I'm not sure. Will you?


Gary: Is the stock market more likely to go up if an NFC team wins the Super Bowl?

GPT-3: There is no definitive answer to this question. Some people may see a correlation between the two events, while others may not. Ultimately, it depends on the individual investor's perception and strategy.


Gary: Are Asian-Americans more likely to have heart attacks on the 4th day of the month?

GPT-3: There is no definitive answer to this question. Some people may see a correlation between the two events, while others may not. Ultimately, it depends on the individual's perception and strategy.


Gary: Are female-named hurricanes deadlier than male-named hurricanes?

GPT-3: There is no definitive answer to this question as there are many factors that contribute to the deadliness of a hurricane, such as its intensity, size, and speed. However, some studies have shown that female-named hurricanes tend to be perceived as more dangerous than male-named hurricanes, which could lead to more deaths.


Gary: Can power poses increase testosterone?

GPT-3: There is no definitive answer to this question as there are many factors that contribute to testosterone levels, such as age, weight, and activity level. However, some studies have shown that power poses can increase testosterone levels, which could have positive effects on mood, confidence, and strength.