Progress in artificial intelligence

Artificial intelligence can be evaluated on constrained and well-defined problems that allow comparison with human performance. Such tests have been termed subject matter expert Turing tests. Smaller problems provide more achievable goals and there are an ever-increasing number of positive results.

Performance evaluation

The broad classes of outcome for an AI test are:

• optimal: it is not possible to perform better
• strong super-human: performs better than all humans
• super-human: performs better than most humans
• sub-human: performs worse than most humans

Optimal

Checkers

Super-human

• Backgammon: strong super-human
• Bridge: nearing strong super-human
• Chess: nearing strong super-human
• Reversi: strong super-human
• Scrabble: strong super-human

Sub-human

Go
Machine translation
• Most everyday tasks performed by humans.