Artificial intelligence can be evaluated on constrained and well-defined problems that allow comparison with human performance. Such tests have been termed subject matter expert Turing tests. Smaller problems provide more achievable goals and there are an ever-increasing number of positive results.
Performance evaluation
The broad classes of outcome for an AI test are:
- optimal: it is not possible to perform better
- strong super-human: performs better than all humans
- super-human: performs better than most humans
- sub-human: performs worse than most humans
Optimal
Super-human
- Backgammon: strong super-human
- Bridge: nearing strong super-human
- Chess: nearing strong super-human
- Reversi: strong super-human
- Scrabble: strong super-human
No comments:
Post a Comment