The Meta-Turing Test
This work addresses a foundational issue in AI evaluation for researchers and philosophers, but it is incremental as it builds directly on Turing's original concept.
The authors tackled the problem of asymmetry in the Turing test by proposing a meta-Turing test where both humans and machines judge each other, resulting in a more robust test against deception.
We propose an alternative to the Turing test that removes the inherent asymmetry between humans and machines in Turing's original imitation game. In this new test, both humans and machines judge each other. We argue that this makes the test more robust against simple deceptions. We also propose a small number of refinements to improve further the test. These refinements could be applied also to Turing's original imitation game.