AIJan 1, 2021

A General Counterexample to Any Decision Theory and Some Responses

arXiv:2101.00280v11 citations
Originality Incremental advance
AI Analysis

This paper addresses a foundational problem for researchers in decision theory, questioning the possibility of a universally optimal decision theory.

This paper presents a general argument and schema to construct problem cases for any decision theory, suggesting that no single decision theory can consistently outperform all others. It also explores various responses to this argument, including one that redefines problem equivalence, which could invalidate the initial argument but has implications for comparing existing decision theories.

In this paper I present an argument and a general schema which can be used to construct a problem case for any decision theory, in a way that could be taken to show that one cannot formulate a decision theory that is never outperformed by any other decision theory. I also present and discuss a number of possible responses to this argument. One of these responses raises the question of what it means for two decision problems to be "equivalent" in the relevant sense, and gives an answer to this question which would invalidate the first argument. However, this position would have further consequences for how we compare different decision theories in decision problems already discussed in the literature (including e.g. Newcomb's problem).

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes