A Notation for Markov Decision Processes

This addresses a clarity issue for researchers in reinforcement learning, but it is incremental as it focuses on notation rather than algorithmic or theoretical advances.

The paper tackles the problem of inconsistent notation in Markov decision processes by proposing a standardized notation, but does not report any experimental results or concrete numbers.