Aniruddha Joshi

Aniruddha Joshi, Niklas Lauffer, Sanjit Seshia

Real-world decision-making often requires balancing multiple conflicting objectives, a challenge that standard Reinforcement Learning (RL) frequently addresses by aggregating rewards into a single scalar signal. While effective for simple tasks, this approach often fails to capture the full spectrum of optimal trade-offs, known as the Pareto frontier. In this paper, we introduce a novel preference-conditioned Bellman operator, motivated from the Chebyshev scalarization, designed to compute deterministic Pareto-optimal policies for Multi-Objective Markov Decision Processes (MOMDPs). We prove that this operator satisfies an enveloping property, where the estimated value functions upper-bound the true Pareto frontier, and demonstrate that it monotonically converges to a coverage set of this frontier. Furthermore, we also show how to extract deterministic policies from these converged Q-estimates. This ensures the agent can recover a policy for any given preference, capturing the entire Pareto-optimal frontier while guaranteeing each synthesized policy remains approximately Pareto-optimal. Experimental results validate that our algorithm successfully recovers complex trade-offs, providing a solution for deterministic Pareto-optimal policy synthesis.

Anupam Saraph, Lalit Kathpalia, Anab Kidwai et al.

A legally valid identification document allows impartial arbitration of the identification of individuals. It protects individuals from a violation of their dignity, justice, liberty and equality. It protects the nation from a destruction of its republic, democratic, sovereign status. In order to test the ability of an identification document to establish impartial identification of individuals, it must be evaluated for its ability to establish identity, undertake identification and build confidence to impartial, reliable and valid identification. The processes of issuing, using and validating identification documents alter the ability of the document to establish identity, undertake identification and build confidence to impartial and valid identification. These processes alter the ability of the document to serve as proof of identity, proof of address, proof of being a resident, or even the proof of existence of a person. We examine the ability of the UID number to serve as an identification document with the ability to impartially arbitrate the identification of individuals and serve as proof of identity, address, and demonstrate existence of a person. We evaluate the implications of the continued use UID system on our ability to undertake legally valid identification ensure integrity of the identity and address databases across the world.