Rate-distortion Theory with Lower Semi-continuous Distortion on Noncompact Alphabets
Provides foundational existence results for rate-distortion theory on noncompact alphabets, addressing a gap for researchers working on source coding with noncompact reproduction spaces.
The paper establishes conditions for the existence of optimal reconstruction distributions in rate-distortion theory on noncompact alphabets, proving attainability for bounded distortions via one-point compactification and for unbounded coercive distortions via concentration-compactness, with counterexamples showing sharpness.
In this paper, we study rate-distortion theory for general sources with an emphasis on the existence of optimal reconstruction distributions on noncompact alphabets. Classical attainability results typically rely on compactness of the reproduction alphabet together with continuity of the distortion function, which may fail in many noncompact settings. We identify two complementary existence mechanisms under lower semi-continuity on locally compact Polish alphabets. For bounded distortions, we prove that the rate-distortion infimum is attained via the one-point compactification argument. For unbounded coercive distortions, we establish existence via concentration-compactness. We also give several counterexamples showing that our attainability results are close to sharp. Our results provide a unified and transparent existence theorem for rate-distortion problems with lower semi-continuous distortions.