ITLGFeb 14, 2024

DeepPolar: Inventing Nonlinear Large-Kernel Polar Codes via Deep Learning

arXiv:2402.08864v214 citationsh-index: 55ICML
Originality Incremental advance
AI Analysis

This work addresses the challenge of sporadic progress in coding theory by automating code invention, though it is incremental as it builds on Polar codes with neural enhancements.

The authors tackled the problem of automating the design of channel codes for short-to-medium block lengths by introducing DeepPolar codes, a nonlinear generalization of Polar codes with larger kernels parameterized by neural networks, resulting in enhanced reliability compared to existing neural and conventional Polar codes.

Progress in designing channel codes has been driven by human ingenuity and, fittingly, has been sporadic. Polar codes, developed on the foundation of Arikan's polarization kernel, represent the latest breakthrough in coding theory and have emerged as the state-of-the-art error-correction code for short-to-medium block length regimes. In an effort to automate the invention of good channel codes, especially in this regime, we explore a novel, non-linear generalization of Polar codes, which we call DeepPolar codes. DeepPolar codes extend the conventional Polar coding framework by utilizing a larger kernel size and parameterizing these kernels and matched decoders through neural networks. Our results demonstrate that these data-driven codes effectively leverage the benefits of a larger kernel size, resulting in enhanced reliability when compared to both existing neural codes and conventional Polar codes.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes