ITAIMay 21, 2022

Interpreting Neural Min-Sum Decoders

arXiv:2205.10684v29 citationsh-index: 18
Originality Incremental advance
AI Analysis

This work provides insights for researchers in coding theory and communications by interpreting learned weights and extending analysis to non-AWGN channels, though it is incremental as it builds on existing neural decoder methods.

The paper tackled the lack of interpretation and analysis for neural min-sum decoders in non-AWGN channels, showing that learned weights are influenced by short cycles in the code and achieve higher reliability than analytically optimized weights, with significant gains in complex channels as parameters increase.

In decoding linear block codes, it was shown that noticeable reliability gains can be achieved by introducing learnable parameters to the Belief Propagation (BP) decoder. Despite the success of these methods, there are two key open problems. The first is the lack of interpretation of the learned weights, and the other is the lack of analysis for non-AWGN channels. In this work, we aim to bridge this gap by providing insights into the weights learned and their connection to the structure of the underlying code. We show that the weights are heavily influenced by the distribution of short cycles in the code. We next look at the performance of these decoders in non-AWGN channels, both synthetic and over-the-air channels, and study the complexity vs. performance trade-offs, demonstrating that increasing the number of parameters helps significantly in complex channels. Finally, we show that the decoders with learned weights achieve higher reliability than those with weights optimized analytically under the Gaussian approximation.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes