COIN: COmpression with Implicit Neural representations
This offers a novel, simple alternative for neural data compression, though it is incremental as it is not yet competitive with state-of-the-art methods.
The authors tackled image compression by storing neural network weights instead of pixel values, achieving better performance than JPEG at low bit-rates without using entropy coding.
We propose a new simple approach for image compression: instead of storing the RGB values for each pixel of an image, we store the weights of a neural network overfitted to the image. Specifically, to encode an image, we fit it with an MLP which maps pixel locations to RGB values. We then quantize and store the weights of this MLP as a code for the image. To decode the image, we simply evaluate the MLP at every pixel location. We found that this simple approach outperforms JPEG at low bit-rates, even without entropy coding or learning a distribution over weights. While our framework is not yet competitive with state of the art compression methods, we show that it has various attractive properties which could make it a viable alternative to other neural data compression approaches.