Electric Currents for Discrete Data Generation
This addresses data generation in discrete settings, but it appears incremental as it applies an existing electrical engineering concept to a known bottleneck in machine learning.
The paper tackles the problem of generating discrete data by proposing ECD^2G, a method that uses electric current analogies to transfer probability mass between distributions, with proof-of-concept experiments demonstrating its feasibility.
We propose $\textbf{E}$lectric $\textbf{C}$urrent $\textbf{D}$iscrete $\textbf{D}$ata $\textbf{G}$eneration (ECD$^{2}$G), a pioneering method for data generation in discrete settings that is grounded in electrical engineering theory. Our approach draws an analogy between electric current flow in a circuit and the transfer of probability mass between data distributions. We interpret samples from the source distribution as current input nodes of a circuit and samples from the target distribution as current output nodes. A neural network is then used to learn the electric currents to represent the probability flow in the circuit. To map the source distribution to the target, we sample from the source and transport these samples along the circuit pathways according to the learned currents. This process provably guarantees transfer between data distributions. We present proof-of-concept experiments to illustrate our ECD$^{2}$G method.