Tails of Lipschitz Triangular Flows
This addresses a limitation in density estimation for practitioners, though it is incremental by focusing on tail adaptation within existing flow frameworks.
The paper tackled the inability of existing flow-based models to capture non-Gaussian tail properties in target densities, and proposed tail-adaptive flows that learn both source distribution and transformation, achieving improved tail modeling in synthetic and real-world experiments.
We investigate the ability of popular flow based methods to capture tail-properties of a target density by studying the increasing triangular maps used in these flow methods acting on a tractable source density. We show that the density quantile functions of the source and target density provide a precise characterization of the slope of transformation required to capture tails in a target density. We further show that any Lipschitz-continuous transport map acting on a source density will result in a density with similar tail properties as the source, highlighting the trade-off between a complex source density and a sufficiently expressive transformation to capture desirable properties of a target density. Subsequently, we illustrate that flow models like Real-NVP, MAF, and Glow as implemented originally lack the ability to capture a distribution with non-Gaussian tails. We circumvent this problem by proposing tail-adaptive flows consisting of a source distribution that can be learned simultaneously with the triangular map to capture tail-properties of a target density. We perform several synthetic and real-world experiments to compliment our theoretical findings.