CVIVMar 16, 2020

G-LBM:Generative Low-dimensional Background Model Estimation from Video Sequences

arXiv:2003.07335v211 citations
AI Analysis

This addresses background estimation in videos for computer vision applications, but it is incremental as it builds on existing low-dimensional manifold learning with probabilistic enhancements.

The paper tackles the problem of estimating background models from video sequences by proposing G-LBM, a generative low-dimensional model that handles noise and outliers, achieving performance comparable to state-of-the-art methods on datasets like SBMnet-2016 and BMC2012.

In this paper, we propose a computationally tractable and theoretically supported non-linear low-dimensional generative model to represent real-world data in the presence of noise and sparse outliers. The non-linear low-dimensional manifold discovery of data is done through describing a joint distribution over observations, and their low-dimensional representations (i.e. manifold coordinates). Our model, called generative low-dimensional background model (G-LBM) admits variational operations on the distribution of the manifold coordinates and simultaneously generates a low-rank structure of the latent manifold given the data. Therefore, our probabilistic model contains the intuition of the non-probabilistic low-dimensional manifold learning. G-LBM selects the intrinsic dimensionality of the underling manifold of the observations, and its probabilistic nature models the noise in the observation data. G-LBM has direct application in the background scenes model estimation from video sequences and we have evaluated its performance on SBMnet-2016 and BMC2012 datasets, where it achieved a performance higher or comparable to other state-of-the-art methods while being agnostic to the background scenes in videos. Besides, in challenges such as camera jitter and background motion, G-LBM is able to robustly estimate the background by effectively modeling the uncertainties in video observations in these scenarios.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes