A Topic Model Approach to Multi-Modal Similarity
This work addresses a problem in multimedia applications, but it appears incremental as it applies an existing method to a new domain.
The authors tackled the challenge of calculating similarities between objects with heterogeneous data modalities by using a multi-modal topic model, and they evaluated their approach on a music dataset.
Calculating similarities between objects defined by many heterogeneous data modalities is an important challenge in many multimedia applications. We use a multi-modal topic model as a basis for defining such a similarity between objects. We propose to compare the resulting similarities from different model realizations using the non-parametric Mantel test. The approach is evaluated on a music dataset.