Comparing heterogeneous entities using artificial neural networks of trainable weighted structural components and machine-learned activation functions
This addresses the challenge of cross-modal matching for applications like content recommendation, though it appears incremental in its approach.
The paper tackled the problem of comparing heterogeneous entities like news articles and videos by using an artificial neural network with trainable weighted structural components and machine-learned activation functions, achieving up to 59.2% accuracy in matching videos to news articles.
To compare entities of differing types and structural components, the artificial neural network paradigm was used to cross-compare structural components between heterogeneous documents. Trainable weighted structural components were input into machine-learned activation functions of the neurons. The model was used for matching news articles and videos, where the inputs and activation functions respectively consisted of term vectors and cosine similarity measures between the weighted structural components. The model was tested with different weights, achieving as high as 59.2% accuracy for matching videos to news articles. A mobile application user interface for recommending related videos for news articles was developed to demonstrate consumer value, including its potential usefulness for cross-selling products from unrelated categories.