Graph Generation Powered with LLMs for Boosting Multivariate Time-Series Representation Learning
This work addresses the challenge of effective graph generation for MTS data, which is crucial for applications like sensor-based monitoring, by introducing a novel method that reduces biases and enhances GNN performance, though it is incremental in combining LLMs with existing graph generation techniques.
The paper tackles the problem of generating graphs for multivariate time-series (MTS) data to improve representation learning with Graph Neural Networks (GNNs), addressing biases from small datasets by leveraging Large Language Models (LLMs) to incorporate universal knowledge, resulting in superior performance on various MTS tasks.
Sourced from multiple sensors and organized chronologically, Multivariate Time-Series (MTS) data involves crucial spatial-temporal dependencies. To capture these dependencies, Graph Neural Networks (GNNs) have emerged as powerful tools. As explicit graphs are not inherent to MTS data, graph generation becomes a critical first step in adapting GNNs to this domain. However, existing approaches often rely solely on the data itself for MTS graph generation, leaving them vulnerable to biases from small training datasets. This limitation hampers their ability to construct effective graphs, undermining the accurate modeling of underlying dependencies in MTS data and reducing GNN performance in this field. To address this challenge, we propose a novel framework, K-Link, leveraging the extensive universal knowledge encoded in Large Language Models (LLMs) to reduce biases for powered MTS graph generation. To harness the knowledge within LLMs, such as physical principles, we design and extract a \textit{Knowledge-Link graph} that captures universal knowledge of sensors and their linkage. To empower MTS graph generation with the knowledge-link graph, we further introduce a graph alignment module that transfers universal knowledge from the knowledge-link graph to the graph generated from MTS data. This enhances the MTS graph quality, ensuring effective representation learning for MTS data. Extensive experiments demonstrate the efficacy of K-Link for superior performance on various MTS tasks.