Amalgam: Hybrid LLM-PGM Synthesis Algorithm for Accuracy and Realism
For practitioners needing synthetic data that supports both complex schemas and accurate analytics, Amalgam offers a practical hybrid solution.
Amalgam is a hybrid LLM-PGM algorithm for synthetic data generation that achieves both accuracy for analytics and realism, with an average 91% χ² P value and a realism score of 3.8/5 (vs. SOTA 3.3 and real data 4.7).
To generate synthetic datasets, e.g., in domains such as healthcare, the literature proposes approaches of two main types: Probabilistic Graphical Models (PGMs) and Deep Learning models, such as LLMs. While PGMs produce synthetic data that can be used for advanced analytics, they do not support complex schemas and datasets. LLMs on the other hand, support complex schemas but produce skewed dataset distributions, which are less useful for advanced analytics. In this paper, we therefore present Amalgam, a hybrid LLM-PGM data synthesis algorithm supporting both advanced analytics, realism, and tangible privacy properties. We show that Amalgam synthesizes data with an average 91 % $Ï^2 P$ value and scores 3.8/5 for realism using our proposed metric, where state-of-the-art is 3.3 and real data is 4.7.