AIBoMGen: Generating an AI Bill of Materials for Secure, Transparent, and Compliant Model Training
This addresses the problem of ensuring secure, transparent, and compliant AI model training for regulators and developers, though it is incremental as it builds on existing SBOM concepts.
The paper tackles the lack of transparency and security in AI systems by introducing AIBoMGen, a platform that automates the generation of signed AI Bills of Materials to record model training details, and it reliably detects unauthorized modifications with negligible performance overhead.
The rapid adoption of complex AI systems has outpaced the development of tools to ensure their transparency, security, and regulatory compliance. In this paper, the AI Bill of Materials (AIBOM), an extension of the Software Bill of Materials (SBOM), is introduced as a standardized, verifiable record of trained AI models and their environments. Our proof-of-concept platform, AIBoMGen, automates the generation of signed AIBOMs by capturing datasets, model metadata, and environment details during training. The training platform acts as a neutral, third-party observer and root of trust. It enforces verifiable AIBOM creation for every job. The system uses cryptographic hashing, digital signatures, and in-toto attestations to ensure integrity and protect against threats such as artifact tampering by dishonest model creators. Our evaluation demonstrates that AIBoMGen reliably detects unauthorized modifications to all artifacts and can generate AIBOMs with negligible performance overhead. These results highlight the potential of AIBoMGen as a foundational step toward building secure and transparent AI ecosystems, enabling compliance with regulatory frameworks like the EUs AI Act.