CRAICLSep 30, 2025

SeedPrints: Fingerprints Can Even Tell Which Seed Your Large Language Model Was Trained From

arXiv:2509.26404v15 citationsh-index: 6
Originality Highly original
AI Analysis

This addresses the need for reliable model attribution in AI, offering a more intrinsic and persistent fingerprinting approach compared to existing methods.

The paper tackles the problem of fingerprinting Large Language Models (LLMs) for provenance verification by proposing SeedPrints, a method that uses random initialization biases as seed-dependent identifiers, achieving seed-level distinguishability and robust identity verification across training stages and domain shifts.

Fingerprinting Large Language Models (LLMs) is essential for provenance verification and model attribution. Existing methods typically extract post-hoc signatures based on training dynamics, data exposure, or hyperparameters -- properties that only emerge after training begins. In contrast, we propose a stronger and more intrinsic notion of LLM fingerprinting: SeedPrints, a method that leverages random initialization biases as persistent, seed-dependent identifiers present even before training. We show that untrained models exhibit reproducible token selection biases conditioned solely on their parameters at initialization. These biases are stable and measurable throughout training, enabling our statistical detection method to recover a model's lineage with high confidence. Unlike prior techniques, unreliable before convergence and vulnerable to distribution shifts, SeedPrints remains effective across all training stages and robust under domain shifts or parameter modifications. Experiments on LLaMA-style and Qwen-style models show that SeedPrints achieves seed-level distinguishability and can provide birth-to-lifecycle identity verification akin to a biometric fingerprint. Evaluations on large-scale pretrained models and fingerprinting benchmarks further confirm its effectiveness under practical deployment scenarios. These results suggest that initialization itself imprints a unique and persistent identity on neural language models, forming a true ''Galtonian'' fingerprint.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes