Benchmarking Quantum Computers via Protocols -- Comparing Superconducting and Ion-Trap Quantum Technology
For quantum computing researchers and engineers, this work offers a protocol-based method to compare disparate quantum technologies, but it is incremental as it builds on prior work and does not demonstrate new quantum capabilities.
The paper introduces a benchmarking protocol that uses binary fidelity thresholds to measure 'quantumness' on optimal sub-chips, enabling fair comparison of superconducting and ion-trap quantum devices. Applied to industry-leading platforms, it reveals strengths and weaknesses of each architecture, providing a common language for assessing quantum advantage.
Superconducting and Ion-Trap quantum architectures are common in the current landscape of the quantum computing field, each with distinct characteristics and operational constraints. Understanding and measuring the underlying quantumness of these devices is essential for assessing their readiness for practical applications and guiding future progress and research. Building on earlier work (Meirom, Mor, Weinstein Arxiv 2505.12441), we utilize a benchmarking strategy applicable for comparing these two architectures by measuring "quantumness" directly on optimal sub-chips. Distinct from existing metrics, our approach employs rigorous binary fidelity thresholds derived from the classical limits of state transfer. This enable us to definitively establish quantum advantage of a designated sub-region. We apply this quality assurance methodology to industry leading platforms from both technologies. This comparison provides a protocol-based evaluation of quantumness advantage, revealing not only the strengths and weaknesses of each tested chip and its sub-chips but also offering a common language for their assessment. By abstracting away technical differences in the final result, we demonstrate a benchmarking strategy that bridges the gap between disparate quantum-circuit technologies, enabling fair performance comparisons and establishing a critical foundation for evaluating future claims of quantum advantage.