Automatic Differentiation for Complex Valued SVD
This work provides a foundational component for automatic differentiation in complex-valued computations, which is incremental but essential for advancing tensor network methods.
The authors derived the backpropagation formula for complex-valued singular value decompositions (SVD), enabling automatic differentiation for complex numbers and applications in tensor networks.
In this note, we report the back propagation formula for complex valued singular value decompositions (SVD). This formula is an important ingredient for a complete automatic differentiation(AD) infrastructure in terms of complex numbers, and it is also the key to understand and utilize AD in tensor networks.