One email each morning — yesterday's AI, sortedGet it in your inbox

METAL LAB

TT-net: Quantum Inspired Tensor Network Denoising in Conditional GANs

arXiv:2608.197892026-08-21

Letting image channels talk to each other improves GAN-based denoising

This paper introduces TT-Net, which swaps the SVD (Singular Value Decomposition, a linear-algebra tool that breaks a matrix into simpler pieces)-based denoising filter used in prior conditional GANs with a tensor-train decomposition (a technique from quantum many-body physics) that can compare information across channels. The previous method, SVD-Net, filtered each feature-map channel separately and could never let channels interact, while TT-Net's two-step decomposition lets channels be compared directly. Tested on CIFAR-10 images corrupted with Gaussian noise, motion blur, and salt-and-pepper noise, TT-Net beat SVD-Net on both PSNR and SSIM across all three noise types.

What they did

  1. SVD-Net decomposed each channel of a feature map independently, so it could never exploit relationships between channels; TT-Net instead applies a two-cut tensor-train decomposition that lets channels be compared against each other
  2. The comparison was controlled: generator, discriminator, and training setup were identical, with only the denoising block swapped from SVD to tensor-train
  3. TT-Net outperformed SVD-Net by 2.68 dB PSNR / 0.0513 SSIM on Gaussian noise, 8.32 dB PSNR / 0.3798 SSIM on motion blur, and 0.99 dB PSNR / 0.0165 SSIM on salt-and-pepper noise
  4. On Gaussian noise, TT-Net also beat both EigenGAN and the state-of-the-art Pix2pix baseline, models included for broader context
  5. TT-Net's adversarial loss term consistently flattened out early in training across all three noise types, yet reconstruction quality kept improving anyway, raising an open question about how much the adversarial component actually contributes
Figure 1: Representative test-set outputs across all four models and three noise types. Ground truth is shown once per row since it is identical across models. Each model’s own noisy input and output are shown alongside it.
Figure 1: Representative test-set outputs across all four models and three noise types. Ground truth is shown once per row since it is identical across models. Each model’s own noisy input and output are shown alongside it.
Figure 2: Discriminator output probabilities D⁡(real)/D⁡(fake) over training, SVD-Net vs. TT-Net, by noise type.
Figure 2: Discriminator output probabilities D⁡(real)/D⁡(fake) over training, SVD-Net vs. TT-Net, by noise type.
Table 1: Feature map shape at each TT-Net / SVD-Net insertion point.
Insertion pointChannelsHeightWidth
After 1st encoder stage643232
After 2nd encoder stage1281616
After 3rd encoder stage25688
Figure 3: Total generator loss (ℒG=ℒGa​d​v+ℒrecon, Section 4.2) over training, SVD-Net (top) vs. TT-Net (bottom), by noise type, linear scale.
Figure 3: Total generator loss (ℒG=ℒGa​d​v+ℒrecon, Section 4.2) over training, SVD-Net (top) vs. TT-Net (bottom), by noise type, linear scale.
Figure 4: Generator loss components (Ga​d​v, L2, MS-SSIM, recon) over training, SVD-Net (top) vs. TT-Net (bottom), by noise type. See Section 4.2 for the loss definitions, ℒrecon=δ⋅ℒMS-SSIM+(1−δ)⋅ℒL​2,δ=0.84.
Figure 4: Generator loss components (Ga​d​v, L2, MS-SSIM, recon) over training, SVD-Net (top) vs. TT-Net (bottom), by noise type. See Section 4.2 for the loss definitions, ℒrecon=δ⋅ℒMS-SSIM+(1−δ)⋅ℒL​2,δ=0.84.
Table 2: Optimized hyperparameters used for each model, with a uniform batch size of 32 applied across all four.
Modellr (G, D)β1β2Optimizer
Pix2pix2×10−40.50.999Adam
EigenGAN2×10−30.50.999Adam
SVD-Net1×10−40.90.999Adam
TT-Net1×10−40.90.999Adam
Figure 5: Validation PSNR over training, SVD-Net vs. TT-Net, by noise type.
Figure 5: Validation PSNR over training, SVD-Net vs. TT-Net, by noise type.
Figure 6: Validation SSIM (windowed) over training, SVD-Net vs. TT-Net, by noise type.
Figure 6: Validation SSIM (windowed) over training, SVD-Net vs. TT-Net, by noise type.
Table 3: Test-set PSNR and SSIM (standard windowed formulation) across noise types, using each model’s optimized hyperparameters (Section 4.1) with a uniform batch size of 32. Bold indicates the best value across all four models. TT-Net achieves the best PSNR and SSIM of any model on Gaussian noise. †SVD-Net’s motion-blur result reflects a late-training discriminator collapse rather than a converged model (Section 5.3).
GaussianMotion BlurSalt & Pepper
ModelPSNRSSIMPSNRSSIMPSNRSSIM
Pix2pix25.520.746636.180.964341.790.9881
EigenGAN25.180.754526.710.839834.240.9513
SVD-Net23.600.745518.02†0.4260†28.980.8761
TT-Net26.280.796826.340.805829.970.8926
Figure 7: MS-SSIM loss component over training, SVD-Net vs. TT-Net, by noise type.
Figure 7: MS-SSIM loss component over training, SVD-Net vs. TT-Net, by noise type.

Why it matters

It shows that a targeted architectural change, letting a denoising mechanism access cross-channel structure, can measurably improve image restoration quality without changing the rest of the GAN pipeline. It also demonstrates that quantum-inspired tensor network tools, originally built for simulating quantum systems, can serve as practical feature filters in real deep learning applications.

Terms in this paper

  • Tensor Train · a way of breaking a multi-dimensional array (tensor) into a chain of smaller matrix multiplications; known as Matrix Product State in quantum physics
  • SVD (Singular Value Decomposition) · a linear-algebra method that splits a matrix into three simpler matrices, useful for keeping only the most important information
  • GAN (Generative Adversarial Network) · a model made of a generator that creates images and a discriminator that judges real vs. fake, trained against each other
  • PSNR / SSIM · standard metrics for measuring how close a restored image is to the original; higher is better
  • discriminator collapse · a training failure where the discriminator overwhelms the generator, causing output quality to suddenly degrade

Original abstract (English)

Developed as a workhorse for classical simulations of quantum algorithms and quantum many-body systems, Tensor Network methods have entered the scientific mainstream in quantum physics. Among various types of tensor networks, Tensor Trains (commonly know as Matrix Product States in the quantum computing community) have already found applications in machine learning. These methods often rely on a powerful linear algebra tool called the Singular Value Decomposition (SVD). Several conditional GAN architectures for image denoising incorporate SVD as a single-cut decomposition step applied to generator feature maps. In this work we introduce TT-Net, which replaces the per-channel SVD denoising block with a two-cut tensor-train decomposition capable of accessing cross-channel information directly, a capability absent from contemporary alternatives. In a controlled comparison differing only in this decomposition mechanism, TT-Net outperforms SVD-Net on PSNR and SSIM across all three noise types tested (Gaussian, motion blur, and salt-and-pepper), supporting the hypothesis that cross-channel access improves denoising quality. Training-dynamics analysis further shows that TT-Net's adversarial loss term consistently saturates to a stagnant state across all three noise types, more so than SVD-Net's, while reconstruction quality continues to improve regardless, raising an open question about the adversarial component's contribution that this work identifies but does not resolve. Furthermore, for Gaussian noise our method outperforms both the EigenGAN and the state of the art Pix2pix method which does not assume any linear algebra decompositions and does not retain any linear algebra information. Our manuscript shows how quantum inspired tools can be used as practical real world feature filters for deep learning applications.

Authors · Michal A. Sterzel, Marko J. Ran\v{c}i\'c

Read on arXiv

Latest papers

All papers →

Latest from METAL LAB

Figures: Michal A. Sterzel et al., arXiv:2608.19789, CC BY 4.0