TT-net: Quantum Inspired Tensor Network Denoising in Conditional GANs

arXiv:2608.197892026-08-21

Letting image channels talk to each other improves GAN-based denoising

This paper introduces TT-Net, which swaps the SVD (Singular Value Decomposition, a linear-algebra tool that breaks a matrix into simpler pieces)-based denoising filter used in prior conditional GANs with a tensor-train decomposition (a technique from quantum many-body physics) that can compare information across channels. The previous method, SVD-Net, filtered each feature-map channel separately and could never let channels interact, while TT-Net's two-step decomposition lets channels be compared directly. Tested on CIFAR-10 images corrupted with Gaussian noise, motion blur, and salt-and-pepper noise, TT-Net beat SVD-Net on both PSNR and SSIM across all three noise types.

METAL MEDIA explanatory visual

Letting image channels talk to each other improves GAN-based denoising

01SVD-Net decomposed each channel of a feature map independently, so it could never exploit relationships between channels; TT-Net instead applies a two-cut tensor-train decomposition that lets channels be compared against each other
02The comparison was controlled: generator, discriminator, and training setup were identical, with only the denoising block swapped from SVD to tensor-train
03TT-Net outperformed SVD-Net by 2.68 dB PSNR / 0.0513 SSIM on Gaussian noise, 8.32 dB PSNR / 0.3798 SSIM on motion blur, and 0.99 dB PSNR / 0.0165 SSIM on salt-and-pepper noise
04On Gaussian noise, TT-Net also beat both EigenGAN and the state-of-the-art Pix2pix baseline, models included for broader context
05TT-Net's adversarial loss term consistently flattened out early in training across all three noise types, yet reconstruction quality kept improving anyway, raising an open question about how much the adversarial component actually contributes

An explanatory diagram made by METAL MEDIA, not a figure supplied by the paper's authors.

What they did

SVD-Net decomposed each channel of a feature map independently, so it could never exploit relationships between channels; TT-Net instead applies a two-cut tensor-train decomposition that lets channels be compared against each other
The comparison was controlled: generator, discriminator, and training setup were identical, with only the denoising block swapped from SVD to tensor-train
TT-Net outperformed SVD-Net by 2.68 dB PSNR / 0.0513 SSIM on Gaussian noise, 8.32 dB PSNR / 0.3798 SSIM on motion blur, and 0.99 dB PSNR / 0.0165 SSIM on salt-and-pepper noise
On Gaussian noise, TT-Net also beat both EigenGAN and the state-of-the-art Pix2pix baseline, models included for broader context
TT-Net's adversarial loss term consistently flattened out early in training across all three noise types, yet reconstruction quality kept improving anyway, raising an open question about how much the adversarial component actually contributes

Figure 1: Representative test-set outputs across all four models and three noise types. Ground truth is shown once per row since it is identical across models. Each model’s own noisy input and output are shown alongside it.

Figure 2: Discriminator output probabilities D⁡(real)/D⁡(fake) over training, SVD-Net vs. TT-Net, by noise type.

Table 1: Feature map shape at each TT-Net / SVD-Net insertion point.
Insertion point	Channels	Height	Width
After 1st encoder stage	64	32	32
After 2nd encoder stage	128	16	16
After 3rd encoder stage	256	8	8

Figure 3: Total generator loss (ℒG=ℒGadv+ℒrecon, Section 4.2) over training, SVD-Net (top) vs. TT-Net (bottom), by noise type, linear scale.

Figure 4: Generator loss components (Gadv, L2, MS-SSIM, recon) over training, SVD-Net (top) vs. TT-Net (bottom), by noise type. See Section 4.2 for the loss definitions, ℒrecon=δ⋅ℒMS-SSIM+(1−δ)⋅ℒL2,δ=0.84.

Table 2: Optimized hyperparameters used for each model, with a uniform batch size of 32 applied across all four.
Model	lr (G, D)	β1	β2	Optimizer
Pix2pix	2×10−4	0.5	0.999	Adam
EigenGAN	2×10−3	0.5	0.999	Adam
SVD-Net	1×10−4	0.9	0.999	Adam
TT-Net	1×10−4	0.9	0.999	Adam

Figure 5: Validation PSNR over training, SVD-Net vs. TT-Net, by noise type.

Figure 6: Validation SSIM (windowed) over training, SVD-Net vs. TT-Net, by noise type.

Table 3: Test-set PSNR and SSIM (standard windowed formulation) across noise types, using each model’s optimized hyperparameters (Section 4.1) with a uniform batch size of 32. Bold indicates the best value across all four models. TT-Net achieves the best PSNR and SSIM of any model on Gaussian noise. †SVD-Net’s motion-blur result reflects a late-training discriminator collapse rather than a converged model (Section 5.3).
	Gaussian	Motion Blur	Salt & Pepper
Model	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM
Pix2pix	25.52	0.7466	36.18	0.9643	41.79	0.9881
EigenGAN	25.18	0.7545	26.71	0.8398	34.24	0.9513
SVD-Net	23.60	0.7455	18.02†	0.4260†	28.98	0.8761
TT-Net	26.28	0.7968	26.34	0.8058	29.97	0.8926

Figure 7: MS-SSIM loss component over training, SVD-Net vs. TT-Net, by noise type.

Why it matters

It shows that a targeted architectural change, letting a denoising mechanism access cross-channel structure, can measurably improve image restoration quality without changing the rest of the GAN pipeline. It also demonstrates that quantum-inspired tensor network tools, originally built for simulating quantum systems, can serve as practical feature filters in real deep learning applications.

Terms in this paper

Tensor Train · a way of breaking a multi-dimensional array (tensor) into a chain of smaller matrix multiplications; known as Matrix Product State in quantum physics
SVD (Singular Value Decomposition) · a linear-algebra method that splits a matrix into three simpler matrices, useful for keeping only the most important information
GAN (Generative Adversarial Network) · a model made of a generator that creates images and a discriminator that judges real vs. fake, trained against each other
PSNR / SSIM · standard metrics for measuring how close a restored image is to the original; higher is better
discriminator collapse · a training failure where the discriminator overwhelms the generator, causing output quality to suddenly degrade

Original abstract (English)

Developed as a workhorse for classical simulations of quantum algorithms and quantum many-body systems, Tensor Network methods have entered the scientific mainstream in quantum physics. Among various types of tensor networks, Tensor Trains (commonly know as Matrix Product States in the quantum computing community) have already found applications in machine learning. These methods often rely on a powerful linear algebra tool called the Singular Value Decomposition (SVD). Several conditional GAN architectures for image denoising incorporate SVD as a single-cut decomposition step applied to generator feature maps. In this work we introduce TT-Net, which replaces the per-channel SVD denoising block with a two-cut tensor-train decomposition capable of accessing cross-channel information directly, a capability absent from contemporary alternatives. In a controlled comparison differing only in this decomposition mechanism, TT-Net outperforms SVD-Net on PSNR and SSIM across all three noise types tested (Gaussian, motion blur, and salt-and-pepper), supporting the hypothesis that cross-channel access improves denoising quality. Training-dynamics analysis further shows that TT-Net's adversarial loss term consistently saturates to a stagnant state across all three noise types, more so than SVD-Net's, while reconstruction quality continues to improve regardless, raising an open question about the adversarial component's contribution that this work identifies but does not resolve. Furthermore, for Gaussian noise our method outperforms both the EigenGAN and the state of the art Pix2pix method which does not assume any linear algebra decompositions and does not retain any linear algebra information. Our manuscript shows how quantum inspired tools can be used as practical real world feature filters for deep learning applications.

Authors · Michal A. Sterzel, Marko J. Ran\v{c}i\'c

Read on arXiv

Latest papers

All papers →

Latest from METAL MEDIA

NCT 127 drop BLINGY, their first full album in two years

Figures: Michal A. Sterzel et al., arXiv:2608.19789, CC BY 4.0