Everything K-culture — comebacks to K-beauty, straight to your inboxGet it in your inbox

METAL MEDIA

PixRestore: Unified Image Restoration via Pixel Diffusion Transformer

arXiv:2608.167932026-08-16

One model fixes noise, haze, rain, and low light at once by diffusing directly on raw pixels instead of a compressed latent space

PixRestore is a single model that handles eight types of image degradation, including denoising, deblurring, dehazing, rain and raindrop removal, desnowing, low-light enhancement, and super-resolution. Instead of reusing a large pretrained text-to-image diffusion model through a compressed latent space, it trains a pixel-space diffusion transformer from scratch, avoiding the detail loss caused by the compression step. With only about 50M parameters and a single inference step, it beats prior diffusion-based restoration methods on quality, speed, and model size.

METAL MEDIA explanatory visual

One model fixes noise, haze, rain, and low light at once by diffusing directly on raw pixels instead of a compressed latent space

  1. 01Prior methods adapt large pretrained text-to-image diffusion models such as SDXL or FLUX, but the VAE (variational autoencoder) they use to compress images discards fine restoration-relevant details, and the open-ended generative prior can invent content inconsistent with the input
  2. 02PixRestore removes the VAE entirely and instead patchifies the raw low-quality image and a noisy image state into tokens fed directly into a Diffusion Transformer (DiT), keeping pixel-level evidence intact
  3. 03Because different degradation types depend on different visual cues, the model extracts multi-layer features from the pretrained vision model DINO and uses a lightweight adaptive layer router to predict, per image, how much to trust each feature layer
  4. 04A slow multi-step version of the model is first trained, then fine-tuned into a fast single-step generator using DINO-based adversarial training, cutting inference time sharply
  5. 05Across eight degradation types on public benchmarks and real-world images, PixRestore scores better overall on fidelity (PSNR, SSIM), perceptual quality (LPIPS, DISTS), and a proposed degradation-removal score (DR-Score), while using up to about 1200x less computation and running 7 to 23 times faster than competing methods
An explanatory diagram made by METAL MEDIA, not a figure supplied by the paper's authors.

What they did

  1. Prior methods adapt large pretrained text-to-image diffusion models such as SDXL or FLUX, but the VAE (variational autoencoder) they use to compress images discards fine restoration-relevant details, and the open-ended generative prior can invent content inconsistent with the input
  2. PixRestore removes the VAE entirely and instead patchifies the raw low-quality image and a noisy image state into tokens fed directly into a Diffusion Transformer (DiT), keeping pixel-level evidence intact
  3. Because different degradation types depend on different visual cues, the model extracts multi-layer features from the pretrained vision model DINO and uses a lightweight adaptive layer router to predict, per image, how much to trust each feature layer
  4. A slow multi-step version of the model is first trained, then fine-tuned into a fast single-step generator using DINO-based adversarial training, cutting inference time sharply
  5. Across eight degradation types on public benchmarks and real-world images, PixRestore scores better overall on fidelity (PSNR, SSIM), perceptual quality (LPIPS, DISTS), and a proposed degradation-removal score (DR-Score), while using up to about 1200x less computation and running 7 to 23 times faster than competing methods
Figure 1: PixRestore achieves the best overall performance in terms of restoration quality, model size, and inference speed. Top-left: radar charts comparing PSNR, LPIPS, and degradation removal performance across eight degradation types. Top-right: GFLOPs versus inference latency, where the bubble size denotes the number of parameters. Bottom: visual comparisons on eight restoration tasks. With only about 50M parameters and single-step inference, PixRestore achieves the best overall restoration quality while being the most efficient among diffusion-based methods.
Figure 1: PixRestore achieves the best overall performance in terms of restoration quality, model size, and inference speed. Top-left: radar charts comparing PSNR, LPIPS, and degradation removal performance across eight degradation types. Top-right: GFLOPs versus inference latency, where the bubble size denotes the number of parameters. Bottom: visual comparisons on eight restoration tasks. With only about 50M parameters and single-step inference, PixRestore achieves the best overall restoration quality while being the most efficient among diffusion-based methods.
Table 1: Latent diffusion vs. pixel diffusion under the same UIR training/test setting. The results are averaged over 8 restoration tasks. Pixel-space modeling provides a better overall trade-off in fidelity, perceptual quality, parameter count, and inference speed.
ModelVAEParams(M)Inf Time-DM (ms/step)Inf Time-VAE (ms)PSNR (dB) ↑LPIPS ↓MUSIQ ↑
Latent DiT-SSD2VAE (f8c4, ps1)106.41257822.100.248350.38
Latent DiT-SFluxVAE (f8c16, ps1)106.59257822.630.210950.86
Latent DiT-SQwenVAE (f8c16, ps1)67.37254122.800.218151.87
Pixel DiT-SNone (ps8)23.4125026.620.159354.32
Figure 2: Overview of PixRestore. A frozen vision encoder extracts multi-layer features from the LQ image, and an adaptive layer router predicts per-layer weights to fuse them into a single conditioning feature. The LQ image and the noisy state xt are patchified, then processed by N DiT blocks, and finally decoded into the HQ output.
Figure 2: Overview of PixRestore. A frozen vision encoder extracts multi-layer features from the LQ image, and an adaptive layer router predicts per-layer weights to fuse them into a single conditioning feature. The LQ image and the noisy state xt are patchified, then processed by N DiT blocks, and finally decoded into the HQ output.
Table 2: Quantitative comparison on public benchmarks. The best and second-best results are highlighted in red and blue italic, respectively. Methods marked with ∗ are retrained using the same training dataset as ours. Metrics: PSNR↑, SSIM↑, LPIPS↓, DISTS↓, DR-Score (degradation-removal score)↑.
MethodDe-rainstreakDenoiseDeblurDe-raindrop
PSNRSSIMLPIPSDISTSDR-ScorePSNRSSIMLPIPSDISTSDR-ScorePSNRSSIMLPIPSDISTSDR-ScorePSNRSSIMLPIPSDISTS
PromptIR24.500.75070.35290.238131.2532.540.90290.24590.160455.3523.820.75840.31310.219527.2318.810.69620.33900.1885
PromptIR∗28.430.83890.26590.190449.9935.450.93770.11040.106579.3329.100.84740.20510.156055.5623.680.80050.22360.1326
DiffUIR24.510.76180.34840.224840.1326.610.83800.31030.205659.5227.860.82000.22580.169944.0918.850.70040.34550.1905
UniRestore22.500.72910.42230.268934.3131.750.89690.23360.166961.2023.870.72050.24050.171646.9418.500.63770.41140.2285
DA-CLIP24.500.75600.33470.217643.0927.350.82450.24590.176464.1227.400.81130.16410.130355.0020.120.69880.27150.1512
DA-CLIP∗31.610.86060.10480.088578.7233.970.87280.14620.116675.1428.290.82280.14740.114858.3823.580.79160.13250.0852
FoundIR26.870.82630.24540.179952.3732.460.79250.27940.164155.5227.290.80460.24300.178139.1218.870.69720.35860.2017
FoundIR∗32.360.88880.15930.120371.1236.160.94150.10510.124580.8629.140.84660.19860.150349.8624.400.82180.19420.1146
Flux-IR20.980.62330.46250.286126.0425.710.68420.41970.236754.8623.510.67450.27460.185158.7018.940.64590.32240.1774
Flux-IR∗21.010.63440.45110.282231.0426.800.74100.37890.205137.0522.150.64460.28180.203673.1817.800.57850.32660.2075
FoundIR-v223.170.66520.36590.221857.2626.870.74810.27850.194674.4724.400.70790.22030.156673.2319.630.54590.27920.1563
FoundIR-v2∗27.850.75980.17730.132281.0328.170.74970.28890.189075.0124.980.73510.19140.132377.1220.810.54610.23000.1294
FAPE-IR27.510.82260.23190.167971.0932.990.90880.12380.111379.3126.800.78950.20980.155650.7221.390.68220.22190.1316
FAPE-IR∗31.910.86950.09030.076284.6434.220.91720.07410.075082.5627.960.82070.15770.109466.7523.880.72230.15550.0967
PixRestore32.280.88470.09020.090582.7534.870.93360.06240.073581.8928.320.82840.12010.094070.1924.480.77550.12580.0882
PixRestore-B32.850.88980.07670.081784.7234.620.93560.05640.070683.7029.230.85110.10510.083572.6925.210.79760.10870.0763
MethodDesnowDehazeLow-light enhancementSuper-resolution
PSNRSSIMLPIPSDISTSDR-ScorePSNRSSIMLPIPSDISTSDR-ScorePSNRSSIMLPIPSDISTSDR-ScorePSNRSSIMLPIPSDISTS
PromptIR22.260.79390.24520.167224.3521.340.88030.14260.101261.6810.490.47810.54100.376527.8724.260.73720.43940.2510
PromptIR∗29.320.85320.18180.140272.3921.250.89310.13480.088567.8917.910.68810.35640.251258.5827.590.79680.28390.2208
DiffUIR22.950.79480.23920.166725.0020.410.86560.16400.117557.1921.720.70820.38190.229262.9326.540.75820.38660.2378
UniRestore22.330.78630.24640.177126.1220.110.84690.21220.135967.3310.940.51880.50060.316538.3824.800.75430.35480.2284
DA-CLIP23.600.79710.22210.155835.5322.960.87510.13110.088570.3322.250.79150.24690.162273.2923.730.67890.37720.2367
DA-CLIP∗28.310.82820.13600.102181.4821.920.87790.14590.107758.5818.010.81850.21290.161472.7926.490.75850.23410.1763
FoundIR23.030.79990.24060.163024.6815.070.79010.25820.191933.1715.340.74730.30340.213262.2425.850.73990.42800.2492
FoundIR∗29.820.86780.15240.122473.0020.990.89030.13350.096264.8123.340.90260.17920.143980.4127.650.79520.28830.2251
Flux-IR21.740.72310.34340.220426.8014.730.75990.29760.198646.1318.850.70220.35570.199862.1622.490.65410.29030.2064
Flux-IR∗21.790.68310.30230.195951.2115.960.80610.23150.157852.8818.400.71980.33860.201061.4520.870.58530.35690.2519
FoundIR-v224.720.73470.25130.167167.4719.060.77050.19280.133762.7917.170.74480.31320.202772.4923.850.66610.29590.1974
Figure 3: Motivation of adaptive hierarchical visual guidance. Left: Per-layer DINO feature visualizations for low-light enhancement and de-raindrop. Shallow layers preserve local structures and details, while deeper layers encode global semantics. Right: LQ–HQ feature similarity across DINOv2-B layers for eight types of degradations. We see that different layers are sensitive to different degradations.
Figure 3: Motivation of adaptive hierarchical visual guidance. Left: Per-layer DINO feature visualizations for low-light enhancement and de-raindrop. Shallow layers preserve local structures and details, while deeper layers encode global semantics. Right: LQ–HQ feature similarity across DINOv2-B layers for eight types of degradations. We see that different layers are sensitive to different degradations.
Table 3: Complexity comparison of different methods. “NFE” denotes number of evaluations. All values are measured with input 1×3×512×512 on a single NVIDIA A800 GPU, with 5 warmup iterations and averaged over 100 runs.
MethodNFEParams (M)FLOPs (G)Latency (ms)
PromptIR-35.591382334
DiffUIR436.263839777
DA-CLIP100231.7611292718071
FoundIR436.263839777
UniRestore11071.205255158
FoundIR-v22016910.0911933418293
Flux-IR2117698.237952905790
FAPE-IR121575.43647581011
PixRestore153.7065844
PixRestore-B1210.89184279
Figure 4: No-reference quality metrics do not reliably reflect degradation removal. Here PixRestore removes the rainstreaks best, yet MUSIQ and AFINE-NR rank it worst, favoring the LQ input and the degradation-preserving output of FoundIR-v2, while our VLM-based DR-Score demonstrates strong alignment with human perceptual judgments.
Figure 4: No-reference quality metrics do not reliably reflect degradation removal. Here PixRestore removes the rainstreaks best, yet MUSIQ and AFINE-NR rank it worst, favoring the LQ input and the degradation-preserving output of FoundIR-v2, while our VLM-based DR-Score demonstrates strong alignment with human perceptual judgments.
Table 4: Ablation studies of PixRestore. “Avg.” denotes uniform averaging of selected DINO features for conditioning or supervision, while “Adap.” denotes adaptive averaging of selected DINO features for conditioning or supervision. “NFE” denotes the number of evaluations.
IDVariantNFEConditioningSupervisionPSNR↑SSIM↑LPIPS↓MUSIQ↑
A0Pixel DiT-S10NoneNone26.620.84540.159354.32
A1+ single-layer conditioning10layer 2None27.070.84570.156154.45
A2+ single-layer conditioning10layer 5None27.360.84870.148954.64
A3+ single-layer conditioning10layer 11None27.120.84910.150854.60
A4+ multi-layer conditioning10Avg. 2 layersNone27.620.85400.141254.90
A5+ multi-layer conditioning10Avg. 6 layersNone27.720.85360.140755.01
A6+ hierarchical loss10Avg. 6 layersAvg. 6 layers27.360.84440.123954.59
A7+ adaptive hierarchical visual guidance10Adap. 6 layersAdap. 6 layers27.660.85000.120954.97
A8+ adaptive hierarchical visual guidance4Adap. 6 layersAdap. 6 layers27.750.85840.122854.07
A9+ adaptive hierarchical visual guidance1Adap. 6 layersAdap. 6 layers28.070.86400.120253.34
A10+ single-step finetuning (PixRestore)1Adap. 6 layersAdap. 6 layers28.490.85890.112055.52
Figure 5: Visual comparisons on desnow (top) and low-light enhancement (bottom). PixRestore removes degradations effectively and recovers more faithful details and colors.
Figure 5: Visual comparisons on desnow (top) and low-light enhancement (bottom). PixRestore removes degradations effectively and recovers more faithful details and colors.
Table 5: Comparison between diffusion pretraining and finetuning with regression training under the same objective and total training iterations.
SchemeTraining iterationsPSNR↑SSIM↑LPIPS↓MUSIQ↑
Regression Training350k27.000.81790.149452.00
Flow pretraining + one-step finetuning (ours)250k + 100k28.490.85890.112055.52
Figure 6: Scaling behavior of PixRestore under varying backbone GFLOPs and patch sizes.
Figure 6: Scaling behavior of PixRestore under varying backbone GFLOPs and patch sizes.
Table 6: Quantitative comparison on real-world test set. The best and second-best results for each metric are highlighted in red bold and blue italic, respectively. Retrained methods are marked with ∗. ‘PR’ denotes the proposed PixRestore, the results of which are shaded in pink.
DegradationMetricPromptIRPromptIR∗DiffUIRDA-CLIPDA-CLIP∗FoundIRFoundIR∗UniRestoreFoundIR-v2FoundIR-v2∗Flux-IRFlux-IR∗FAPE-IRFAPE-IR∗PRPR-B
De-rainstreakMUSIQ↑59.9060.0661.0262.2359.9461.0060.8762.5863.0662.5762.9860.2361.0759.5362.6262.78
Affine-NR↓-0.90-0.90-0.92-0.91-0.91-0.90-0.92-0.89-0.96-0.96-0.94-0.89-1.00-1.00-1.02-1.03
DR-Score ↑30.8530.0533.7733.6251.6831.4838.8332.8749.0771.7225.5028.3764.7376.3272.1274.69
DeblurMUSIQ↑34.2832.5741.6446.6143.9232.8534.1049.2669.9972.7855.2665.7344.8945.8453.3756.56
Affine-NR↓-0.73-0.70-0.78-0.77-0.76-0.70-0.72-0.81-1.04-1.10-0.87-1.00-0.80-0.83-0.88-0.93
DR-Score ↑26.5631.0828.1248.7845.2226.5829.3546.7766.6674.9438.0972.1863.3565.4165.4373.08
De-raindropMUSIQ↑64.1863.4764.0466.2654.4661.8560.6263.8765.8157.7465.6066.2852.7139.6147.9954.54
Affine-NR↓-0.83-0.78-0.82-0.87-0.71-0.77-0.71-0.78-0.83-0.79-0.92-1.02-0.85-0.76-0.72-0.80
DR-Score↑25.7026.1522.1037.6344.6526.5732.3826.0034.3062.5936.0536.0380.7380.8274.8880.62
DesnowMUSIQ↑58.9659.2759.9259.7459.3660.2460.1560.3063.3563.4658.3362.1257.9658.6862.6962.65
Affine-NR↓-0.74-0.75-0.77-0.78-0.77-0.75-0.75-0.73-0.83-0.86-0.76-0.89-0.86-0.88-0.90-0.91
DR-Score ↑26.9034.1739.5345.9946.6928.0132.4532.1346.9064.8938.6350.6371.5771.7371.8674.70
DehazeMUSIQ↑59.8360.4059.6661.0060.2160.2660.5560.8563.3861.3263.3960.3259.7760.3361.9361.47
Affine-NR↓-0.88-0.88-0.87-0.88-0.87-0.87-0.88-0.82-0.90-0.86-0.89-0.83-0.88-0.90-0.93-0.93
DR-Score ↑32.9037.6824.5532.3628.8631.0232.4347.4342.6137.5240.3740.7432.6735.9444.5142.06
Low-lightMUSIQ↑47.6755.0354.2164.6653.1849.6157.1048.4763.3361.3154.1052.7549.9157.6058.1758.63
Affine-NR↓-0.88-0.92-0.71-0.95-0.90-0.89-0.98-0.85-1.00-0.94-0.93-0.91-0.89-0.99-0.98-0.99
DR-Score↑31.6567.0359.3366.2465.1031.7065.0538.8771.2566.6258.0754.7138.7075.0962.3862.13
AverageMUSIQ↑54.1455.1356.7560.0855.1854.3055.5657.5564.8263.2059.4561.2454.3953.6057.8059.44
Affine-NR↓-0.83-0.82-0.81-0.86-0.82-0.81-0.83-0.81-0.93-0.92-0.89-0.92-0.88-0.88-0.91-0.93
DR-Score ↑29.0937.6934.5744.1047.0329.2338.4237.5151.8063.0539.4547.1158.6367.5565.2067.88
Figure 7: Visual comparisons on real-world desnow, dehaze, and deblur cases. PixRestore can remove degradations more effectively and recover cleaner details and sharper structures with fewer artifacts.
Figure 7: Visual comparisons on real-world desnow, dehaze, and deblur cases. PixRestore can remove degradations more effectively and recover cleaner details and sharper structures with fewer artifacts.
Table S.1: Training data sources for each degradation type.
DegradationTraining data
DeblurGoPro [33], RealBlur [57], UHD-Blur [3], LSD-Defocus [58]
DehazeRESIDE [2], UHD-Haze [3], WeatherBench-haze [41], UniSer-Haze [59], synthetic data from UrbanSyn [60], BlendedMVS [61] and MegaDepth [62]
De-raindropRaindropClarity [63], RainDS-Real-RainDrop [36],
de-rainstreakRain13K [64], RealRain-1k [37], UAV-Rain1k [38], FoundIR-rain [9], RainDS-Real-RainStreak [36], synthetic data from UrbanSyn [60],
DesnowSnow100K [65], WeatherBench-snow [41], synthetic data from UrbanSyn [60],
DenoiseSIDD [66], PolyU [35], synthetic Gaussian noise DF2K [34, 67]
Low-light
enhancementLOL [40], UHD-LL [39], DarkFace [68], FoundIR-low-light [9], NTIRE-LLIE [69]
Super-resolution (SR)RealESRGAN degradation from DF2K [34, 67], RealSR [42], ScreenSR [43]
Figure 8: Visual comparisons on real-world de-raindrop, low-light enhancement, and de-rainstreak cases. PixRestore can remove degradations more effectively and recover cleaner details and sharper structures with fewer artifacts.
Figure 8: Visual comparisons on real-world de-raindrop, low-light enhancement, and de-rainstreak cases. PixRestore can remove degradations more effectively and recover cleaner details and sharper structures with fewer artifacts.
Table S.2: Real-world test data sources for each degradation type.
DegradationReal-world test data
DeblurGyroBlur-Real [70]
DehazeRTTS and OpenReal-fog [44]
De-raindropOpenReal-raindrop [44]
De-rainstreakOpenReal-rainstreak [44] and DiffUIR[10]
DesnowSnow100K-realistic [65] and OpenReal-snow [44]
Low-light
enhancementOpenReal-night [44] and ExDark [71]
Figure S.1: Illustration of DR-Score. Given the LQ input, the restored result, and the task description, the VLM judges whether the target degradation has been removed. A better restoration receives a higher DR-Score.
Figure S.1: Illustration of DR-Score. Given the LQ input, the restored result, and the task description, the VLM judges whether the target degradation has been removed. A better restoration receives a higher DR-Score.
Table S.3: Pixel-space and latent-space comparison on 8 degradation types. We report comparisons on PSNR↑/LPIPS↓/MUSIQ↑.
DegradationLatent DiT with FLUX-VAELatent DiT with Qwen-VAELatent DiT with SD2-VAEPixel DiT
SR25.59/0.2038/58.6825.62/0.1992/62.2525.03/0.2586/58.5326.48/0.2067/57.80
Deblur26.66/0.1617/46.5326.93/0.1545/46.6926.00/0.1921/45.2327.17/0.1850/41.76
Dehaze15.31/0.2253/54.5615.16/0.2391/52.5015.08/0.2659/53.3124.78/0.1020/58.17
Denoise31.97/0.0952/47.2232.33/0.1021/48.3730.65/0.1252/47.9032.58/0.1179/51.32
De-raindrop20.43/0.2257/62.7920.63/0.2463/64.7120.01/0.2751/62.4623.19/0.1707/66.66
De-rainstreak25.07/0.1478/46.4925.34/0.1821/47.6324.53/0.1876/46.0030.19/0.1350/49.43
Desnow27.82/0.1304/49.0028.41/0.1190/49.3927.30/0.1483/49.4528.96/0.1301/48.58
Low-light enhancement10.82/0.4572/40.6410.82/0.4530/42.1310.81/0.4834/39.7320.80/0.2122/57.98
Overall22.63/0.2109/50.8622.80/0.2181/51.8722.10/0.2483/50.3826.62/0.1593/54.32
Figure S.2: Human alignment analysis of different no-reference metrics with pairwise human preferences. Left: alignment ratios between metric-induced rankings and human judgments across real-world UIR tasks. Right: representative failure cases where two restored results are visually similar with subtle appearance differences but lead to disagreement between DR-Score and human judgment.
Figure S.2: Human alignment analysis of different no-reference metrics with pairwise human preferences. Left: alignment ratios between metric-induced rankings and human judgments across real-world UIR tasks. Right: representative failure cases where two restored results are visually similar with subtle appearance differences but lead to disagreement between DR-Score and human judgment.
Table S.4: Comparison of frozen visual foundation priors under the same pixel DiT setting. All encoders share the ViT-B architecture and parameter count. Features of the same layer are selected. Metrics are averaged over 8 degradation types. Best results are highlighted in bold.
Visual PriorPSNR (dB) ↑SSIM ↑LPIPS ↓MUSIQ ↑
CLIP-B26.610.84410.159854.30
MAE-B26.700.84540.159354.20
SigLIP-B26.660.84490.159254.19
DINOv2-B27.250.85000.153154.21
Figure S.3: Visual comparisons on synthetic desnow, low-light enhancement, de-rainstreak, and denoise cases. Overall, PixRestore restores cleaner and more faithful results with better structural details and fewer artifacts.
Figure S.3: Visual comparisons on synthetic desnow, low-light enhancement, de-rainstreak, and denoise cases. Overall, PixRestore restores cleaner and more faithful results with better structural details and fewer artifacts.
Table S.5: Detailed quantitative comparison on Deblur benchmarks. The best and second-best results are highlighted in red and blue italic, respectively. Methods marked with ∗ are retrained under the same training setting as ours.
MethodGoProUHD-blur
PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓
PromptIR23.430.79030.30350.197225.50-0.587424.210.72650.32280.241829.81-0.6163
PromptIR∗29.820.87750.20000.144036.18-0.712328.390.81720.21010.168140.52-0.7570
DiffUIR29.320.86690.20410.149235.93-0.713726.390.77310.24760.190738.01-0.7075
UniRestore24.110.74960.22160.140845.93-0.789623.630.69140.25950.202442.99-0.6870
DA-CLIP28.570.85540.12790.099441.05-0.732926.230.76710.20030.161242.83-0.7479
DA-CLIP∗28.870.85360.13170.103142.91-0.744427.710.79200.16300.126447.05-0.7656
FoundIR27.020.81210.26100.180029.96-0.627627.560.79710.22500.176238.80-0.7544
FoundIR∗29.950.87620.18870.139335.81-0.729728.330.81700.20840.161339.98-0.7696
FoundIR-v224.480.71790.22240.145157.73-0.895424.320.69800.21830.168063.23-1.0422
FoundIR-v2∗24.980.74700.19650.126256.90-0.891424.970.72320.18620.138558.39-0.9774
Flux-IR24.030.70120.24080.155055.90-0.850022.980.64790.30840.215353.29-0.8064
Flux-IR∗22.590.67160.27170.193660.22-0.960921.710.61760.29180.213758.22-0.9313
FAPE-IR28.020.83740.15270.105841.62-0.778125.580.74170.26690.205435.00-0.7267
FAPE-IR∗28.680.85050.13470.090738.84-0.740327.250.79080.18070.128241.57-0.7694
PixRestore-S28.960.85530.10670.083343.39-0.818227.670.80160.13350.104649.73-0.8105
PixRestore-B30.000.88050.08950.072144.74-0.835428.460.82180.12060.094949.54-0.8200
PixRestore-L30.790.89480.07870.065745.51-0.861628.960.83460.11170.089150.45-0.8515
PixRestore-XL31.230.90250.07210.062146.34-0.871229.070.84070.10900.085450.34-0.8487
Figure S.4: Visual comparisons on synthetic dehaze, de-raindrop, deblur, and SR cases. Overall, PixRestore restores cleaner and more faithful results with better structural details and fewer artifacts.
Figure S.4: Visual comparisons on synthetic dehaze, de-raindrop, deblur, and SR cases. Overall, PixRestore restores cleaner and more faithful results with better structural details and fewer artifacts.
Table S.6: Detailed quantitative comparison on Dehaze benchmarks. The best and second-best results are highlighted in red and blue italic, respectively. Methods marked with ∗ are retrained under the same training setting as ours.
MethodRESIDE-6KUHD-Haze
PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓
PromptIR26.690.95720.04600.041851.24-0.942215.980.80350.23910.160563.94-0.9765
PromptIR∗24.010.94170.06420.055351.58-0.936218.490.84450.20540.121663.45-1.0058
DiffUIR24.660.93110.07080.058250.59-0.931416.150.80010.25720.176862.57-0.9683
UniRestore23.630.91620.11710.086955.68-0.963016.590.77760.30730.184962.14-0.9155
DA-CLIP28.660.92730.05590.046353.52-0.978417.270.82300.20630.130765.88-1.0698
DA-CLIP∗28.150.95790.04310.040951.31-0.943915.700.79790.24870.174663.98-0.9540
FoundIR16.520.83810.16650.130449.68-0.861213.620.74210.34990.253359.75-0.8267
FoundIR∗25.070.95250.05230.048350.61-0.946416.910.82820.21460.144164.37-0.9976
FoundIR-v219.010.81010.18370.131857.83-0.939619.110.73090.20180.135769.04-1.0056
FoundIR-v2∗18.570.79250.19970.134256.12-0.919119.620.73650.18700.122268.08-1.0543
Flux-IR15.640.77960.25910.163965.46-1.018513.830.74020.33610.233361.74-0.8161
Flux-IR∗17.270.84160.15780.107450.54-0.834814.650.77060.30520.208360.48-0.8251
FAPE-IR31.360.96280.03780.036450.35-0.957319.200.83860.15420.093766.12-1.1555
FAPE-IR∗28.900.95750.04110.038550.32-0.948821.780.85370.14420.090565.45-1.1361
PixRestore-S28.410.95550.04730.044452.81-0.977722.510.87290.13180.085566.98-1.1836
PixRestore-B29.870.96360.03900.038851.79-0.973723.410.88200.11880.076067.26-1.2451
PixRestore-L30.630.96600.03650.036652.11-0.977223.230.88360.12270.077166.81-1.2381
PixRestore-XL31.730.96770.03400.035551.83-0.974123.140.88270.12230.077666.92-1.2237
Table S.7: Detailed quantitative comparison on Denoise benchmarks. The best and second-best results are highlighted in red and blue italic, respectively. Methods marked with ∗ are retrained under the same training setting as ours.
MethodDIV2K (Gaussian)PolyU
PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓
PromptIR34.570.90790.14110.138464.24-0.909830.500.89780.35060.182530.88-0.6068
PromptIR∗33.910.89750.14630.138861.00-0.851737.000.97800.07440.074232.70-0.6156
DiffUIR21.240.75400.34370.252355.21-0.701331.980.92210.27690.158832.67-0.6270
UniRestore30.380.87280.16590.142064.25-0.886833.110.92090.30120.191831.60-0.5629
DA-CLIP28.910.75320.24120.176457.33-0.815525.790.89570.25060.176533.00-0.6137
DA-CLIP∗30.760.77040.24480.157058.12-0.792937.190.97530.04770.076133.67-0.5932
FoundIR27.140.60610.49200.257445.98-0.609737.770.97890.06680.070733.55-0.6303
FoundIR∗34.060.89920.15720.146962.82-0.907438.250.98370.05290.102234.24-0.6195
FoundIR-v225.430.65440.26580.182562.76-0.919728.310.84180.29130.206652.61-0.8119
FoundIR-v2∗25.960.65840.24880.183762.60-0.908030.390.84100.32900.194341.44-0.6478
Flux-IR21.330.47800.57580.266050.37-0.732230.080.89030.26370.207343.26-0.7832
Flux-IR∗24.340.58370.42960.238649.22-0.733829.260.89840.32810.171632.85-0.6348
FAPE-IR31.090.85400.11470.101360.49-0.873934.890.96360.13290.121235.29-0.6526
FAPE-IR∗31.320.85720.10800.097860.52-0.883037.110.97720.04010.052233.52-0.6135
PixRestore-S33.040.89230.07830.086363.62-0.941036.710.97490.04650.060734.54-0.6139
PixRestore-B33.400.89680.07250.077763.84-0.959135.840.97450.04020.063634.15-0.6030
PixRestore-L33.350.89620.07300.076864.12-0.967135.910.97360.03850.070934.39-0.6022
PixRestore-XL33.460.89790.07290.077464.06-0.964836.500.97450.03410.075333.95-0.5994
Table S.8: Detailed quantitative comparison on De-rainstreak benchmarks. The best and second-best results are highlighted in red and blue italic, respectively. Methods marked with ∗ are retrained under the same training setting as ours.
MethodRainDS-realRealRain-1K
PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓
PromptIR25.150.74830.20470.139260.54-0.860223.850.75310.50110.337042.82-0.6698
PromptIR∗26.620.79330.19770.125461.79-0.896330.230.88450.33410.255436.49-0.5757
DiffUIR26.110.78880.18850.116863.88-0.915722.910.73480.50840.332945.21-0.7440
UniRestore23.470.71430.32200.183865.71-0.879721.520.74390.52260.354045.97-0.7192
DA-CLIP24.660.74670.18340.121363.20-0.904124.350.76540.48610.313946.39-0.7354
DA-CLIP∗25.720.75160.14320.085963.31-0.926137.500.96950.06650.091032.27-0.6034
FoundIR26.780.78900.16300.107563.26-0.904526.970.86350.32780.252339.15-0.6486
FoundIR∗27.270.81200.19930.119167.29-0.981237.440.96550.11930.121635.47-0.6340
FoundIR-v223.650.60780.19560.111163.58-0.972222.690.72260.53620.332648.23-0.7375
FoundIR-v2∗23.740.60430.19060.108864.82-1.000131.960.91530.16410.155636.17-0.6297
Flux-IR22.340.66650.26950.176964.41-0.967619.630.58010.65540.395250.43-0.7374
Flux-IR∗21.660.64100.29120.180362.00-0.930620.370.62780.61100.384045.93-0.6811
FAPE-IR26.530.76360.14070.083562.03-0.974828.500.88170.32320.252342.51-0.7340
FAPE-IR∗26.670.76420.12700.074661.14-0.981637.140.97480.05350.077831.15-0.6092
PixRestore-S27.060.79500.11800.077366.07-1.043337.500.97440.06250.103832.07-0.6152
PixRestore-B27.410.80380.10780.069365.65-1.046138.280.97580.04560.094132.27-0.6153
PixRestore-L27.540.80650.09900.066465.60-1.053238.510.97600.04040.093332.65-0.6170
PixRestore-XL27.580.80790.10000.065065.18-1.046338.600.97530.04010.102832.81-0.6160
Table S.9: Detailed quantitative comparison on De-raindrop benchmarks. The best and second-best results are highlighted in red and blue italic, respectively. Methods marked with ∗ are retrained under the same training setting as ours.
MethodRainDS-realUAV-Rain1k
PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓
PromptIR20.700.70690.27730.156055.31-0.808816.920.68550.40070.221166.57-0.8022
PromptIR∗24.530.75290.26370.134759.14-0.856022.840.84820.18350.130568.19-0.8475
DiffUIR20.560.69960.31190.167856.28-0.803417.130.70110.37900.213266.67-0.7942
UniRestore20.250.69060.34820.188858.44-0.811116.750.58470.47460.268365.96-0.7044
DA-CLIP22.990.70180.17630.097761.66-0.883217.260.69580.36670.204767.27-0.8080
DA-CLIP∗24.140.70770.15700.090560.92-0.885523.010.87550.10790.079969.43-0.9228
FoundIR20.670.71710.31450.174959.34-0.804117.070.67730.40260.228567.57-0.7823
FoundIR∗25.410.77080.24870.131965.20-0.931623.400.87290.13970.097369.58-0.9111
FoundIR-v220.220.57250.30790.156659.84-0.870419.030.51940.25050.156069.47-0.8975
FoundIR-v2∗21.720.56410.24350.125564.75-0.987619.910.52800.21650.133269.30-0.9315
Flux-IR21.010.65400.23350.122163.08-1.004616.870.63770.41130.232866.83-0.8472
Flux-IR∗18.850.56720.33130.196468.66-1.172916.760.58970.32180.218672.29-1.0842
FAPE-IR24.710.72550.18410.093059.93-0.945218.060.63890.25980.170265.88-0.8070
FAPE-IR∗25.270.72630.15020.079058.40-0.935822.490.71830.16070.114568.35-0.9177
PixRestore-S25.420.73940.13260.076161.54-0.991123.540.81170.11900.100270.15-0.9816
PixRestore-B25.760.74610.12450.072061.41-0.992824.650.84900.09280.080670.35-1.0176
PixRestore-L25.890.75040.11950.068661.30-0.996325.160.86310.08100.071970.63-1.0379
PixRestore-XL26.010.75670.11710.067761.36-0.993925.690.87740.07150.065570.55-1.0392
Table S.10: Detailed quantitative comparison on Low-light Enhancement benchmarks. The best and second-best results are highlighted in red and blue italic, respectively. Methods marked with ∗ are retrained under the same training setting as ours.
MethodUHD-LLLOL
PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓
PromptIR11.820.56600.50880.311635.06-0.65779.170.39020.57320.441538.49-0.7859
PromptIR∗25.330.88460.23030.175745.85-0.679410.500.49160.48240.326844.53-0.8607
DiffUIR17.670.50640.60570.332037.19-0.477925.760.90990.15810.126468.79-0.9938
UniRestore12.410.61020.46650.290336.98-0.64179.480.42740.53470.342643.85-0.7569
DA-CLIP20.510.74360.36750.220148.51-0.617223.990.83950.12630.104374.18-1.0050
DA-CLIP∗16.640.77760.26320.201647.98-0.758919.380.85940.16260.121266.85-0.9450
FoundIR14.220.69840.35480.238642.38-0.703716.470.79630.25190.187765.83-1.0337
FoundIR∗24.280.88850.21130.168751.48-0.855222.400.91680.14710.119171.35-1.0455
FoundIR-v216.400.71200.36430.238160.71-0.931317.950.77760.26200.167467.72-1.0373
FoundIR-v2∗17.720.72720.35410.227355.85-0.875116.360.73410.28340.192962.16-0.9620
Flux-IR15.350.55190.54550.296538.47-0.514022.360.85250.16580.103272.10-1.1667
Flux-IR∗14.330.60280.48660.285237.25-0.527522.470.83690.19060.116770.91-1.2086
FAPE-IR12.570.63150.38990.266939.07-0.748926.340.89420.12610.100666.74-1.0265
FAPE-IR∗26.550.89800.14450.109651.54-0.815625.530.90490.12960.104065.50-1.0535
PixRestore-S26.280.88890.14200.106053.31-0.846124.960.88990.13000.095766.07-1.0386
PixRestore-B26.360.88860.13840.101053.45-0.853425.080.89830.12120.089965.88-1.0329
PixRestore-L26.890.89280.13260.097954.53-0.861325.300.89600.12730.093264.39-1.0055
PixRestore-XL26.370.89340.13240.098254.62-0.868626.200.89550.12860.094963.64-1.0015
Table S.11: Detailed quantitative comparison on Desnow benchmarks. The best and second-best results are highlighted in red and blue italic, respectively. Methods marked with ∗ are retrained under the same training setting as ours.
MethodWeatherBench
PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓
PromptIR22.260.79390.24520.167245.60-0.6023
PromptIR∗29.320.85320.18180.140246.30-0.6161
DiffUIR22.950.79480.23920.166748.10-0.6185
UniRestore22.330.78630.24640.177149.39-0.6451
DA-CLIP23.600.79710.22210.155846.48-0.6127
DA-CLIP∗28.310.82820.13600.102148.82-0.6424
FoundIR23.030.79990.24060.163045.77-0.6029
FoundIR∗29.820.86780.15240.122447.98-0.6908
FoundIR-v224.720.73470.25130.167159.98-0.8032
FoundIR-v2∗26.280.76900.18240.131154.44-0.7440
Flux-IR21.740.72310.34340.220456.08-0.6879
Flux-IR∗21.790.68310.30230.195957.03-0.7504
FAPE-IR26.020.81910.17590.118946.29-0.6280
FAPE-IR∗30.190.86760.11360.084947.84-0.6595
PixRestore-S31.260.88590.08530.066949.86-0.6829
PixRestore-B31.930.89590.06880.058450.10-0.6825
PixRestore-L32.350.90390.06560.056950.36-0.6859
PixRestore-XL32.570.90770.06230.055350.25-0.6864
Table S.12: Detailed quantitative comparison on Super-resolution benchmarks. The best and second-best results are highlighted in red and blue italic, respectively. Methods marked with ∗ are retrained under the same training setting as ours.
MethodRealSRScreenSR
PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓PSNR↑SSIM↑LPIPS↓DISTS↓MUSIQ↑AFINE-NR↓
PromptIR23.470.73800.46470.267025.95-0.443525.050.73650.41400.235142.95-0.7419
PromptIR∗28.650.80510.30450.238245.99-0.682126.540.78840.26330.203358.41-0.8518
DiffUIR27.400.77340.37440.241735.15-0.499925.680.74310.39890.233848.34-0.7720
UniRestore24.840.76830.33580.230539.91-0.585724.760.74030.37370.226353.30-0.8091
DA-CLIP24.210.72580.39100.246930.60-0.480423.240.63210.36350.226547.89-0.7682
DA-CLIP∗27.720.77770.22130.182150.30-0.726025.260.73930.24690.170564.42-0.9523
FoundIR26.130.74320.44740.261926.74-0.439625.580.73650.40860.236542.63-0.7437
FoundIR∗28.740.80000.33540.245440.54-0.644326.560.79030.24120.204861.52-0.9192
FoundIR-v224.610.66820.33030.224868.03-1.013423.090.66400.26160.170065.93-0.9700
FoundIR-v2∗24.830.66490.32060.217964.84-0.978522.740.64110.17810.118572.46-1.0921
Flux-IR23.420.65990.35480.246569.74-1.097121.560.64830.22580.166472.17-1.2027
Flux-IR∗22.410.59270.36680.255968.62-1.038619.340.57780.34710.247971.41-1.1189
FAPE-IR27.920.79690.23250.187750.67-0.818925.170.74950.33070.207752.83-0.8243
FAPE-IR∗29.060.81390.18430.146850.37-0.822425.900.75460.20610.139861.45-0.8721
PixRestore-S28.400.78820.17760.145856.20-0.850125.620.75780.16960.125866.40-0.9682
PixRestore-B28.430.79040.16460.136756.15-0.859025.710.76420.15560.121167.20-0.9940
PixRestore-L28.550.79330.15900.131757.26-0.888025.460.75080.14830.122768.72-0.9846
PixRestore-XL28.590.79560.15950.133256.37-0.892225.170.73990.15040.135368.07-0.9560

Why it matters

For anyone building photo restoration, surveillance footage cleanup, or camera preprocessing pipelines that face many kinds of image damage, this shows high-quality unified restoration is possible without a heavy generative backbone. The paper also flags that common no-reference quality metrics fail to reliably measure whether degradation was actually removed, proposing a VLM-based DR-Score as a more human-aligned alternative for future evaluation.

Terms in this paper

  • VAE (variational autoencoder) · a neural network that compresses an image into a smaller representation and back; here identified as a source of lost fine detail
  • DiT (Diffusion Transformer) · a diffusion model, which generates images by gradually removing noise, built using a transformer architecture
  • DINO / DINOv2 · a self-supervised vision model that learns image structure and meaning without labeled data
  • patchification · splitting an image into small square patches to use as input tokens for a transformer
  • DR-Score · a new evaluation metric that asks a vision-language model to judge whether a degradation was actually removed

Original abstract (English)

Unified image restoration (UIR) aims to recover high-quality (HQ) content from low-quality (LQ) images with different degradations using a single model. Most recent methods adapt large pretrained text-to-image (T2I) latent diffusion models for their strong capacity and generative priors. However, the variational autoencoder (VAE) in latent T2I models may discard restoration-sensitive details, while the open-ended synthesis prior can introduce content-inconsistent artifacts. We present PixRestore, a VAE-free pixel-space Diffusion Transformer (DiT) for UIR, where the diffusion backbone is trained entirely from scratch, without relying on T2I pretraining. PixRestore performs flow matching directly on patchified pixels, preserving fine-grained details while keeping the token sequence tractable. To adapt to different degradations, PixRestore learns to predict the reliability of layer features using LQ--HQ DINO feature similarity. Features from more reliable layers are fused as dense conditioning, while less reliable layers receive stronger HQ-feature supervision to encourage degradation removal. We train PixRestore on a large-scale corpus of diverse scenes and degradations, and further finetune it into a one-step generator using DINO-based adversarial objectives for efficient inference. Experiments on public benchmarks and real-world test sets show that, with only about 50M parameters and single-step inference, PixRestore achieves the best overall fidelity, perceptual quality, and robustness to degradations among competing UIR models while being far more efficient. Larger PixRestore variants can further boost performance, demonstrating the scalability of our pixel-space design. Code and the curated benchmark can be found at https://github.com/csslc/PixRestore.

Authors · Lingchen Sun

Read on arXiv

Latest papers

All papers →

Latest from METAL MEDIA

Figures: Lingchen Sun et al., arXiv:2608.16793, CC BY 4.0