EDITBRIDGE: Towards Faithful and Efficient Ultra-High-Resolution Image Editing

arXiv:2608.180632026-08-17

先低分辨率编辑再对照高分辨率原图重新补全细节,让4K图像编辑仅需61秒完成

高分辨率图像编辑通常只能在1K以下运行,因为注意力计算量会随图像尺寸呈平方级增长,常见的折中方案是先在低分辨率下编辑再用超分辨率放大,但这种方式容易凭空捏造与原图不符的细节,或出现过度平滑、过度锐化的纹理问题。EditBridge不是从噪声重新生成图像,而是训练一个扩散桥模型,直接学习把低分辨率编辑结果转换为高分辨率结果,并以原始高分辨率原图作为引导;同时配合一种稀疏注意力机制,未编辑区域只参考原图中精确对应的位置,编辑区域只参考附近小范围,从而大幅降低计算量。最终在2K分辨率下比超分辨率方法快3.6到8.4倍,4K图像编辑仅需61秒完成。

METAL MEDIA 解读图

先低分辨率编辑再对照高分辨率原图重新补全细节,让4K图像编辑仅需61秒完成

01高分辨率图像编辑因注意力计算量随图像尺寸呈平方级增长,通常只能在1K以下分辨率运行
02常见的低分辨率编辑加超分辨率放大方案会出现信息发散(捏造出与原图不符的细节)和纹理退化(过度平滑或过度锐化)两大问题
03EditBridge采用扩散桥,直接学习从低分辨率编辑结果到高分辨率目标图像的转换路径,而不是从噪声重新生成图像,从而在整个过程中保留原始结构信息
04提出的先验引导块状稀疏注意力(PG-BSA)让未编辑区域只关注原图中精确对应的位置,编辑区域只关注周边小范围,显著减少计算开销
05在2K分辨率下比基于超分辨率的方法快3.6到8.4倍(耗时4.08秒),4K图像编辑仅需61秒完成,用户研究显示该方法在细节保留、真实感和美观度上均优于对比方法

这是 METAL MEDIA 制作的解读图，并非论文作者提供的原图。

他们做了什么

高分辨率图像编辑因注意力计算量随图像尺寸呈平方级增长,通常只能在1K以下分辨率运行
常见的低分辨率编辑加超分辨率放大方案会出现信息发散(捏造出与原图不符的细节)和纹理退化(过度平滑或过度锐化)两大问题
EditBridge采用扩散桥,直接学习从低分辨率编辑结果到高分辨率目标图像的转换路径,而不是从噪声重新生成图像,从而在整个过程中保留原始结构信息
提出的先验引导块状稀疏注意力(PG-BSA)让未编辑区域只关注原图中精确对应的位置,编辑区域只关注周边小范围,显著减少计算开销
在2K分辨率下比基于超分辨率的方法快3.6到8.4倍(耗时4.08秒),4K图像编辑仅需61秒完成,用户研究显示该方法在细节保留、真实感和美观度上均优于对比方法

Table 1: Quantitative comparison results. ↑/↓ indicate whether higher/lower values are better. Bold numbers represent the best results.
Method	Haar ↑	mPSNR ↑	mSSIM ↑	mMSE ↓	mLPIPS ↓	Time (s) ↓
1K Resolution
Direct Inference	0.3973	16.8078	0.7539	0.0549	0.4116	20.00
DiT4SR [14]	0.4127	14.5031	0.7092	0.0554	0.4818	28.47
DiT-SR [9]	0.4523	16.7152	0.7955	0.0430	0.4403	2.44
PiSA-SR [32]	0.4247	15.2115	0.7481	0.0486	0.4492	0.30
TSD-SR [12]	0.4127	15.3864	0.7531	0.0516	0.4628	0.42
HiFlow [7]	0.3012	11.6964	0.6489	0.1323	0.6012	5.12
ScaleEdit [22]	0.4824	16.8461	0.8206	0.0408	0.3784	181.20
Ours	0.4992	18.6536	0.8686	0.0369	0.3829	0.84
2K Resolution
Direct Inference	0.2254	13.5262	0.7491	0.0880	0.6700	82.14
DiT4SR [14]	0.3806	15.1298	0.7468	0.0516	0.5348	113.32
DiT-SR [9]	0.4210	17.2430	0.8265	0.0423	0.4738	14.82
PiSA-SR [32]	0.4046	16.2433	0.8061	0.0446	0.4702	20.22
TSD-SR [12]	0.4046	16.2021	0.7952	0.0467	0.4910	34.20
HiFlow [7]	0.3144	13.9314	0.7377	0.0759	0.5113	33.11
ScaleEdit [22]	0.4583	16.5510	0.6818	0.0485	0.5197	662.50
Ours	0.4673	18.6366	0.8712	0.0377	0.3903	4.08
4K Resolution
Direct Inference	0.2134	10.7086	0.5411	0.1281	0.7774	695.23
DiT4SR [14]	0.4002	20.2771	0.7535	0.0133	0.3510	533.83
DiT-SR [9]	0.4267	16.8615	0.6818	0.0415	0.5436	119.68
PiSA-SR [32]	0.4267	21.6200	0.7974	0.0108	0.2687	111.42
TSD-SR [12]	0.4124	22.2766	0.8035	0.0074	0.2399	108.72
HiFlow [7]	0.3307	14.4400	0.6719	0.0664	0.6038	129.30
ScaleEdit [22]	0.4116	18.5714	0.7638	0.0390	0.6015	3601.20
Ours	0.4279	24.1380	0.8347	0.0049	0.2112	61.10

Table 2: Performance comparison between our PG-BSA and full attention across 1K and 2K settings. ↑/↓ indicate whether higher/lower values are better. Bold numbers represent the best results within each resolution block.
Setting	Method	HaarPSI↑	mPSNR↑	mSSIM↑	mMSE↓	mLPIPS↓	Time (s)↓
1K	Ours	0.499	18.653	0.868	0.036	0.382	0.84
FullAttention	0.539	19.080	0.857	0.030	0.599	0.73
2K	Ours	0.467	18.636	0.871	0.037	0.390	4.08
FullAttention	0.505	17.918	0.705	0.041	0.425	4.71

Table 3: Quantitative evaluation of varying inference steps. ↑/↓ indicate whether higher/lower values are better. Bold numbers represent the best results.
Method	HaarPSI↑	mPSNR↑	mSSIM↑	mMSE↓	mLPIPS↓	Time(s)↓
5 steps	0.4131	15.7269	0.7763	0.0474	0.4739	4.03
10 steps	0.4020	15.4190	0.7636	0.0494	0.4662	8.10
Ours (1 step)	0.4991	18.6535	0.8685	0.0368	0.3829	0.84

为什么重要

高分辨率图像编辑是专业修图、设计等实际工作中的刚需,但此前速度与保真度往往难以兼得。这项研究证明二者可以同时实现,为将高分辨率编辑功能落地到实际产品降低了门槛。

本文术语

扩散桥(Diffusion Bridge) · 一种直接学习从起始图像过渡到目标图像的生成模型,而非从随机噪声生成
超分辨率(Super-Resolution) · 把低分辨率图像放大为高分辨率的技术,需要凭空补出缺失的细节
PG-BSA(先验引导块状稀疏注意力) · 一种只选择性关注原图中空间对应区域以降低计算量的注意力机制
DiT(扩散Transformer) · 一种基于Transformer架构的图像生成模型
LoRA(低秩适配) · 一种不重新训练整个模型,只训练少量新增参数即可完成微调的方法

无法转载的图表

Figure 1: Motivation of the proposed method. (a) and (b) compare the standard high-resolution image editing paradigm with our approach. (c) analyzes the inherent limitations of existing methods.
Figure 2: Overview of our proposed EditBridge. The upper section illustrates the inference process of the diffusion bridge, which transports the low-resolution edit to its high-resolution counterpart. The lower section details the construction of the correspondence prior and the proposed Prior-Guided Sparse Attention (PG-BSA) mechanism.
Figure 3: Qualitative comparison at 1K resolution. Our method better preserves fidelity while enhancing visual clarity.
Figure 4: Qualitative comparison at 2K resolution. Our method better preserves fidelity while enhancing visual clarity.
Figure 5: Ablation of Attention Sparsity. Full attention leads to noticeable source-induced artifacts, whereas our sparse attention maintains superior visual fidelity and alignment.
Figure 6: Impact of sampling steps. Perceptual quality and high-frequency details are maximized at T=1. Increasing the number of inference steps does not yield significant visual gains, further validating the efficiency of our refinement framework.
Figure 7: Results of the user study across three dimensions: Detail Preservation, Realism, and Aesthetics. Our method consistently outperforms all baselines in human preference.
Figure 8: Visual results at 1K resolution.
Figure 9: Visual results at 2K resolution.

在原文中查看图表 →

论文原文摘要（英文）

High-resolution image editing is increasingly demanded in professional workflows, yet existing diffusion-based models remain constrained to resolutions below 1K due to quadratic attention complexity and prohibitive memory requirements. A prevalent workaround employs a two-stage pipeline: editing at low resolution followed by independent super-resolution. However, this approach suffers from two critical issues: information divergence, where hallucinated details contradict the original high-resolution (HR) source, and texture degradation, manifesting as over-smoothed or over-sharpened artifacts. We propose EditBridge, a diffusion bridge framework for efficient ultra high-resolution editing. Unlike conventional diffusion that regenerates from noise, we formulate refinement as structured data-to-data translation from the low-resolution (LR) edited result to its HR counterpart, explicitly conditioned on the original HR source to preserve authentic details. To efficiently incorporate HR source guidance, we introduce a prior-guided block-wise sparse attention mechanism that exploits semantic correspondence from first-stage editing to constrain cross-image interactions to spatially aligned regions, significantly reducing computational overhead. Extensive experiments demonstrate that EditBridge achieves high-fidelity editing with superior perceptual quality at resolutions up to 4K, delivering 3.6--8.4times speedup at 2K and enabling practical 4K editing in 61 seconds.

作者 · Jiayi Song

在 arXiv 阅读

EDITBRIDGE: Towards Faithful and Efficient Ultra-High-Resolution Image Editing

先低分辨率编辑再对照高分辨率原图重新补全细节,让4K图像编辑仅需61秒完成

他们做了什么

为什么重要

本文术语

无法转载的图表

最新论文

METAL MEDIA 最新报道