K-文化的一切——从回归到 K-美妆,发送到您的邮箱订阅邮件

METAL MEDIA

Training Chemical Plausibility-Aware Large Language Models for Single-Step Retrosynthesis

arXiv:2608.189402026-08-18

一个分子往往有好几种合成路径,让AI一次给出15个答案后表现大幅提升

逆合成预测是指从目标分子倒推出起始原料的过程,现实中一个分子常常存在多种可行方案,但传统的单一答案评测方式却忽略了这种多样性。研究团队提出了Top-K提示法,训练和评测AI语言模型时要求其一次给出15个候选答案,并用约4560万条经过验证的化学反应构建了大规模数据集来训练C3LM模型。结果显示,该模型在一个全新的高难度基准测试中,表现超过了传统的逆合成预测软件。

METAL MEDIA 解读图

一个分子往往有好几种合成路径,让AI一次给出15个答案后表现大幅提升

  1. 01逆合成分析是从目标分子倒推出可获得的起始原料的过程,天然存在多种合理路径,但传统的单一答案评测协议无法体现这种一对多的特性
  2. 02研究团队没有像以往那样只要求AI给出一个答案(Top-1),而是采用Top-K提示法,明确要求模型针对每个分子给出15个不同的候选答案,并以此方式训练和评测模型
  3. 03团队构建了名为CREED-CCV-2+USPTO-XL的超大规模数据集,包含约368万个独特产物分子和约4565万条经过验证的化学反应,用其训练C3LM模型,并进一步用强化学习结合化学合理性评分工具ChemCensor以及新颖性奖励对模型进行微调
  4. 04在具有挑战性的、包含全新分子的URSA-expert-2026基准测试中,C3LM超过了MHNreact等主流传统逆合成软件以及多款强大的商业AI模型;分析还发现AI模型和传统软件往往找到彼此不重合的反应,提示将二者结合使用可以覆盖更广的化学空间
这是 METAL MEDIA 制作的解读图,并非论文作者提供的原图。

他们做了什么

  1. 逆合成分析是从目标分子倒推出可获得的起始原料的过程,天然存在多种合理路径,但传统的单一答案评测协议无法体现这种一对多的特性
  2. 研究团队没有像以往那样只要求AI给出一个答案(Top-1),而是采用Top-K提示法,明确要求模型针对每个分子给出15个不同的候选答案,并以此方式训练和评测模型
  3. 团队构建了名为CREED-CCV-2+USPTO-XL的超大规模数据集,包含约368万个独特产物分子和约4565万条经过验证的化学反应,用其训练C3LM模型,并进一步用强化学习结合化学合理性评分工具ChemCensor以及新颖性奖励对模型进行微调
  4. 在具有挑战性的、包含全新分子的URSA-expert-2026基准测试中,C3LM超过了MHNreact等主流传统逆合成软件以及多款强大的商业AI模型;分析还发现AI模型和传统软件往往找到彼此不重合的反应,提示将二者结合使用可以覆盖更广的化学空间
Table 1: Plausibility-based evaluation in the single-step retrosynthesis Top-K mode. Max: per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC: per-TM average ChemCensor score over top-K unique predictions; ChemCensor v1.1.1, USPTO-full as the source of synthetic precedents. See the full table in Appendix F. Results for recently released models are available at https://dddbench.insilico.com/.
ModelURSA-expert-2026USPTO-50K-test-mini
MaxAv. PT-Top-K CCMaxAv. PT-Top-K CC
@3@5@10@3@5@10
Proprietary Foundation Models
Grok-4.11.861.561.310.863.992.612.021.24
Grok-4.31.741.411.130.663.992.581.951.15
Gemini 3.1 Pro1.911.691.461.084.322.922.341.59
GPT 5.41.190.780.550.292.341.431.020.55
GPT 5.51.941.681.461.054.503.072.451.63
Claude Opus 4.71.911.651.390.954.352.962.311.45
Claude Opus 4.81.891.621.340.854.352.952.301.44
Open-weight Foundation Models
Qwen 3.51.611.321.070.643.442.391.841.09
Kimi K2.51.681.381.130.693.652.431.861.10
GLM-51.220.970.750.422.161.391.030.58
Conventional SSRS Models
LocalRetro2.111.851.591.224.843.312.671.81
GLN1.961.721.491.034.803.182.521.58
MHNreact2.051.841.621.284.863.302.681.90
RetroKNN2.101.841.601.224.853.332.681.82
R-SMILES2.081.831.561.114.853.362.671.75
C3LM, Supervised Fine-Tuning, Top-1 Mode
C3LM-LFM2-CREED-CCV+USPTO*1.621.060.720.384.122.101.360.70
C3LM, Supervised and Reinforcement Learning Fine-Tuning, Top-K Mode
C3LM-LFM2-CREED-CCV+USPTO1.921.681.420.984.162.742.171.42
C3LM-LFM2-CREED-CCV-2+USPTO-XL2.041.811.591.274.162.882.371.70
C3LM-LFM2-RFT-CC2.081.881.651.294.162.922.411.73
C3LM-LFM2-RFT-CC-NR2.161.941.731.374.283.012.511.85
Chemical Plausibility and Diversity Frontier of Generated Reactions
All GP LLMs (17) together2.192.071.931.654.853.983.532.87
All conventional SSRS models (8) together2.181.991.781.454.903.583.002.26
Table 2: C3LM family inventory. TD-1 = CREED-CCV + USPTO; TD-2 = CREED-CCV-2 + USPTO-XL. ∗Trained in prior work (46); its predictions are re-scored under ChemCensor (v1.1.1) for comparison, without retraining.
Model NameShort NameTraining DataReward
C3LM, Supervised Fine-Tuning, Top-1 task
C3LM-LFM2-CREED-CCV+USPTO*C3LM-1TD-1
C3LM, Supervised Fine-Tuning, Top-K task
C3LM-LFM2-CREED-CCV+USPTOC3LM-2TD-1
C3LM-LFM2-CREED-CCV-2+USPTO-XLC3LM-3TD-2
C3LM, Reinforcement Learning Fine-Tuning, Top-K task
C3LM-LFM2-RFT-CCC3LM-4TD-2ChemCensor
C3LM-LFM2-RFT-CC-NRC3LM-5TD-2ChemCensor, Novelty
Table 4: Plausibility-based evaluation in the single-step retrosynthesis Top-1 mode. Max: per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC: per-TM average ChemCensor score over top-K unique predictions; ChemCensor v1.1.1.
ModelURSA-expert-2026USPTO-50K-test-mini
MaxAv. PT-Top-K CCMaxAv. PT-Top-K CC
@3@5@10@3@5@10
Proprietary Foundation Models
Grok-4.11.731.280.920.474.012.291.530.79
Grok-4.31.470.860.560.283.061.340.830.41
Gemini 3.1 Pro1.630.920.570.284.001.701.030.51
GPT 5.10.730.340.210.111.370.630.380.19
GPT 5.20.860.450.280.142.020.950.580.29
GPT 5.40.110.050.030.022.120.970.600.30
GPT 5.51.520.960.630.323.901.891.180.59
Claude Sonnet 4.51.440.860.560.283.341.671.050.52
Claude Sonnet 4.61.260.710.440.223.321.641.010.51
Claude Opus 4.51.310.680.420.213.331.540.940.47
Claude Opus 4.61.360.840.530.263.631.811.120.56
Claude Opus 4.71.671.040.660.333.721.791.120.56
Claude Opus 4.81.661.060.670.343.641.691.040.52
Open-weight Foundation Models
DeepSeek 3.20.390.160.090.051.140.440.260.13
Qwen 3.51.541.040.730.383.692.021.320.67
Kimi K2.51.470.980.640.333.731.851.160.58
GLM-51.030.490.290.153.671.921.230.62
LFM2 2.6B0.000.000.000.000.000.000.000.00
Table 5: Intersection of predicted reactions for URSA-expert-2026 benchmark set with the reference conventional model MHNreact. Δ is the per-target difference between the number of reactions unique to the model and those unique to MHNreact.
ModelIntersectionUnique for ModelUnique for MHNreactΔ
C3LM-LFM2-CREED-CCV-2+USPTO-XL5.06.86.4+0.4
C3LM-LFM2-RFT-CC-NR5.06.76.4+0.3
C3LM-LFM2-RFT-CC4.86.06.6-0.6
C3LM-LFM2-CREED-CCV+USPTO3.64.07.9-3.9
Gemini 3.1 Pro5.23.56.2-2.7
GPT 5.55.23.26.2-3.0
Grok-4.13.92.77.5-4.8
Claude Opus 4.74.52.66.9-4.3
Claude Opus 4.84.02.27.4-5.2
Qwen 3.52.72.08.7-6.7
Claude Opus 4.63.01.98.5-6.6
Grok-4.33.11.98.4-6.5
Kimi K2.53.11.98.4-6.5
Claude Sonnet 4.52.31.99.1-7.2
Claude Opus 4.52.71.88.7-6.9
GLM-52.31.49.2-7.8
C3LM-LFM2-CREED-CCV+USPTO*1.41.310.0-8.7
GPT 5.41.01.110.5-9.4
Claude Sonnet 4.61.60.89.8-9.0
GPT 5.20.30.611.1-10.5
GPT 5.10.30.511.1-10.6
DeepSeek 3.20.40.410.9-10.5
Table 6: Plausibility-based evaluation in the single-step retrosynthesis Top-K mode. Max: per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC: per-TM average ChemCensor score over top-K unique predictions; ChemCensor v1.1.1, ChemCensor-U2P2 reference database (USPTO-full ∪ Pistachio Q3 2023).
ModelURSA-expert-2026USPTO-50K-test-mini
MaxAv. PT-Top-K CCMaxAv. PT-Top-K CC
@3@5@10@3@5@10
Proprietary Foundation Models
Grok-4.12.171.811.541.064.132.842.271.46
Grok-4.32.021.621.320.824.142.812.191.35
Gemini 3.1 Pro2.201.931.681.294.423.122.561.83
GPT 5.10.690.400.270.141.410.790.540.28
GPT 5.20.510.330.240.151.610.990.710.40
GPT 5.41.370.970.710.392.501.621.190.66
GPT 5.52.281.941.681.274.603.262.681.86
Claude Sonnet 4.51.861.511.210.753.362.311.801.11
Claude Sonnet 4.61.170.900.700.423.132.071.570.92
Claude Opus 4.51.921.551.240.793.542.461.941.22
Claude Opus 4.61.951.591.290.833.962.772.191.37
Claude Opus 4.72.241.891.611.164.443.162.551.68
Claude Opus 4.82.171.851.541.024.453.172.551.68
Open-weight Foundation Models
DeepSeek 3.20.550.400.290.171.180.730.520.30
Qwen 3.51.911.541.260.813.612.612.071.29
Kimi K2.51.981.611.350.883.842.672.111.33
GLM-51.761.401.110.663.122.111.610.96
Conventional SSRS Models
LocalRetro2.382.111.841.414.883.492.872.02
GLN2.261.941.681.214.863.352.711.76
MEGAN2.341.951.611.094.853.342.671.72
Chemformer2.011.160.780.404.731.731.050.52
Graph2Edits2.382.051.731.224.863.182.461.55
MHNreact2.332.081.821.444.903.482.892.12
RetroKNN2.352.111.821.414.903.532.912.04
R-SMILES2.352.091.791.304.903.542.891.95
Table 7: Plausibility-based evaluation in the single-step retrosynthesis Top-K mode. Max: per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC: per-TM average ChemCensor score over top-K unique predictions; ChemCensor v0.5.2.
ModelURSA-expert-2026USPTO-50K-test-mini
MaxAv. PT-Top-K CCMaxAv. PT-Top-K CC
@3@5@10@3@5@10
Proprietary Foundation Models
Grok-4.11.901.591.330.884.042.712.131.33
Grok-4.31.801.451.160.694.022.652.031.22
Gemini 3.1 Pro1.961.721.491.114.352.972.421.66
GPT 5.10.610.350.230.121.310.720.480.25
GPT 5.20.430.280.200.121.530.920.650.36
GPT 5.41.230.810.570.302.401.501.080.59
GPT 5.51.981.711.481.084.513.152.551.72
Claude Sonnet 4.51.591.291.020.603.212.101.580.93
Claude Sonnet 4.61.040.790.610.352.981.921.420.81
Claude Opus 4.51.701.341.070.653.372.281.751.06
Claude Opus 4.61.731.391.130.703.822.612.021.23
Claude Opus 4.71.951.681.420.974.373.042.401.53
Claude Opus 4.81.931.661.380.884.373.032.401.51
Open-weight Foundation Models
DeepSeek 3.20.510.350.240.130.990.600.420.23
Qwen 3.51.631.331.070.643.492.461.921.16
Kimi K2.51.731.421.160.713.722.511.941.17
GLM-51.501.200.930.522.931.921.440.83
Conventional SSRS Models
LocalRetro2.141.871.611.234.823.352.731.88
GLN1.971.731.501.044.813.232.581.66
MEGAN2.031.761.501.014.823.262.591.67
Chemformer1.771.020.680.354.701.731.050.53
Graph2Edits2.111.811.541.094.803.122.401.51
MHNreact2.081.861.631.284.843.342.751.98
RetroKNN2.131.861.621.234.843.372.751.90
R-SMILES2.101.871.641.244.873.512.861.95

为什么重要

逆合成预测是判断候选药物分子能否在实验室中真正被合成出来的关键筛选步骤,提升AI在这方面的多样性和可靠性有助于减少新药研发早期的试错成本。同时,AI模型与传统软件探索出不同反应空间这一发现,也为未来结合两者、形成互补组合方案提供了实践方向。

本文术语

  • 逆合成(Retrosynthesis) · 从目标分子出发倒推出起始原料及合成路径的化学分析方法
  • Top-K提示法 · 要求AI一次性生成多个不同候选答案,而不是只给一个答案
  • ChemCensor · 用于给生成的化学反应打分、判断其是否化学上合理的评估工具
  • GRPO(分组相对策略优化) · 一种强化学习方法,通过比较一组候选答案的相对优劣来训练模型
  • SMILES · 一种用文本字符串表示分子结构的化学记法

无法转载的图表

  • Figure 1: Comparison of representative top-performing models from each model tier, normalized by metric-specific frontier scores.
  • Figure 2: Data-generation pipeline for the CREED-CCV-2+USPTO-XL training set.
  • Figure 3: Top-1 → Top-K transition on URSA-expert-2026 (Av. PT-Top-10 CC). Hollow = Top-1 task, filled = Top-K task; line length is the gain Δ=Top-K−Top-1 (right column, sorted).
  • Figure 4: Intersection between the reactions predicted for the URSA-expert-2026 benchmark set by each LLM and those predicted by MHNreact. Values on the right (Δ) show the average per-target difference between the number of reactions unique to the LLM and those unique to MHNreact; positive values indicate more LLM-unique reactions. C3LM-2: C3LM-LFM2-CREED-CCV+USPTO; C3LM-3: C3LM-LFM2-CREED-CCV-2+USPTO-XL; C3LM-5: C3LM-LFM2-RFT-CC-NR. See all results in Figure 5.
  • Figure 5: Intersection of reactions predicted by LLMs and the conventional SSRS model MHNreact. Values on the right show the difference between the number of reactions unique to the model and those unique to MHNreact (model − MHNreact). C3LM-1: C3LM-LFM2-CREED-CCV+USPTO*; C3LM-2: C3LM-LFM2-CREED-CCV+USPTO; C3LM-3: C3LM-LFM2-CREED-CCV-2+USPTO-XL; C3LM-4: C3LM-LFM2-RFT-CC; C3LM-5: C3LM-LFM2-RFT-CC-NR.
  • Figure 6: Intersection of reactions predicted for X404-1768-5005 by C3LM-LFM2-CREED-CCV-2+USPTO-XL and MHNreact.
  • Figure 7: Distribution of the number of reactant sets for products from USPTO-50K-test-mini. For each product, all reference reactant sets were retrieved by matching it against USPTO-full.
在原文中查看图表 →

论文原文摘要(英文)

Single-step retrosynthesis is a central component of computer-aided synthesis planning, yet its intrinsically one-to-many nature is poorly captured by single-answer evaluation and benchmarking protocols. To address this, we introduce Top-K prompting as a robust training and inference paradigm to better capture diverse, plausible reaction predictions. We compile CREED-CCV-2+USPTO-XL, an ultra-large-scale dataset of ~45.6 million verified reactions to train the C3LM (Chemistry Constraint-Consistent Language Model). By integrating fine-tuning with ChemCensor-based and novelty-oriented rewards, our model achieves state-of-the-art performance on the OOD URSA-expert-2026 benchmark. Further analysis of reaction uniqueness shows that LLMs and conventional models explore complementary reaction spaces, motivating ensemble-based retrosynthesis systems. Overall, our results establish Top-K, plausibility-aware training as a practical new direction for robust future LLM-based synthesis planning.

作者 · Bogdan Zagribelnyy

在 arXiv 阅读

最新论文

全部论文 →

METAL MEDIA 最新报道