Everything K-culture — comebacks to K-beauty, straight to your inboxGet it in your inbox

METAL MEDIA

Training Chemical Plausibility-Aware Large Language Models for Single-Step Retrosynthesis

arXiv:2608.189402026-08-18

There's rarely just one right answer for how to make a molecule, and asking AI for 15 answers at once made it much better at chemistry

Predicting how to break a target molecule down into starting materials (retrosynthesis) genuinely has many valid solutions, but standard single-answer benchmarks miss this diversity. The researchers introduced 'Top-K prompting,' training and testing AI language models to produce 15 candidate answers at once, and built C3LM using a huge dataset of about 45.6 million verified chemical reactions. The resulting model outperformed established retrosynthesis software on a new, harder benchmark of unseen molecules.

METAL MEDIA explanatory visual

There's rarely just one right answer for how to make a molecule, and asking AI for 15 answers at once made it much better at chemistry

  1. 01Retrosynthesis, working backward from a drug candidate to available starting materials, naturally has multiple valid solutions per molecule, but conventional single-answer evaluation protocols fail to capture this one-to-many nature
  2. 02Instead of asking the model for just one answer (Top-1), the team trained and evaluated models using Top-K prompting, explicitly asking for 15 different plausible answers per molecule
  3. 03They built a huge new dataset called CREED-CCV-2+USPTO-XL with about 3.68 million unique products and roughly 45.6 million verified reactions, trained the C3LM model on it, and further fine-tuned it with reinforcement learning using a chemical-plausibility scoring tool (ChemCensor) plus a novelty reward
  4. 04C3LM beat leading conventional retrosynthesis tools like MHNreact and strong commercial AI models on the challenging out-of-distribution URSA-expert-2026 benchmark, and analysis showed AI models and conventional software tend to find different, complementary reactions -- suggesting combining both approaches could cover more chemical possibilities
An explanatory diagram made by METAL MEDIA, not a figure supplied by the paper's authors.

What they did

  1. Retrosynthesis, working backward from a drug candidate to available starting materials, naturally has multiple valid solutions per molecule, but conventional single-answer evaluation protocols fail to capture this one-to-many nature
  2. Instead of asking the model for just one answer (Top-1), the team trained and evaluated models using Top-K prompting, explicitly asking for 15 different plausible answers per molecule
  3. They built a huge new dataset called CREED-CCV-2+USPTO-XL with about 3.68 million unique products and roughly 45.6 million verified reactions, trained the C3LM model on it, and further fine-tuned it with reinforcement learning using a chemical-plausibility scoring tool (ChemCensor) plus a novelty reward
  4. C3LM beat leading conventional retrosynthesis tools like MHNreact and strong commercial AI models on the challenging out-of-distribution URSA-expert-2026 benchmark, and analysis showed AI models and conventional software tend to find different, complementary reactions -- suggesting combining both approaches could cover more chemical possibilities
Table 1: Plausibility-based evaluation in the single-step retrosynthesis Top-K mode. Max: per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC: per-TM average ChemCensor score over top-K unique predictions; ChemCensor v1.1.1, USPTO-full as the source of synthetic precedents. See the full table in Appendix F. Results for recently released models are available at https://dddbench.insilico.com/.
ModelURSA-expert-2026USPTO-50K-test-mini
MaxAv. PT-Top-K CCMaxAv. PT-Top-K CC
@3@5@10@3@5@10
Proprietary Foundation Models
Grok-4.11.861.561.310.863.992.612.021.24
Grok-4.31.741.411.130.663.992.581.951.15
Gemini 3.1 Pro1.911.691.461.084.322.922.341.59
GPT 5.41.190.780.550.292.341.431.020.55
GPT 5.51.941.681.461.054.503.072.451.63
Claude Opus 4.71.911.651.390.954.352.962.311.45
Claude Opus 4.81.891.621.340.854.352.952.301.44
Open-weight Foundation Models
Qwen 3.51.611.321.070.643.442.391.841.09
Kimi K2.51.681.381.130.693.652.431.861.10
GLM-51.220.970.750.422.161.391.030.58
Conventional SSRS Models
LocalRetro2.111.851.591.224.843.312.671.81
GLN1.961.721.491.034.803.182.521.58
MHNreact2.051.841.621.284.863.302.681.90
RetroKNN2.101.841.601.224.853.332.681.82
R-SMILES2.081.831.561.114.853.362.671.75
C3LM, Supervised Fine-Tuning, Top-1 Mode
C3LM-LFM2-CREED-CCV+USPTO*1.621.060.720.384.122.101.360.70
C3LM, Supervised and Reinforcement Learning Fine-Tuning, Top-K Mode
C3LM-LFM2-CREED-CCV+USPTO1.921.681.420.984.162.742.171.42
C3LM-LFM2-CREED-CCV-2+USPTO-XL2.041.811.591.274.162.882.371.70
C3LM-LFM2-RFT-CC2.081.881.651.294.162.922.411.73
C3LM-LFM2-RFT-CC-NR2.161.941.731.374.283.012.511.85
Chemical Plausibility and Diversity Frontier of Generated Reactions
All GP LLMs (17) together2.192.071.931.654.853.983.532.87
All conventional SSRS models (8) together2.181.991.781.454.903.583.002.26
Table 2: C3LM family inventory. TD-1 = CREED-CCV + USPTO; TD-2 = CREED-CCV-2 + USPTO-XL. ∗Trained in prior work (46); its predictions are re-scored under ChemCensor (v1.1.1) for comparison, without retraining.
Model NameShort NameTraining DataReward
C3LM, Supervised Fine-Tuning, Top-1 task
C3LM-LFM2-CREED-CCV+USPTO*C3LM-1TD-1
C3LM, Supervised Fine-Tuning, Top-K task
C3LM-LFM2-CREED-CCV+USPTOC3LM-2TD-1
C3LM-LFM2-CREED-CCV-2+USPTO-XLC3LM-3TD-2
C3LM, Reinforcement Learning Fine-Tuning, Top-K task
C3LM-LFM2-RFT-CCC3LM-4TD-2ChemCensor
C3LM-LFM2-RFT-CC-NRC3LM-5TD-2ChemCensor, Novelty
Table 4: Plausibility-based evaluation in the single-step retrosynthesis Top-1 mode. Max: per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC: per-TM average ChemCensor score over top-K unique predictions; ChemCensor v1.1.1.
ModelURSA-expert-2026USPTO-50K-test-mini
MaxAv. PT-Top-K CCMaxAv. PT-Top-K CC
@3@5@10@3@5@10
Proprietary Foundation Models
Grok-4.11.731.280.920.474.012.291.530.79
Grok-4.31.470.860.560.283.061.340.830.41
Gemini 3.1 Pro1.630.920.570.284.001.701.030.51
GPT 5.10.730.340.210.111.370.630.380.19
GPT 5.20.860.450.280.142.020.950.580.29
GPT 5.40.110.050.030.022.120.970.600.30
GPT 5.51.520.960.630.323.901.891.180.59
Claude Sonnet 4.51.440.860.560.283.341.671.050.52
Claude Sonnet 4.61.260.710.440.223.321.641.010.51
Claude Opus 4.51.310.680.420.213.331.540.940.47
Claude Opus 4.61.360.840.530.263.631.811.120.56
Claude Opus 4.71.671.040.660.333.721.791.120.56
Claude Opus 4.81.661.060.670.343.641.691.040.52
Open-weight Foundation Models
DeepSeek 3.20.390.160.090.051.140.440.260.13
Qwen 3.51.541.040.730.383.692.021.320.67
Kimi K2.51.470.980.640.333.731.851.160.58
GLM-51.030.490.290.153.671.921.230.62
LFM2 2.6B0.000.000.000.000.000.000.000.00
Table 5: Intersection of predicted reactions for URSA-expert-2026 benchmark set with the reference conventional model MHNreact. Δ is the per-target difference between the number of reactions unique to the model and those unique to MHNreact.
ModelIntersectionUnique for ModelUnique for MHNreactΔ
C3LM-LFM2-CREED-CCV-2+USPTO-XL5.06.86.4+0.4
C3LM-LFM2-RFT-CC-NR5.06.76.4+0.3
C3LM-LFM2-RFT-CC4.86.06.6-0.6
C3LM-LFM2-CREED-CCV+USPTO3.64.07.9-3.9
Gemini 3.1 Pro5.23.56.2-2.7
GPT 5.55.23.26.2-3.0
Grok-4.13.92.77.5-4.8
Claude Opus 4.74.52.66.9-4.3
Claude Opus 4.84.02.27.4-5.2
Qwen 3.52.72.08.7-6.7
Claude Opus 4.63.01.98.5-6.6
Grok-4.33.11.98.4-6.5
Kimi K2.53.11.98.4-6.5
Claude Sonnet 4.52.31.99.1-7.2
Claude Opus 4.52.71.88.7-6.9
GLM-52.31.49.2-7.8
C3LM-LFM2-CREED-CCV+USPTO*1.41.310.0-8.7
GPT 5.41.01.110.5-9.4
Claude Sonnet 4.61.60.89.8-9.0
GPT 5.20.30.611.1-10.5
GPT 5.10.30.511.1-10.6
DeepSeek 3.20.40.410.9-10.5
Table 6: Plausibility-based evaluation in the single-step retrosynthesis Top-K mode. Max: per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC: per-TM average ChemCensor score over top-K unique predictions; ChemCensor v1.1.1, ChemCensor-U2P2 reference database (USPTO-full ∪ Pistachio Q3 2023).
ModelURSA-expert-2026USPTO-50K-test-mini
MaxAv. PT-Top-K CCMaxAv. PT-Top-K CC
@3@5@10@3@5@10
Proprietary Foundation Models
Grok-4.12.171.811.541.064.132.842.271.46
Grok-4.32.021.621.320.824.142.812.191.35
Gemini 3.1 Pro2.201.931.681.294.423.122.561.83
GPT 5.10.690.400.270.141.410.790.540.28
GPT 5.20.510.330.240.151.610.990.710.40
GPT 5.41.370.970.710.392.501.621.190.66
GPT 5.52.281.941.681.274.603.262.681.86
Claude Sonnet 4.51.861.511.210.753.362.311.801.11
Claude Sonnet 4.61.170.900.700.423.132.071.570.92
Claude Opus 4.51.921.551.240.793.542.461.941.22
Claude Opus 4.61.951.591.290.833.962.772.191.37
Claude Opus 4.72.241.891.611.164.443.162.551.68
Claude Opus 4.82.171.851.541.024.453.172.551.68
Open-weight Foundation Models
DeepSeek 3.20.550.400.290.171.180.730.520.30
Qwen 3.51.911.541.260.813.612.612.071.29
Kimi K2.51.981.611.350.883.842.672.111.33
GLM-51.761.401.110.663.122.111.610.96
Conventional SSRS Models
LocalRetro2.382.111.841.414.883.492.872.02
GLN2.261.941.681.214.863.352.711.76
MEGAN2.341.951.611.094.853.342.671.72
Chemformer2.011.160.780.404.731.731.050.52
Graph2Edits2.382.051.731.224.863.182.461.55
MHNreact2.332.081.821.444.903.482.892.12
RetroKNN2.352.111.821.414.903.532.912.04
R-SMILES2.352.091.791.304.903.542.891.95
Table 7: Plausibility-based evaluation in the single-step retrosynthesis Top-K mode. Max: per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC: per-TM average ChemCensor score over top-K unique predictions; ChemCensor v0.5.2.
ModelURSA-expert-2026USPTO-50K-test-mini
MaxAv. PT-Top-K CCMaxAv. PT-Top-K CC
@3@5@10@3@5@10
Proprietary Foundation Models
Grok-4.11.901.591.330.884.042.712.131.33
Grok-4.31.801.451.160.694.022.652.031.22
Gemini 3.1 Pro1.961.721.491.114.352.972.421.66
GPT 5.10.610.350.230.121.310.720.480.25
GPT 5.20.430.280.200.121.530.920.650.36
GPT 5.41.230.810.570.302.401.501.080.59
GPT 5.51.981.711.481.084.513.152.551.72
Claude Sonnet 4.51.591.291.020.603.212.101.580.93
Claude Sonnet 4.61.040.790.610.352.981.921.420.81
Claude Opus 4.51.701.341.070.653.372.281.751.06
Claude Opus 4.61.731.391.130.703.822.612.021.23
Claude Opus 4.71.951.681.420.974.373.042.401.53
Claude Opus 4.81.931.661.380.884.373.032.401.51
Open-weight Foundation Models
DeepSeek 3.20.510.350.240.130.990.600.420.23
Qwen 3.51.631.331.070.643.492.461.921.16
Kimi K2.51.731.421.160.713.722.511.941.17
GLM-51.501.200.930.522.931.921.440.83
Conventional SSRS Models
LocalRetro2.141.871.611.234.823.352.731.88
GLN1.971.731.501.044.813.232.581.66
MEGAN2.031.761.501.014.823.262.591.67
Chemformer1.771.020.680.354.701.731.050.53
Graph2Edits2.111.811.541.094.803.122.401.51
MHNreact2.081.861.631.284.843.342.751.98
RetroKNN2.131.861.621.234.843.372.751.90
R-SMILES2.101.871.641.244.873.512.861.95

Why it matters

Retrosynthesis prediction is a core screening step for checking whether a proposed drug candidate can actually be synthesized in a lab, so improving how diverse and reliable this AI-based prediction is can reduce wasted effort early in drug discovery. The finding that AI models and traditional software explore different reaction spaces also points toward practical ensemble strategies that combine both for broader coverage.

Terms in this paper

  • Retrosynthesis · Working backward from a target molecule to figure out what starting materials and reactions could produce it
  • Top-K prompting · Asking an AI model to generate multiple distinct candidate answers in one go instead of just one
  • ChemCensor · A scoring tool that checks whether a generated chemical reaction is chemically plausible
  • GRPO (Group Relative Policy Optimization) · A reinforcement learning method that trains a model by comparing groups of candidate answers against each other
  • SMILES · A text-string notation used to represent chemical structures

Figures we cannot republish

  • Figure 1: Comparison of representative top-performing models from each model tier, normalized by metric-specific frontier scores.
  • Figure 2: Data-generation pipeline for the CREED-CCV-2+USPTO-XL training set.
  • Figure 3: Top-1 → Top-K transition on URSA-expert-2026 (Av. PT-Top-10 CC). Hollow = Top-1 task, filled = Top-K task; line length is the gain Δ=Top-K−Top-1 (right column, sorted).
  • Figure 4: Intersection between the reactions predicted for the URSA-expert-2026 benchmark set by each LLM and those predicted by MHNreact. Values on the right (Δ) show the average per-target difference between the number of reactions unique to the LLM and those unique to MHNreact; positive values indicate more LLM-unique reactions. C3LM-2: C3LM-LFM2-CREED-CCV+USPTO; C3LM-3: C3LM-LFM2-CREED-CCV-2+USPTO-XL; C3LM-5: C3LM-LFM2-RFT-CC-NR. See all results in Figure 5.
  • Figure 5: Intersection of reactions predicted by LLMs and the conventional SSRS model MHNreact. Values on the right show the difference between the number of reactions unique to the model and those unique to MHNreact (model − MHNreact). C3LM-1: C3LM-LFM2-CREED-CCV+USPTO*; C3LM-2: C3LM-LFM2-CREED-CCV+USPTO; C3LM-3: C3LM-LFM2-CREED-CCV-2+USPTO-XL; C3LM-4: C3LM-LFM2-RFT-CC; C3LM-5: C3LM-LFM2-RFT-CC-NR.
  • Figure 6: Intersection of reactions predicted for X404-1768-5005 by C3LM-LFM2-CREED-CCV-2+USPTO-XL and MHNreact.
  • Figure 7: Distribution of the number of reactant sets for products from USPTO-50K-test-mini. For each product, all reference reactant sets were retrieved by matching it against USPTO-full.
See the figures in the original paper →

Original abstract (English)

Single-step retrosynthesis is a central component of computer-aided synthesis planning, yet its intrinsically one-to-many nature is poorly captured by single-answer evaluation and benchmarking protocols. To address this, we introduce Top-K prompting as a robust training and inference paradigm to better capture diverse, plausible reaction predictions. We compile CREED-CCV-2+USPTO-XL, an ultra-large-scale dataset of ~45.6 million verified reactions to train the C3LM (Chemistry Constraint-Consistent Language Model). By integrating fine-tuning with ChemCensor-based and novelty-oriented rewards, our model achieves state-of-the-art performance on the OOD URSA-expert-2026 benchmark. Further analysis of reaction uniqueness shows that LLMs and conventional models explore complementary reaction spaces, motivating ensemble-based retrosynthesis systems. Overall, our results establish Top-K, plausibility-aware training as a practical new direction for robust future LLM-based synthesis planning.

Authors · Bogdan Zagribelnyy

Read on arXiv

Latest papers

All papers →

Latest from METAL MEDIA