K-文化的一切——从回归到 K-美妆，发送到您的邮箱订阅邮件

METAL MEDIA

Intern-S2-Preview: Scientific Agentic Foundation Model

arXiv:2608.135052026-08-12

一个3970亿参数的科学AI模型能同时处理文本、图像、时间序列并完成需要多步骤操作的长任务

Intern-S2-Preview是一个3970亿参数规模的科学智能体基础模型,设计目标是让模型同时理解科学文献中的文本、图像和数值时间序列,并借助工具完成需要长时间、多步骤推进的任务。训练流程先进行多模态预训练,再经过统一的后训练流程,依次包括监督微调、多任务强化学习、智能体强化学习以及在策略蒸馏。该模型在多个科学、多模态和智能体基准上取得有竞争力或领先的结果,一个独立的记忆扩展模块在不改动被冻结的3970亿参数主干的情况下,把Biology-Instructions平均分从56.92提升到60.32。

METAL MEDIA 解读图

Intern-S2-Preview-397B的结构与训练流程

证据状态已报告实测结果

  1. 多模态预训练在渲染的科学文档、图文交错数据以及多样化科学语料上学习,同时吸收文本与视觉结构信息
  2. 统一后训练流程监督微调之后依次进行多任务强化学习、白盒与黑盒智能体强化学习,最后通过在策略蒸馏汇合为一个模型
  3. 时间序列理解与预测模块在高效的长序列编码器基础上加入专门的数值预测分支来预测未来数值
  4. Memory Decoder(独立扩展模块)主干3970亿参数模型保持冻结,搭配领域训练的记忆模块,由路由器动态融合以实现针对性专精
  5. 多基准综合评测在科学、多模态、智能体、通用和时间序列等多个基准上验证,取得有竞争力或领先的结果
这是 METAL MEDIA 制作的解读图，并非论文作者提供的原图。

他们做了什么

  1. 科学信息往往分散在文本、图表、公式、页面排版和数值时间序列等多种形式中,该模型被设计成能同时处理这些异质证据,并在长任务过程中反复使用工具,而不是只回答孤立的问题。
  2. 训练先在渲染的科学文档、图文交错数据以及多样化科学语料上做预训练,再经过统一的后训练流程:监督微调、可扩展的多任务强化学习、白盒与黑盒智能体强化学习,最后用在策略蒸馏把各个专门策略的能力汇聚到一个统一模型中。
  3. 在架构层面,3970亿参数模型在原有的时间序列理解编码器之上加入了专门的数值预测分支;此外还单独研究了一个名为Memory Decoder(记忆解码器)的模块,它在保持3970亿主干冻结的前提下,通过附加外部记忆来实现对新科学领域的快速专精。
  4. 在科学、多模态、智能体和通用基准的综合评测中,该模型在多个场景下取得有竞争力或领先的成绩;在SciTS基准上时间序列理解和预测能力都有提升,而专门针对生物学训练的记忆扩展模块Intern-MemDec-4B在不修改被冻结的3970亿主干的情况下,把Biology-Instructions平均分从56.92提升到60.32。
Figure 1: Architecture of the separate Memory Decoder extension for Intern-S2-Preview-397B. The frozen Intern-S2-Preview-397B backbone and a domain memory process the same input in parallel and produce separate next-token distributions. A lightweight token-level router uses their hidden states and output-distribution uncertainty features to predict a dynamic fusion weight λ, which controls the contribution of the two distributions to the final prediction.
Figure 1: Architecture of the separate Memory Decoder extension for Intern-S2-Preview-397B. The frozen Intern-S2-Preview-397B backbone and a domain memory process the same input in parallel and produce separate next-token distributions. A lightweight token-level router uses their hidden states and output-distribution uncertainty features to predict a dynamic fusion weight λ, which controls the contribution of the two distributions to the final prediction.
Figure 2: Architecture of the time series modules for long-sequence understanding and numerical forecasting.
Figure 2: Architecture of the time series modules for long-sequence understanding and numerical forecasting.
Table 1: Public sources used to construct executable coding and terminal tasks.
ProviderCollection#Tasks#Environments
SWE-benchSWE-smith [93]59,136222
SWE-GymSWE-Gym [59]2,4382401
R2E-GymR2E-Gym-V1 [38]7,4808101
NebiusSWE-rebench-V2 [6]32,10032075
AweAI-TeamScale-SWE [104]20,20019472
NVIDIANemotron-Terminal-Synthetic-Tasks [60]80,0008
RUC-AIBOXClawGym-Task [7]13,5001
(b) Structure of the time series forecaster.
(b) Structure of the time series forecaster.
Figure 3: Overview of matched text and visual pre-training. The text pathway predicts tokens from parsed PDF content, whereas the visual pathway predicts foreground visual latents from rendered pages, improving alignment between textual and visual document representations.
Figure 3: Overview of matched text and visual pre-training. The text pathway predicts tokens from parsed PDF content, whereas the visual pathway predicts foreground visual latents from rendered pages, improving alignment between textual and visual document representations.
Table 4: Results of time series understanding on SciTS benchmark. F1 scores are reported. Higher F1 indicates better performance.
SciTS Task IDASU01ASU03BIU01BIU03EAU01MEU01NEU06PHU01PHU04RAU01RAU02
Text LLMGPT-4.1-mini67.215.60.212.767.044.016.124.052.724.610.6
Gemini2.5-Flash64.116.31.512.467.660.95.820.764.820.913.5
DeepSeek-V31.112.30.05.840.259.313.628.950.719.44.2
VL LLMGPT-5-mini65.718.90.817.967.630.413.321.447.824.39.1
Gemini2.5-Flash61.615.20.98.372.564.111.622.759.031.611.3
Intern-S1-Pro98.075.920.888.399.565.671.336.893.2--
Intern-S2-Preview-397B97.191.036.598.3100.081.870.266.999.988.460.2
Figure 4: Pipeline for producing the interleaved image-text pair data from PDF documents, including OCR and layout parsing, visual-unit cropping, visual-gain filtering, and document-level sequence assembly.
Figure 4: Pipeline for producing the interleaved image-text pair data from PDF documents, including OCR and layout parsing, visual-unit cropping, visual-gain filtering, and document-level sequence assembly.
Figure 6: Overview of the post-training pipeline for Intern-S2-Preview. The pretrained base model is first enhanced through supervised fine-tuning, followed by multi-task RLVR and black-box agentic RL for general and specialized capability improvement. On-policy distillation then consolidates the resulting scientific reasoning and agentic capabilities into a single unified model.
Figure 6: Overview of the post-training pipeline for Intern-S2-Preview. The pretrained base model is first enhanced through supervised fine-tuning, followed by multi-task RLVR and black-box agentic RL for general and specialized capability improvement. On-policy distillation then consolidates the resulting scientific reasoning and agentic capabilities into a single unified model.
Table 5: Results of time series forecasting on the SciTS benchmark, reported in the format MAPE (success rate %). Lower MAPE indicates better performance, while higher success rate is better.
SciTS Task IDENG02ENG03MEG03NEG03PHG02URG01URG05
Text LLMGPT-4.1-mini125.0 (1.4)8.3 (96.0)42.1 (49.6)95.2 (96.4)1.1e3 (94.2)320.6 (18.6)126.6 (100)
Gemini2.5-Flash72.5 (5.9)9.6 (99.0)62.2 (57.9)63.5 (99.2)110.8 (99.0)246.0 (23.3)98.6 (100)
DeepSeek-V3117.2 (46.1)7.7 (98.0)46.4 (30.9)4.3 (3.1)200.1 (92.2)350.0 (18.6)296.7 (93.0)
VL LLMGPT-5-mini56.1 (4.5)11.2 (76.0)37.6 (51.8)74.3 (97.2)155.3 (97.4)182.1 (58.1)71.1 (72.9)
Gemini2.5-Flash103.9 (7.4)15.6 (53.0)53.1 (37.2)–185.2 (36.9)351.9 (16.3)114.6 (91.2)
Time Series ModelsMoirai-Large [85]121.2 (100)12.8 (100)51.7 (100)59.1 (100)116.9 (100)294.7 (100)74.6 (100)
TimeMoE-Large [68]70.4 (100)11.6 (100)39.0 (100)70.1 (100)80.2 (100)218.4 (100)84.4 (100)
Chronos-bolt-Base [5]73.7 (100)12.0 (100)41.5 (100)78.5 (100)109.3 (100)139.3 (100)70.6 (100)
UniTS [31]70.1 (100)12.8 (100)42.0 (100)95.2 (46.4)135.9 (44.1)389.7 (100)–
TimeOmni [86]68.6 (100)7.4 (100)37.5 (100)78.7 (100)163.0 (100)247.0 (100)174.0 (100)
Intern-S2-Preview-397B60.2 (100)7.1 (100)32.8 (100)59.2 (100)72.2 (100)138.9 (100)60.6 (100)
Figure 7: Overview of our co-located partial-rollout system based on XTuner and LMDeploy. During rollout, completed requests are continuously replaced to keep the inference engine fully utilized. Once sufficient completed trajectories have been collected for one training batch, the remaining in-flight rollouts are paused and their generated prefixes are retained. The same GPUs then switch to policy training. After the training states are offloaded and the updated model weights are synchronized to the inference engine, the paused requests resume generation from their retained prefixes.
Figure 7: Overview of our co-located partial-rollout system based on XTuner and LMDeploy. During rollout, completed requests are continuously replaced to keep the inference engine fully utilized. Once sufficient completed trajectories have been collected for one training batch, the remaining in-flight rollouts are paused and their generated prefixes are retained. The same GPUs then switch to policy training. After the training states are offloaded and the updated model weights are synchronized to the inference engine, the paused requests resume generation from their retained prefixes.
Figure 8: Comparison of training with and without adaptive length penalty, showing similar reward curves and shorter outputs with regularization.
Figure 8: Comparison of training with and without adaptive length penalty, showing similar reward curves and shorter outputs with regularization.

研究结果

  • Intern-S2-Preview-397B在Biology-Instructions(56.92)、Mol-Instructions(52.37)和SciReasoner(63.97)上超过了强力的开源与闭源模型,并在内部的MP20和ProteinBinder-9评测集上取得了最好成绩。
  • 在MolecularIQ(61.49)、TOMG-Bench(65.66)、XLRS-Bench(51.97)和MicroVQA(68.81)上取得开源模型中的最佳成绩,同时在MMLU-Pro(89.75)、SimpleQA-Verified(69.90)、MMMU-Pro(80.46)和ChartQAPro(69.65)上也是开源模型中的最佳表现。
  • 在偏科学的智能体任务上普遍超过DeepSeek-V4-Pro和Qwen3.5-397B,仅次于GLM-5.2;在通用智能体任务上持续超过Qwen3.5-397B,表现与Kimi-K2.7-Code相当。
  • 在SciTS时间序列理解任务上持续超过通用文本大模型和视觉语言大模型;尽管参数量不到万亿参数级Intern-S1-Pro的一半,该模型在两者共有的九项任务中的七项上超过了它,其中PHU01任务的F1分数从36.8提升到66.9。
  • 专门为生物学训练的记忆扩展模块Intern-MemDec-4B在保持3970亿主干冻结的情况下,把Biology-Instructions平均分从56.92提升到60.32,同时在通用知识、推理和多模态基准上与主干模型表现接近,说明该模块能实现有针对性的专精而不带来明显副作用。
Figure 9: Overview of our agentic RL infrastructure. Heterogeneous white-box and black-box agents are unified by the Agent Gateway and execute against a shared sandbox and model-serving substrate. Semantic trajectories and verifier feedback are retained in the Replay Buffer, while the Rollout Trace Store preserves exact token-level evidence through a per-session incremental PrefixTree. Experience assembly aligns the two views for advantage estimation and policy optimization.
Figure 9: Overview of our agentic RL infrastructure. Heterogeneous white-box and black-box agents are unified by the Agent Gateway and execute against a shared sandbox and model-serving substrate. Semantic trajectories and verifier feedback are retained in the Replay Buffer, while the Rollout Trace Store preserves exact token-level evidence through a per-session incremental PrefixTree. Experience assembly aligns the two views for advantage estimation and policy optimization.
Figure 10: Self-evolving construction of general agentic tasks. Community skills are filtered and composed through compatible skill-state paths before stage-wise synthesis produces validated task bundles. Online and offline rollouts yield curated reusable trajectories, while execution failures update sampling and synthesis components to generate the next task distribution.
Figure 10: Self-evolving construction of general agentic tasks. Community skills are filtered and composed through compatible skill-state paths before stage-wise synthesis produces validated task bundles. Online and offline rollouts yield curated reusable trajectories, while execution failures update sampling and synthesis components to generate the next task distribution.

可应用场景

  • 需要同时理解科学文献中的图表、公式与文字的文献分析和问答系统
  • 希望在不重新训练整个主干模型的情况下,快速为特定领域(如生物学、化学、材料科学)补充专业知识的场景
  • 需要理解长时间序列数据并预测未来数值的天文学、地球科学、神经科学、生理信号分析或雷达信号分析等任务
  • 需要反复调用工具、经过多步骤才能完成的编程、终端操作和软件工程类智能体任务
Figure 11: Reward trajectories across SWE, general-purpose, and terminal tasks under multiple agent harnesses. Each panel presents a representative example over 160 optimization steps. Curves are locally smoothed to highlight the overall optimization trends.
Figure 11: Reward trajectories across SWE, general-purpose, and terminal tasks under multiple agent harnesses. Each panel presents a representative example over 160 optimization steps. Curves are locally smoothed to highlight the overall optimization trends.

局限与待验证事项

  • 作者将其称为预览系统,并指出在更长的科学工作流上提升可靠性、扩展领域专用记忆和任务环境、强化验证器以及深化与专业科学工具的整合都是未来工作。
  • Memory Decoder的研究只以生物学作为代表领域进行评测,是否在其他科学领域同样有效尚未得到验证。
  • 对Memory Decoder的跨领域评测只是检查其在通用基准上的表现是否与被冻结的主干接近,并不能排除在未测试领域中出现更细微副作用的可能。
  • 在通用时间序列预测基准GIFT-Eval上,该模型取得0.785的零样本MASE,论文只称其为具有竞争力,并未明确说明是否超过专门的预测模型。

为什么重要

真正的科学研究往往不是回答一道孤立的题目,而是要在混杂的证据之间持续推理、反复使用工具、经历很多步骤才能完成任务,这个模型试图用一个系统覆盖这整个流程。把可插拔的记忆模块接到被冻结的主干模型上以实现领域专精,也为团队提供了一种在不重新训练整个模型、也不损害其通用能力的前提下快速补充专业知识的实用思路。

本文术语

  • 智能体强化学习(agentic RL) · 让模型在使用工具、与环境交互并完成多步骤任务的过程中,依据奖励信号进行训练的方法
  • Memory Decoder(记忆解码器) · 附加在被冻结的主干模型之上、单独训练的模块,用于提供特定领域知识而不改变主干参数
  • 在策略蒸馏 · 把多个专门策略学到的能力汇总合并到一个统一模型中的训练步骤
  • 数值预测分支 · 不用文本词元生成数值,而是通过独立的神经网络路径直接预测未来数值,以保持数值精度
  • SciTS基准 · 用于评测模型理解和预测科学时间序列信号能力的基准测试

无法转载的图表

  • Figure 5: The pipeline of the image retrieval process, including image encoding, vector database construction, and online text-to-image and image-to-image retrieval with post-processing.
在原文中查看图表 →

论文原文摘要（英文）

Scientific discovery increasingly requires AI systems that can reason over scientific evidence of heterogeneous modalities, interact with scientific tools and environments, and sustain progress across long task horizons. We present Intern-S2-Preview, a series of scientific agentic foundation models designed to support multimodal scientific understanding, reasoning, generation, and long-horizon tasks. The training pipeline begins with scientific multimodal pre-training over rendered scientific documents, interleaved image-text data, and diverse scientific corpora. Starting from the pretrained checkpoint, we apply a unified post-training pipeline consisting of supervised fine-tuning, scalable multi-task reinforcement learning (RL), black- and white-box agentic RL, and on-policy distillation. This pipeline is supported by practical techniques that improve rollout and training stability and efficiency, including partial rollout with off-policy correction, adaptive length regularization, online speculative decoding, robust multi-task optimization, and trace-aware experience assembly for agentic tasks. At the architecture level, Intern-S2-Preview-397B extends time series modelling from efficient long-sequence understanding to numerical forecasting, while Memory Decoder is studied as a separate memory-augmented path for rapid scientific specialization without modifying the frozen 397B backbone. Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings. The time series modules improve scientific signal understanding and forecasting on SciTS, while the separate Intern-MemDec-4B extension improves the Biology-Instructions average score from 56.92 to 60.32 without modifying the frozen 397B backbone.

作者 · Lei Bai

在 arXiv 阅读

最新论文

全部论文 →

METAL MEDIA 最新报道

图片来源： Lei Bai et al., arXiv:2608.13505, CC BY 4.0