Everything K-culture — comebacks to K-beauty, straight to your inboxGet it in your inbox

METAL MEDIA

Scientific Data Skills: Enabling Agent-Ready Scientific Data Services at Scale

arXiv:2608.196252026-08-21

Packaging scientific datasets as ready-to-use 'skill' files so AI agents can find and understand them on their own

AI agents struggle to find, understand, and use scientific datasets because the data are scattered across many repositories and documented mainly for human readers. The researchers built the Scientific Data Skill (SciDSK), a standardized package combining dataset descriptions, file structure, usage steps, quality checks, and provenance, along with a pipeline to build it and an online platform, the Scientific Data Skill Bank, hosting resources across six scientific fields. In tests, agents using SciDSK found relevant datasets more accurately and interpreted their contents more precisely than agents using conventional dataset records.

METAL MEDIA explanatory visual

Packaging scientific datasets as ready-to-use 'skill' files so AI agents can find and understand them on their own

  1. 01Problem: scientific data are fragmented across many repositories and documented for humans, making it hard for AI agents to autonomously discover datasets, understand their file structure, and apply them correctly to a task
  2. 02Solution: SciDSK bundles dataset description, scientific context, file organization, usage procedures, quality checks, and provenance into one reusable 'agent skill' package, while the actual data stays in its original repository and is only linked, not copied
  3. 03Design: each SciDSK uses a SKILL.md file with a machine-readable YAML header (name, description, identifiers) for discovery, plus a human-readable body (overview, access steps, field details, usage guidance, quality checks, provenance) for interpretation, built through a three-stage pipeline grounded in authoritative source materials and checked before publication
  4. 04Platform: the Scientific Data Skill Bank (scidsk.cn) publishes curated SciDSK resources across six disciplines -- physics, chemistry, earth sciences, biology, materials science, and computer science -- each assigned a persistent identifier (CSTR) that traces back to its source dataset
  5. 05Results: on a 104-query retrieval benchmark, an agent using registered SciDSK skills (Agent-SciDSK) beat conventional metadata search and plain-text SciDSK search on every metric; in four interpretation case studies covering CT scans, population-density maps, table images, and social-media event data, it satisfied 23 of 24 evaluation criteria versus 22 for the conventional dataset-page approach
An explanatory diagram made by METAL MEDIA, not a figure supplied by the paper's authors.

What they did

  1. Problem: scientific data are fragmented across many repositories and documented for humans, making it hard for AI agents to autonomously discover datasets, understand their file structure, and apply them correctly to a task
  2. Solution: SciDSK bundles dataset description, scientific context, file organization, usage procedures, quality checks, and provenance into one reusable 'agent skill' package, while the actual data stays in its original repository and is only linked, not copied
  3. Design: each SciDSK uses a SKILL.md file with a machine-readable YAML header (name, description, identifiers) for discovery, plus a human-readable body (overview, access steps, field details, usage guidance, quality checks, provenance) for interpretation, built through a three-stage pipeline grounded in authoritative source materials and checked before publication
  4. Platform: the Scientific Data Skill Bank (scidsk.cn) publishes curated SciDSK resources across six disciplines -- physics, chemistry, earth sciences, biology, materials science, and computer science -- each assigned a persistent identifier (CSTR) that traces back to its source dataset
  5. Results: on a 104-query retrieval benchmark, an agent using registered SciDSK skills (Agent-SciDSK) beat conventional metadata search and plain-text SciDSK search on every metric; in four interpretation case studies covering CT scans, population-density maps, table images, and social-media event data, it satisfied 23 of 24 evaluation criteria versus 22 for the conventional dataset-page approach
Figure 1: Key challenges in enabling AI agents to discover, interpret, and invoke scientific data.
Figure 1: Key challenges in enabling AI agents to discover, interpret, and invoke scientific data.
Table 1: Comparison of SciDK with existing dataset- and agent-oriented concepts.
Dataset MetadataDataset CardAgent SkillTool/MCPSciDSK(Ours)
Dataset description✓✓××✓
Scientific contextPartial✓Partial×✓
Task knowledge×Partial✓×✓
Operational guidance×Partial✓✓✓
Agent discoveryPartialPartial✓×✓
Dataset invocation××Partial✓✓
Figure 2: Schematic structure of a Scientific Data Skill.
Figure 2: Schematic structure of a Scientific Data Skill.
Table 2: Overall discovery performance on the test sets. All values are percentages, and the best result is shown in bold.
MethodHit@1Recall@5MRRnDCG@5
BM25-Raw47.1269.2357.5959.12
Agent-Raw71.1590.3879.0481.90
Agent-SciDSK-Text70.1990.3879.0181.92
Agent-SciDSK80.7794.2386.4188.40
Figure 3: Construction pipeline of a Scientific Data Skill.
Figure 3: Construction pipeline of a Scientific Data Skill.
Table 3: Results on the four dataset interpretation cases.
Evidence conditionCoverage (%)Satisfied criteria
ScienceDB page91.6722/24
Scientific Data Skill95.8323/24
Figure 4: The online Scientific Data Skill Bank, which can be visited at https://scidsk.cn/.
Figure 4: The online Scientific Data Skill Bank, which can be visited at https://scidsk.cn/.
Table 4: Comparison on the CT skull reconstruction case.
Evidence conditionTIFF sequence interpretationReported file-count handlingPre-use checksCoverage
Dataset information pageIncorrectly described the visible sequence as “200+ slices”Noted that the visible file tree may be incompleteProvided general checks for the image sequence and parameters5/6
Scientific Data SkillCorrectly identified 196 consecutive slicesDistinguished the reported total from the visible portion while preserving uncertaintySpecified continuity, non-empty-file, readability, parameter-file, and directory-completeness checks6/6
(b) Skill Discovery Page.
(b) Skill Discovery Page.
Table 5: Comparison on the Weibo rumor-event mapping case.
Evidence conditionFile organizationCross-file relationshipValidation checksCoverage
Dataset information pageIdentified events.txt as the label file and posts.zip as containing event-organized JSON contentLinked event identifiers to event-named JSON files but left corpus-wide completeness unresolvedSuggested general coverage and schema checks without explicit count and label-domain validation5/6
Scientific Data SkillIdentified 4,664 labeled events and clearly distinguished the roles of the two filesSpecified a one-to-one mapping between event records and event-named JSON filesRequired count validation, binary-label checks, archive extraction, orphan detection, and sampled content verification6/6
(c) Data Skill Detail Information.
(c) Data Skill Detail Information.

Why it matters

For AI agents to be useful in data-driven scientific research, they need to find the right dataset, correctly interpret what each file means, and know how to use it properly -- something existing documentation was not built to support. This work offers both a concrete specification and a working platform that could serve as real infrastructure for making scientific data usable by autonomous AI systems.

Figure 5: Human annotation interface for reviewing discovery benchmark queries.
Figure 5: Human annotation interface for reviewing discovery benchmark queries.

Terms in this paper

  • AI agent · an AI system that can plan and carry out multi-step tasks autonomously, often using external tools
  • SciDSK (Scientific Data Skill) · a packaged representation bundling a dataset's knowledge and usage instructions for reuse by AI agents
  • Agent Skill · a modular, reusable package that gives an AI agent task-specific knowledge and instructions
  • FAIR principles · guidelines making data Findable, Accessible, Interoperable, and Reusable
  • CSTR · a persistent identifier assigned to a resource so it can be independently identified and cited

Original abstract (English)

Scientific data are increasingly used by AI agents, yet existing dataset representations provide limited support for autonomous discovery, interpretation, and invocation. This limitation stems from the fragmentation of scientific data across heterogeneous repositories and from dataset representations designed primarily for human use. To address this limitation, we introduce the Scientific Data Skill (SciDSK), an agent-ready representation that packages dataset-specific knowledge and operational guidance as a reusable agent skill. A SciDSK integrates dataset descriptions, scientific context, file organization, usage procedures, quality checks, and provenance information while retaining the underlying data in its original repository. We define a structured SciDSK specification and develop a systematic construction pipeline that grounds each SciDSK in authoritative dataset records and associated supporting materials. We further establish the Scientific Data Skill Bank, a unified platform that publishes SciDSK resources across six scientific disciplines and supports package access, persistent identification, and traceability to source datasets. We evaluate SciDSK through a retrieval benchmark for dataset discovery and controlled cases for dataset interpretation. The results show that SciDSK improves agent-driven dataset discovery and provides more precise and actionable support for dataset interpretation. These findings support the value of organizing dataset-specific knowledge in an agent-ready representation.

Authors · Xiaohan Huang, Qingqing Long, Xiaolei Du, Siyu Pu, Jiawen Xu, Haotian Chen, Chenyang Zhao, Jinbiao Liu, Xuezhi Wang, Hao

Read on arXiv

Latest papers

All papers →

Latest from METAL MEDIA

Figures: Xiaohan Huang et al., arXiv:2608.19625, arxiv-nonexclusive