每天早上一封邮件，把昨天的 AI 梳理好订阅邮件

METAL LAB

Scientific Data Skills: Enabling Agent-Ready Scientific Data Services at Scale

arXiv:2608.196252026-08-21

把科学数据集打包成AI智能体能直接读懂的说明书,让它们自己找数据、用数据

科学数据分散在各种仓库里,文档又是给人看的,导致AI智能体很难自主发现、理解并正确使用这些数据集。研究团队提出了Scientific Data Skill(SciDSK),一种把数据集描述、科学背景、文件结构、使用步骤、质量检查和来源信息打包成可复用智能体技能的标准格式,并配套构建流程和一个覆盖六个学科的在线平台Scientific Data Skill Bank。实验显示,使用SciDSK的智能体在数据集检索和内容解读上都比传统方式更准确。

他们做了什么

  1. 问题:科学数据分散在不同仓库中,配套文档主要面向人类读者,导致AI智能体难以自主发现相关数据集、理解文件结构、并将其正确用于具体任务
  2. 方案:SciDSK将数据集描述、科学背景、文件组织、操作指南、质量检查和来源信息整合进一个可复用的智能体技能包,原始数据仍保留在原仓库,只建立关联而不复制
  3. 结构:每个SciDSK用一个SKILL.md文件,包含供机器读取的YAML头信息(名称、描述、标识符等)用于发现,以及供解读的正文(数据概览、访问方式、字段说明、使用指南、质量检查、来源信息);通过三阶段流程构建并在发布前验证
  4. 平台:Scientific Data Skill Bank(scidsk.cn)在线发布覆盖物理学、化学、地球科学、生物学、材料科学、计算机科学六个学科的SciDSK资源,每个资源都分配持久标识符CSTR,可与原始数据集相互追溯
  5. 结果:在104条查询的检索基准测试中,使用已注册SciDSK技能的智能体(Agent-SciDSK)在所有指标上都优于传统元数据检索和把SciDSK当纯文本搜索的方式;在CT影像、人口密度地图、表格图片、社交媒体事件数据四个解读案例中,该方式满足24项评估标准中的23项,而传统数据集页面方式只满足22项
Figure 1: Key challenges in enabling AI agents to discover, interpret, and invoke scientific data.
Figure 1: Key challenges in enabling AI agents to discover, interpret, and invoke scientific data.
Table 1: Comparison of SciDK with existing dataset- and agent-oriented concepts.
Dataset MetadataDataset CardAgent SkillTool/MCPSciDSK(Ours)
Dataset description✓✓××✓
Scientific contextPartial✓Partial×✓
Task knowledge×Partial✓×✓
Operational guidance×Partial✓✓✓
Agent discoveryPartialPartial✓×✓
Dataset invocation××Partial✓✓
Figure 2: Schematic structure of a Scientific Data Skill.
Figure 2: Schematic structure of a Scientific Data Skill.
Table 2: Overall discovery performance on the test sets. All values are percentages, and the best result is shown in bold.
MethodHit@1Recall@5MRRnDCG@5
BM25-Raw47.1269.2357.5959.12
Agent-Raw71.1590.3879.0481.90
Agent-SciDSK-Text70.1990.3879.0181.92
Agent-SciDSK80.7794.2386.4188.40
Figure 3: Construction pipeline of a Scientific Data Skill.
Figure 3: Construction pipeline of a Scientific Data Skill.
Table 3: Results on the four dataset interpretation cases.
Evidence conditionCoverage (%)Satisfied criteria
ScienceDB page91.6722/24
Scientific Data Skill95.8323/24
Figure 4: The online Scientific Data Skill Bank, which can be visited at https://scidsk.cn/.
Figure 4: The online Scientific Data Skill Bank, which can be visited at https://scidsk.cn/.
Table 4: Comparison on the CT skull reconstruction case.
Evidence conditionTIFF sequence interpretationReported file-count handlingPre-use checksCoverage
Dataset information pageIncorrectly described the visible sequence as “200+ slices”Noted that the visible file tree may be incompleteProvided general checks for the image sequence and parameters5/6
Scientific Data SkillCorrectly identified 196 consecutive slicesDistinguished the reported total from the visible portion while preserving uncertaintySpecified continuity, non-empty-file, readability, parameter-file, and directory-completeness checks6/6
(b) Skill Discovery Page.
(b) Skill Discovery Page.
Table 5: Comparison on the Weibo rumor-event mapping case.
Evidence conditionFile organizationCross-file relationshipValidation checksCoverage
Dataset information pageIdentified events.txt as the label file and posts.zip as containing event-organized JSON contentLinked event identifiers to event-named JSON files but left corpus-wide completeness unresolvedSuggested general coverage and schema checks without explicit count and label-domain validation5/6
Scientific Data SkillIdentified 4,664 labeled events and clearly distinguished the roles of the two filesSpecified a one-to-one mapping between event records and event-named JSON filesRequired count validation, binary-label checks, archive extraction, orphan detection, and sampled content verification6/6
(c) Data Skill Detail Information.
(c) Data Skill Detail Information.

为什么重要

AI智能体要在科学研究中真正用上数据,必须先找到合适的数据集、正确理解每个文件的含义、并知道该如何规范使用,而现有文档体系在这三方面都支持不足。这项工作提供了一套具体的规范和可运行的平台,为让科学数据真正可被自主AI系统使用提供了实际的基础设施。

Figure 5: Human annotation interface for reviewing discovery benchmark queries.
Figure 5: Human annotation interface for reviewing discovery benchmark queries.

本文术语

  • AI智能体 · 能够自主规划并执行多步骤任务、常借助外部工具的AI系统
  • SciDSK(Scientific Data Skill) · 将数据集知识和使用方法打包成可供AI智能体复用的表示形式
  • 智能体技能(Agent Skill) · 为AI智能体提供特定任务知识和操作指南的模块化、可复用资源
  • FAIR原则 · 让数据可被发现、可访问、可互操作、可重用的数据管理准则
  • CSTR · 分配给资源的持久标识符,便于独立识别和引用

论文原文摘要（英文）

Scientific data are increasingly used by AI agents, yet existing dataset representations provide limited support for autonomous discovery, interpretation, and invocation. This limitation stems from the fragmentation of scientific data across heterogeneous repositories and from dataset representations designed primarily for human use. To address this limitation, we introduce the Scientific Data Skill (SciDSK), an agent-ready representation that packages dataset-specific knowledge and operational guidance as a reusable agent skill. A SciDSK integrates dataset descriptions, scientific context, file organization, usage procedures, quality checks, and provenance information while retaining the underlying data in its original repository. We define a structured SciDSK specification and develop a systematic construction pipeline that grounds each SciDSK in authoritative dataset records and associated supporting materials. We further establish the Scientific Data Skill Bank, a unified platform that publishes SciDSK resources across six scientific disciplines and supports package access, persistent identification, and traceability to source datasets. We evaluate SciDSK through a retrieval benchmark for dataset discovery and controlled cases for dataset interpretation. The results show that SciDSK improves agent-driven dataset discovery and provides more precise and actionable support for dataset interpretation. These findings support the value of organizing dataset-specific knowledge in an agent-ready representation.

作者 · Xiaohan Huang, Qingqing Long, Xiaolei Du, Siyu Pu, Jiawen Xu, Haotian Chen, Chenyang Zhao, Jinbiao Liu, Xuezhi Wang, Hao

在 arXiv 阅读

最新论文

全部论文 →

METAL LAB 最新报道

图片来源： Xiaohan Huang et al., arXiv:2608.19625, arxiv-nonexclusive