每天早上一封邮件，把昨天的 AI 梳理好订阅邮件

METAL LAB

Automatic bioinformatic software named entity recognition from literature

arXiv:2608.192012026-08-21

新AI工具能自动从生物学论文中识别出软件和数据库的名字

生物学论文里经常提到BLAST、KEGG这类软件和数据库,但它们的名字写法五花八门,还常常和普通单词撞脸,人工或传统方法很难大规模自动识别。堪萨斯大学团队开发了SNAIL,把能读懂上下文的语言模型和分析拼写规律的分类器结合起来,并用论文引用线索加上大语言模型生成的例句自动构建训练数据,省去了大量人工标注。在两个独立测试集和真实论文上,SNAIL的表现明显超过了现有方法以及ChatGPT、Gemini、Grok、Claude等通用大模型。

他们做了什么

  1. 生物信息学软件和数据库名称层出不穷,还常常用普通单词或缩写命名(比如blast、grasp),仅靠词典匹配根本抓不住新出现或有歧义的名字
  2. SNAIL结合了基于SciBERT读取上下文语义的模块和基于XGBoost分析大小写、缩写等拼写特征的模块,训练时还故意遮住目标词本身,逼模型只靠上下文做判断
  3. 训练数据不是靠人工逐条标注,而是通过论文引用线索自动提取,再加上ChatGPT生成的例句合并而成,最终获得超过13万个正例标注,不依赖大规模人工标注
  4. 在两个基准数据集上平均F1得分超过80%,远超已有方法bioNerDS2(35%)以及ChatGPT(66%)、Gemini(49%)、Grok(58%)、Claude(28%)
  5. 处理一篇约6000词的论文只需大约一分钟,借此分析了2000篇论文,发现不同期刊对KEGG、GO、PDB等工具的偏好明显不同
Fig. 1. Overview of the automated training corpus generation framework. The workflow construction integrates literature mining with generative data augmentation. software/database (SW/DB) references are isolated and validated using publication metadata. (B) LLM-assisted generation. Tailored prompts guide a large language model to distill diverse positive and negative training examples from the ext
Fig. 1. Overview of the automated training corpus generation framework. The workflow construction integrates literature mining with generative data augmentation. software/database (SW/DB) references are isolated and validated using publication metadata. (B) LLM-assisted generation. Tailored prompts guide a large language model to distill diverse positive and negative training examples from the ext
Fig. 2. Hybrid architectural design of the SNAIL framework. The framework combines semantic and lexical processing tracks for token-level prediction. The semantic stream (SNAIL-semantic) processes text embeddings through an MLP, while the lexical stream (SNAIL-lexical) routes engineering features through XGBoost. Output vectors from both streams are integrated via a late-fusion layer.
Fig. 2. Hybrid architectural design of the SNAIL framework. The framework combines semantic and lexical processing tracks for token-level prediction. The semantic stream (SNAIL-semantic) processes text embeddings through an MLP, while the lexical stream (SNAIL-lexical) routes engineering features through XGBoost. Output vectors from both streams are integrated via a late-fusion layer.
Table 1: A summary of all features used in the SNAIL-lexical model. Features are grouped into lexical, syntactic, and dictionary-based categories, capturing naming patterns, contextual cues, and prior knowledge of bioinformatics software and databases (SW/DB).
FeatureCategoryExample/Note
Upper-caseLexicalBLAST, PDB
Lower-caseLexicalblastp, nr, nt
Mixed-casedLexicaledgeR, DESeq2
Hearst patternSyntactic“…tools such as BLAST…”
EnumerationSyntactic“…such as BWA, Bowtie, and SOAP…”
Good headwordDict. Matchdatabase, tools
Weak headwordDict. Matchplatform, interface
Blacklist headwordDict. Matchalgorithm, method
BioconductorDict. Matcha list of known Bioconductor packages
Known SW/DBDict. Matcha list of known bioinformatic SW/DB NEs
Biological acronymsDict. Matcha list of biochemical reagents
English wordsDict. Matcha list of English words
English acronymsDict. Matcha list of English acronyms
Fig. 3. Model selection, ablation analysis, and integration of SNAIL components across datasets and training strategies on DS1. (A) Comparison of lexical classifiers for SNAIL-lexical. Models include support vector machine (SVM), logistic regression (LR), random forest (RF), multilayer perceptron (MLP), and extreme gradient boosting (XGBoost, XGB). Black dots indicate the selected lexical classifi
Fig. 3. Model selection, ablation analysis, and integration of SNAIL components across datasets and training strategies on DS1. (A) Comparison of lexical classifiers for SNAIL-lexical. Models include support vector machine (SVM), logistic regression (LR), random forest (RF), multilayer perceptron (MLP), and extreme gradient boosting (XGBoost, XGB). Black dots indicate the selected lexical classifi
Fig. 4. Benchmarking of SNAIL against existing methods and large language models for bioinformatics named entity recognition. (A) Performance comparison on benchmark datasets. Precision, recall, and F1-score of SNAIL and bioNerDS2 evaluated on DS1. Error bars indicate standard deviation across cross-validation folds. (B) Comparison with large language models (LLMs) on two full-text articles (PMC60
Fig. 4. Benchmarking of SNAIL against existing methods and large language models for bioinformatics named entity recognition. (A) Performance comparison on benchmark datasets. Precision, recall, and F1-score of SNAIL and bioNerDS2 evaluated on DS1. Error bars indicate standard deviation across cross-validation folds. (B) Comparison with large language models (LLMs) on two full-text articles (PMC60

为什么重要

生物信息学工具和数据库更新太快,没有一份持续维护的完整目录,导致研究者可能一直用着过时的流程或错过更好的工具。像SNAIL这样准确又高效的识别工具,能支撑持续更新的工具目录建设,帮助研究者做出更有依据的工具选择。

Fig. 5. Large-scale literature mining reveals correlations between tool usage and citation impact, and journal-specific preferences in bioinformatics resources. (A) Correlation between mention frequency and citation counts. Each point represents a bioinformatics software or database identified by SNAIL across 2,000 articles from ten journals. (B) Journal-level clustering based on tool usage profil
Fig. 5. Large-scale literature mining reveals correlations between tool usage and citation impact, and journal-specific preferences in bioinformatics resources. (A) Correlation between mention frequency and citation counts. Each point represents a bioinformatics software or database identified by SNAIL across 2,000 articles from ten journals. (B) Journal-level clustering based on tool usage profil
Automatic bioinformatic software named entity recognition from literature figure 5

本文术语

  • 命名实体识别(NER) · 自然语言处理中自动从文本里找出特定类别名称(如人名、软件名)的技术
  • SciBERT · 在科学文献上预训练的BERT类语言模型,能捕捉词句的上下文含义
  • XGBoost · 一种把多棵决策树组合起来做预测的机器学习算法
  • 词元遮蔽 · 训练时故意隐藏目标词本身,迫使模型依靠周围上下文而非死记单词拼写来判断
  • F1分数 · 综合衡量准确率和查全率的模型评价指标,数值越接近100表现越好
Automatic bioinformatic software named entity recognition from literature figure 6

论文原文摘要（英文）

Bioinformatics software and databases are essential components of modern life science research, yet their mentions in the scientific literature are often inconsistent and difficult to systematically identify at scale. The lack of a comprehensive and up-to-date catalog of bioinformatics resources hinders efforts toward automated biomedical knowledge extraction and streamlined data analysis. Here we present SNAIL, a hybrid named entity recognition framework designed to automatically identify bioinformatics software and database (SW/DB) names from biomedical texts. SNAIL integrates complementary lexical and semantic modeling strategies. The lexical component captures orthographic patterns and contextual cues characteristic of SW/DB names, while the semantic component leverages contextual embeddings generated by transformer-based language models such as SciBERT, combined with an explicit token-masking strategy to enhance entity-focused representations. A large training corpus was constructed automatically through a hybrid pipeline that integrates citation-hinted extraction with large language model-assisted distillation. Evaluation on two independent benchmark datasets and real-world research articles demonstrates that SNAIL substantially outperforms existing approaches, including domain-specific methods such as bioNerDS2 and general-purpose large language models such as ChatGPT, Gemini, Grok and Claude. Applying SNAIL to large-scale literature analysis further reveals distinct journal-level preferences across bioinformatics subfields. These results demonstrate that SNAIL provides an accurate and scalable solution for identifying bioinformatics resources in scientific texts and enables systematic meta-analysis of tool usage and research trends.

作者 · Hao Xuan, Rithvij Pasupuleti, Ben Liu, Haishuo Sun, Jun Zhang, Zijun Yao, Cuncong Zhong

在 arXiv 阅读

最新论文

全部论文 →

METAL LAB 最新报道

图片来源： Hao Xuan et al., arXiv:2608.19201, arxiv-nonexclusive