Automated Summarization of Financial News Using Large Language Models and Retrieval-Augmented Generation: An Early Empirical Study (Fall 2023)

arXiv:2608.195262026-08-21

用AI总结股市新闻发现:简单的摘要方法反而比时髦的检索增强技术更靠谱

这项2023年秋季在乔治华盛顿大学完成的项目搭建了一套系统,从新闻、维基百科和股价数据中提取十家大公司的信息,再用大语言模型自动生成摘要。结果显示,开源模型Falcon-7B搭配简单的“分块汇总(Summarize Chains)”方法效果最好,而现在流行的检索增强生成(RAG)技术反而导致内容重复或凭空捏造事实。把股价数字提前转换成自然语言句子再交给GPT处理,则完全避免了计算错误。

论文原文摘要（英文）

Stock market analysts and investors face a daily challenge: too much financial news, too little time. Manually reading and synthesizing hundreds of company-specific articles is impractical, yet missing key information can directly affect investment decisions. This project, conducted at George Washington University in Fall 2023, explores whether Large Language Models can automate this process reliably. We built a pipeline that pulls news articles from the News API, company background from Wikipedia, and stock price data from Yahoo Finance for ten major companies (AAPL, MSFT, GOOGL, AMZN, META, TSLA, JPM, NVDA, WMT, DIS). Because LLMs cannot directly process numerical tables, we developed a simple but effective template that converts stock data into natural language narratives. We then tested two summarization approaches (Summarize Chains and Retrieval-Augmented Generation with FAISS) across three open-source models (Falcon-7B-Instruct, DistilBART-CNN-12-6, BART-Large-XSum) for news, and GPT (text-davinci-003) for stock summaries. Falcon-7B with Summarize Chains gave the best results, covering all news events accurately and coherently. RAG, while promising in theory, caused severe repetition in Falcon and hallucinated facts in BART-Large when k was large. Both LLM-based approaches outperformed a simple Lead-3 baseline on ROUGE-1. We also built a Streamlit dashboard for interactive stock visualization. The work was done in Fall 2023, before RAG-based financial tools became widespread, and the failure modes we document, particularly hallucination under RAG in smaller models, remain relevant today.

作者 · Pranav Chandaliya