每天早上一封邮件,把昨天的 AI 梳理好订阅邮件

METAL LAB

Beyond Memory Majority: Latent-Source Reasoning for Multi-Agent Memory Arbitration

arXiv:2608.197012026-08-21

当多个AI智能体写下的记忆其实来自同一个源头,这个方法能防止系统被'虚假多数'骗过

在长期运行的多智能体AI系统中,不同智能体会把观察和结论写入共享记忆库,但看似来自不同智能体的记忆其实可能源自同一个上游信息,如果系统把它们当作独立证据简单投票或加权,就会重复计数,形成研究者称之为'记忆相关性偏差'的虚假多数问题。研究团队提出CAMA框架,通过识别记忆之间的隐藏重叠来估算真正独立的证据数量,并在证据不足时主动检索或追溯来源加以补充。在多个基准测试中,CAMA的表现全面优于现有最优方法。

他们做了什么

  1. 问题:现有方法把检索到的记忆当作彼此独立的证据,通过投票或加权合并,但不同智能体写下的记忆可能源自同一个上游来源,导致相关记忆被重复计数、制造出虚假的多数支持,即'记忆相关性偏差(Memory Correlation Bias)'
  2. 方法:CAMA用神经网络推断记忆之间在多大程度上共享同一潜在证据因素,并结合记录记忆来源的溯源信息(provenance)作为先验,估算出真正独立的证据数量;当证据不足时,系统学习一套策略,主动检索新证据或追溯记忆的上游来源来补齐
  3. 结果:在MemoryAgentBench、LongMemEval、LoCoMo三个基准和DeepSeek-V4-Flash、Qwen3.6-27B两种基础模型上测试,CAMA全面优于Vanilla RAG、多数投票、Mem0、HippoRAG以及多智能体方法MAD、MADAM-RAG等基线,在少数正确证据被大量重复记忆淹没的情况下仍能更好地找出正确答案,且面对冗余记忆增多时判断更稳定
  4. 效率:相比多智能体方法,CAMA所需的大模型调用次数和token消耗更少,但每消耗一定token带来的准确率提升更高,说明其性能提升来自结构化的证据推理,而非反复的智能体交互
Figure 1: An overview of our proposed CAMA. The diagram illustrates the overall workflow of memory arbitration, where retrieved memories are progressively processed through evidence decoupling, conflict arbitration, and evidence recovery.
Figure 1: An overview of our proposed CAMA. The diagram illustrates the overall workflow of memory arbitration, where retrieved memories are progressively processed through evidence decoupling, conflict arbitration, and evidence recovery.
Table 1: Overall performance comparison on three benchmark datasets. Best results are marked by bold.
BackboneMethodsMemoryAgentBenchLongMemEvalLOCOMO
FC-SHFC-MHOverallEMF1BERTJudgeEMF1BERTJudge
DeepSeek-V4-FlashVanilla RAG68.434.251.334.145.784.251.629.740.383.547.2
Majority Voting70.133.551.833.645.184.050.928.939.683.246.1
HippoRAG72.642.857.738.549.885.356.433.444.184.651.8
Mem073.944.559.240.251.685.758.135.846.785.254.3
MAD74.746.960.841.752.986.160.536.947.885.556.2
MADAM-RAG75.248.863.444.154.386.862.437.649.585.759.4
CAMA (Ours)78.955.767.349.859.187.969.243.653.887.164.7
Qwen3.6-27BVanilla RAG65.231.448.331.542.983.448.727.337.882.744.5
Majority Voting66.830.748.830.942.383.147.926.537.182.443.6
HippoRAG69.539.654.635.646.884.553.230.941.483.849.1
Mem071.041.356.237.448.784.955.333.243.984.451.7
MAD71.943.857.938.950.185.357.634.545.284.753.8
MADAM-RAG73.646.760.241.652.685.961.236.847.585.357.1
CAMA (Ours)76.553.264.947.456.987.267.041.551.686.562.4
Figure 2: Hyperparameter sensitivity analysis on MemoryAgentBench with DeepSeek-V4-Flash.
Figure 2: Hyperparameter sensitivity analysis on MemoryAgentBench with DeepSeek-V4-Flash.
Table 2: Evaluation of memory correlation bias mitigation under DeepSeek-V4-Flash.
MethodsMemoryAgentBenchLongMemEvalLOCOMO
CMR ↑RS ↓IEG ↑ERR ↑CMR ↑RS ↓IEG ↑ERR ↑CMR ↑RS ↓IEG ↑ERR ↑
Vanilla RAG38.741.25.85.336.943.55.14.633.445.84.43.9
Majority Voting33.544.84.74.931.846.94.24.228.749.33.53.5
HippoRAG46.827.411.69.844.229.110.58.940.531.69.17.7
Mem049.624.113.711.247.125.812.610.343.428.211.09.0
MAD54.319.215.912.651.820.714.511.447.622.912.810.1
MADAM-RAG60.715.319.414.158.216.618.112.953.918.516.211.5
CAMA (Ours)71.27.825.136.267.49.122.633.162.110.320.229.4
(b)
(b)
Table 3: Ablation study on the MemoryAgentBench and LongMemEval benchmarks under DeepSeek-V4-Flash.
MethodsMemoryAgentBenchLongMemEval
FC-SHFC-MHOverallCMRRSIEGERREMF1BERTJudgeCMRRSIEGERR
w/o Evi. Decoupling71.545.358.448.232.714.628.942.151.886.259.746.534.113.826.4
w/o Prov. Prior76.851.964.463.413.821.734.247.356.687.465.861.214.620.331.8
w/o Expand76.251.463.866.79.517.215.346.155.787.364.963.810.215.813.6
w/o Trace75.449.662.564.815.219.427.146.856.287.465.762.516.318.125.2
w/o Policy77.152.364.765.911.416.822.747.657.087.566.464.112.515.220.8
CAMA78.955.767.371.27.825.136.249.859.187.969.267.49.122.633.1
(c)
(c)
Table 4: Efficiency analysis on the MemoryAgentBench benchmark under DeepSeek-V4-Flash.
MethodsAvg. LatencyLLM CallsToken Cost (k)Context Len (k)Δ Acc./ kToken
Vanilla RAG1.81.03.23.1
Majority Voting4.65.012.83.10.04
HippoRAG3.22.05.94.41.08
MAD9.88.424.39.60.39
MADAM-RAG11.410.628.911.20.42
CAMA(Ours)6.74.214.66.81.10
(d)
(d)
Table 5: Evaluation of memory correlation bias mitigation under Qwen3.6-27B.
MethodsMemoryAgentBenchLongMemEvalLOCOMO
CMR ↑RS ↓IEG ↑ERR ↑CMR ↑RS ↓IEG ↑ERR ↑CMR ↑RS ↓IEG ↑ERR ↑
Vanilla RAG36.243.15.14.734.545.44.64.131.147.54.03.5
Majority Voting31.446.54.14.329.848.63.73.826.851.03.13.1
HippoRAG43.929.110.48.741.530.89.57.938.033.48.26.9
Mem046.725.712.310.144.427.411.49.340.829.89.98.2
MAD51.220.614.511.548.922.113.210.444.824.411.79.2
MADAM-RAG57.516.717.713.055.018.116.511.850.820.114.810.5
CAMA (Ours)68.18.623.434.064.310.021.131.059.011.218.827.5
Table 6: Ablation study on the MemoryAgentBench and LongMemEval benchmarks under Qwen3.6-27B.
MethodsMemoryAgentBenchLongMemEval
FC-SHFC-MHOverallCMRRSIEGERREMF1BERTJudgeCMRRSIEGERR
w/o Evi. Decoupling69.343.556.446.034.113.227.040.350.185.657.844.735.412.524.8
w/o Prov. Prior74.649.862.260.814.920.232.145.755.086.863.958.615.718.929.8
w/o Expand74.149.361.763.810.615.914.244.654.186.763.060.911.314.712.5
w/o Trace73.447.660.561.916.218.025.445.254.786.863.859.717.417.023.7
w/o Policy75.050.562.863.112.415.621.246.155.686.964.561.413.614.219.6
CAMA76.553.264.968.18.623.434.047.456.987.267.064.310.021.131.0
Table 7: Efficiency analysis on the MemoryAgentBench benchmark under Qwen3.6-27B.
MethodsAvg. LatencyLLM CallsToken Cost (k)Context Len (k)Δ Acc./ kToken
Vanilla RAG1.51.03.23.1
Majority Voting3.95.012.83.10.04
HippoRAG2.82.05.94.41.07
MAD8.38.424.39.60.40
MADAM-RAG9.710.628.911.20.41
CAMA(Ours)5.84.214.66.81.14

为什么重要

在智能体不断把决策结果写回共享记忆的长期系统中,一旦错误的重复记忆被误判为多数支持,错误就会被写回记忆库并不断自我强化,长期积累会造成持续性偏差。这项研究提供了一种在错误固化之前加以识别和纠正的实用思路,对构建需要可靠长期记忆的多智能体系统有参考价值。

本文术语

  • 记忆相关性偏差(Memory Correlation Bias) · 不同智能体写下的记忆实际共享同一来源,却被当作独立证据重复计数,从而制造虚假多数的现象
  • 溯源信息(provenance) · 记录一条记忆是从何处、经过怎样的过程产生的来源信息
  • CAMA(Correlation-Aware Memory Arbitration) · 本研究提出的方法,通过识别记忆间的隐藏关联估算独立证据数量,并在证据不足时主动补充证据后再做最终判断
  • 有效独立证据数(Neff) · 衡量检索到的记忆中实际包含多少条真正彼此独立的证据的指标
  • 恢复策略(recovery policy) · 在证据不足时,系统学习决定是继续检索新证据、追溯记忆来源,还是直接停止并给出结论的决策机制

论文原文摘要(英文)

Long-term multi-agent systems continuously accumulate the memories produced by different agents. Existing memory methods typically treat retrieved memories as independent evidence and combine them through voting or weighting. However, this independence assumption often fails in multi-agent settings: memories written by different agents may inherit the same upstream source or shared bias, causing correlated evidence to be repeatedly counted and creating a false majority. We term this failure mode \textit{Memory Correlation Bias}. To address the issue, we propose the \textbf{C}orrelation-\textbf{A}ware \textbf{M}emory \textbf{A}rbitration (CAMA) framework that jointly decouples retrieved memories and recovers missing independent evidence. We model the retrieved memories as query-conditioned evidence groups and combine neural dependency inference with provenance-based symbolic priors to estimate the effective number of independent evidence sources, thereby preventing correlated memories from forming a false majority. Since critical independent evidence may be absent from the initial retrieval set, \textsc{CAMA} further learns a sequential recovery policy that actively retrieves alternative evidence or traces upstream sources before making the final decision, aiming to recover sufficient independent evidence for reliable arbitration while minimizing retrieval cost. Experiments on multiple benchmarks demonstrate the superiority of our method over the state-of-the-art baseline methods, suppressing false majorities induced by correlated memories.

作者 · Chenchen Lin, Wenhao Yuan, Xuehe Wang, Edith Cheuk Han Ngai

在 arXiv 阅读

最新论文

全部论文 →

METAL LAB 最新报道

图片来源: Chenchen Lin et al., arXiv:2608.19701, arxiv-nonexclusive