每天早上一封邮件，把昨天的 AI 梳理好订阅邮件

METAL LAB

Interrupting the Loop: Periodic Subject Changes Raise Judged Surprise and Connection in Base Language Models

arXiv:2608.198932026-08-21

让基础语言模型在没有任何任务的情况下自说自话,但每隔几百个词硬塞进一个新话题,会让它的文字显得更出人意料、更有内在联系

研究者只给基础语言模型一句开头,不给任何指令,强迫它连续生成数千个词元,并在24种不同干预条件下进行对比。结果显示,效果几乎全部来自两个简单操作:抑制字面重复的机制,以及每隔几百个词元偷偷插入一个全新主题句子,其中插入新主题的操作贡献更大,显著提高了被判定的惊讶感和联系感得分。研究还发现并修正了AI评判者在阅读长文本时的盲点,比如把实验者插入的句子误判为模型自己写的,或把模型重复自己早先内容误判为新颖。

他们做了什么

  1. 给三个基础语言模型(仅经过预训练、未经指令微调)一句开场白,不设任何任务,强迫其连续生成4500个词元
  2. 在结合重复抑制机制(habituation)与周期性隐藏插入新主题(interruption)的24种条件中,插入新主题使被判定的惊讶感提高1.2到1.4分,联系感提高0.8分,效果超过仅用重复抑制
  3. 要求延续话题的连接词反而拉低了分数,单纯的分段在新文本上没有可检测的效果,重置上下文的效果不逊于保留上下文
  4. 研究发现AI评判者有时会把实验者插入的句子误判为模型自己写的,也会把模型在评判者看不到的范围之外重复自己早先内容误判为真正的惊讶与联系,研究据此修正了评估流程
  5. 在一个可验证的问题(在线装箱问题)上,同样的插入新主题操作使有效且互不相同的候选方案数量提高了三到四倍,但并未提升最优方案的质量
Figure 2: Habituation and interruption: bare, bare + habituation, interruption without habituation, habituation + interruption 150, the full scaffold, and the two habituation baselines (stronger penalty; EOS allowed). One point per premise, grey lines join the same premise across arms, bars are cell means with 95% bootstrap CIs over cells (Qwen3-30B-A3B, generated-only windows).
Figure 2: Habituation and interruption: bare, bare + habituation, interruption without habituation, habituation + interruption 150, the full scaffold, and the two habituation baselines (stronger penalty; EOS allowed). One point per premise, grey lines join the same premise across arms, bars are cell means with 95% bootstrap CIs over cells (Qwen3-30B-A3B, generated-only windows).
Figure 3: Where the stream goes: trajectories in sentence-embedding space (64-token windows, one PCA per seed), seed 6. ⋆ premise, ∘ start, × reseed, ⋄ judged event sized by surprise. Bare makes one jump and freezes; the scaffold orbits and returns; the clock reseed jumps across the space keeping its context.
Figure 3: Where the stream goes: trajectories in sentence-embedding space (64-token windows, one PCA per seed), seed 6. ⋆ premise, ∘ start, × reseed, ⋄ judged event sized by surprise. Bare makes one jump and freezes; the scaffold orbits and returns; the clock reseed jumps across the space keeping its context.
Figure 4: Content of the interruption at period 150: neutral change, re-encounter stitch, the premise itself, the stream’s own past. Injecting a return is as bad as not interrupting.
Figure 4: Content of the interruption at period 150: neutral change, re-encounter stitch, the premise itself, the stream’s own past. Injecting a return is as bad as not interrupting.
Table 1: Conditions: the habituation × interruption factorial with its baselines (top), the content and timing arms, the boundary and context controls, and the judge-gated arm (bottom). Ten premises each, 4,500 tokens per cell, main generator Qwen3-30B-A3B-Base; the ladder bare / habituation / habituation + interruption 150 / scaffold is replicated on Qwen3-8B-Base and OLMo-2-13B.
armhabituationinterruption
bareoffnone: continuous generation, EOS masked
bare + habituationonnone
habituation, EOS allowedonnone; the model may emit end-of-text and start a new document
habituation 1.3on (stronger)none
interruption, no habituationoffneutral subject change every 150 or 300 tokens, context preserved
habituation + interruption 150onneutral subject change every 150 tokens, context preserved
salience onlyonnone; salience events mark review windows
DREAM scaffoldonfull scaffold: salience, in-loop judge, kick, reseed with forgetting, re-encounter
content: re-encounter / premise / own pastonevery 150 tokens: a return-to-the-premise stitch / the premise itself / a window of the stream’s own past (≥400 tokens back)
salience: re-encounteronthe stitch injected on each salience event, no judge gate
period 75 / 300 / 600 / 900onneutral subject change at other periods (900 also with the stitch)
sham break 300ona paragraph break (“\n\n”) every 300 tokens, nothing else
sham continuity 300on“And so, as before,” every 300 tokens: a boundary that asks for continuity
reset + subject change 300onneutral subject change every 300 tokens on a reset context (premise + injected sentence only)
reset + break 300ona paragraph break every 300 tokens on a reset context
judge-gated 150onthe neutral change every 150 tokens unless Opus reads the last 128 tokens as a find (surprise and coherence ≥5), which is left to run
Figure 5: When to interrupt: the re-encounter stitch on the clock (150 and 900), the neutral change every 900, the stitch on salience events, and salience only (nothing injected). Post-interruption windows; one point per premise.
Figure 5: When to interrupt: the re-encounter stitch on the clock (150 and 900), the neutral change every 900, the stitch on salience events, and salience only (nothing injected). Post-interruption windows; one point per premise.
Figure 6: Period of the neutral change: the post-interruption window (32–128 generated tokens after the injection) at periods 150, 300, 600 and 900; one point per premise.
Figure 6: Period of the neutral change: the post-interruption window (32–128 generated tokens after the injection) at periods 150, 300, 600 and 900; one point per premise.
Figure 7: Decay: cell-mean surprise of generated-only windows by tokens since the injection, per period.
Figure 7: Decay: cell-mean surprise of generated-only windows by tokens since the injection, per period.
Table 2: The ladder on three generator models from two families: judged surprise (S), connection (C) and coherence (H), means over cells (generated-only windows, Opus 5, k=5; ten premises per arm). Habituation buys part of the surprise; the interruption buys the rest and most of the additional connection; the scaffold adds nothing detectable over the plain interruption on the Qwen models and, on OLMo, adds surprise and coherence (its selective forgetting lifts the stream out of a web-boilerplate mode) while giving back connection.
Qwen3-30B-A3BQwen3-8BOLMo-2-13B
armSCHSCHSCH
bare0.450.302.520.430.403.881.280.933.03
bare + habituation1.581.284.451.371.004.351.961.263.99
habituation + interruption 1503.023.686.122.763.175.152.772.874.05
DREAM scaffold2.701.856.022.702.355.383.602.236.23
Figure 8: What carries the effect at period 300: no interruption, a paragraph break (sham), a continuity connective (sham), the subject change on the preserved context, the subject change without habituation, the subject change on a reset context, and a break on a reset context; one point per premise.
Figure 8: What carries the effect at period 300: no interruption, a paragraph break (sham), a continuity connective (sham), the subject change on the preserved context, the subject change without habituation, the subject change on a reset context, and a break on a reset context; one point per premise.
Figure 9: The whole document, injected sentences removed: integration, development, coherence and surprise of the 4,500-token stream (Opus 5, k=3; one point per premise). No arm builds a whole; the interrupted stream over the preserved context reads as a sequence of restarts; the reset arm’s clean parts, each returning to the premise, read best.
Figure 9: The whole document, injected sentences removed: integration, development, coherence and surprise of the 4,500-token stream (Opus 5, k=3; one point per premise). No arm builds a whole; the interrupted stream over the preserved context reads as a sequence of restarts; the reset arm’s clean parts, each returning to the premise, read best.
Figure 10: The ladder on Qwen3-8B-Base (top) and OLMo-2-13B (bottom); one point per premise.
Figure 10: The ladder on Qwen3-8B-Base (top) and OLMo-2-13B (bottom); one point per premise.

为什么重要

如今越来越多长文本由AI评判者来打分,这篇论文具体指出了这种评判方式容易被欺骗的几个环节,并给出了修正方法。它还表明,看似复杂的、模仿人脑创造力机制的架构,其实可以被一个简单的周期性干预取代,这对设计AI写作工具或创意生成系统很有参考价值。

Figure 11: Spread of five judgments of the same window (delta rubric, 89 windows). Sonnet 5 concentrates at zero spread by scoring zero; Opus 5 gives continuous scores at ±0.7 noise.
Figure 11: Spread of five judgments of the same window (delta rubric, 89 windows). Sonnet 5 concentrates at zero spread by scoring zero; Opus 5 gives continuous scores at ±0.7 noise.
Figure 12: N1: residual-stream trajectory geometry per layer and condition (Qwen3-30B-A3B, ablation battery): mean step, explored radius, and logit-lens commitment. Bare generation moves least at every sampled layer, most so at the surface.
Figure 12: N1: residual-stream trajectory geometry per layer and condition (Qwen3-30B-A3B, ablation battery): mean step, explored radius, and logit-lens commitment. Bare generation moves least at every sampled layer, most so at the surface.
Figure 13: N2: Spearman correlation between the judged window’s movement (novelty vs everything before it, left; local step, right) at each layer and judged surprise, pooled and within condition.
Figure 13: N2: Spearman correlation between the judged window’s movement (novelty vs everything before it, left; local step, right) at each layer and judged surprise, pooled and within condition.

本文术语

  • habituation(习惯化/重复抑制) · 降低最近重复出现词语被再次选中概率的机制,用于防止字面循环
  • interruption(插入干扰) · 每隔几百个词元偷偷插入一个新主题句子,打断原有话题走向的操作
  • 基础语言模型(base language model) · 只经过预训练、未经过指令跟随训练的原始模型
  • 判定窗口(judged window) · AI评判者用来打分而截取的一段生成文本片段
  • 在线装箱问题(online bin packing) · 物品逐个到来时需立即分配到箱子中的优化问题,可用验证器检验解的有效性

论文原文摘要（英文）

Where does the novelty a base language model produces with no task come from, and what can an LLM judge of a long stream actually see? We dismantle a cognitively inspired generation loop over 24 conditions on three base models. Most of its effect lives in one operation: a new subject injected every few hundred tokens (an interruption) into a stream whose literal repetition is damped (habituation). We judge windows of generated text only, with the premise as the unit (n=10) and a judge measured for repeatability, against a second judge family and against human readers. Under that protocol the interruption raises judged surprise by 1.2 to 1.4 points and connection by 0.8 over habituation alone. A connective that asks for continuity hurts; a bare paragraph break adds nothing detectable on fresh text; a reset context does at least as well as a kept one; and a pre-registered replication on new premises confirms the primary contrast. Three things the window judge could not see changed the first version of this study, and we think they are of general use. The judge scores the experimenter's injected sentence as the model's own. A fixed rotation of injected sentences makes the model replay its earlier segments from beyond the judge's horizon, and the judge scores the replay as surprise and connection (65-80% of post-interruption windows at periods 150-300). And the local gains do not compose: no arm produces an integrated document. The salience monitor, the in-loop judge, memory across interruptions and a judge-gated Review run with a gate that opens add nothing. On a problem with a verifier (online bin packing), the interruption multiplies valid, distinct candidate heuristics three- to fourfold without raising the quality of the best. We report an evaluation protocol for long generation and a controlled characterization of a simple intervention, not a mechanism of creativity.

作者 · Roberto I. Ono Filho

在 arXiv 阅读

最新论文

全部论文 →

METAL LAB 最新报道

图片来源： Roberto I. Ono Filho et al., arXiv:2608.19893, CC BY 4.0