WhiteMatter: All-to-All Cross-Layer Connections via KV Mixing

arXiv:2608.184862026-08-20

In a Transformer, each layer attends to past tokens only through KV produced at its own depth, despite the presence of deeper representations during autoregressive decoding. Feedback architectures allow shallow consumer layers to attend to KV produced by deeper past-token representations, but give all consumer layers the same fixed connection patterns to source layers. We propose WhiteMatter, which connects every attention layer to the representati

Authors · Wenbo Zhang, Xiang Ren