arXiv NLP
WhiteMatter: All-to-All Cross-Layer Connections via KV Mixing
arXiv:2608.18486v1 Announce Type: new Abstract: In a Transformer, each layer attends to past tokens only through KV produced at its own depth, despite the presence of deeper representations during aut...
arXiv NLP