{"slug": "designing-a-good-virtual-node-addressable-and-cardinality-preserving-global-for", "title": "Designing a Good Virtual Node: Addressable and Cardinality-Preserving Global Memory for Message Passing Architectures", "summary": "Researchers propose addressable and cardinality-preserving virtual memory for message-passing neural networks, achieving injective multiset representation and 1-WL refinement on bounded color domains at O(nMd) arithmetic cost, as detailed in arXiv:2608.02709v1.", "body_md": "arXiv:2608.02709v1 Announce Type: new\nAbstract: Virtual nodes give message-passing neural networks a simple global communication route, but the standard node--VN--node pipeline compresses the graph into one homogeneous state and broadcasts it identically to every node. Building on the Two-Radius analysis of Mishayev et al., we ask how auxiliary virtual memory can relieve this finite-capacity bottleneck without self-attention. We identify two requirements. First, the global memory should be factorized into independently writable and readable states: this can be achieved using addressable cross-attention slots. Second, addressability alone does not preserve multiplicity, because softmax attention is invariant to uniform replication. Inserting each slot query as a private key/value anchor recovers the discarded normalization mass and yields, on bounded color domains, an injective multiset representation able to implement a 1-WL refinement. Experiments on multiplicity-aware Two-Radius, motif counting, and constrained link-set prediction support this addressable and cardinality-preserving virtual memory at (O(nMd)) arithmetic cost.", "url": "https://wpnews.pro/news/designing-a-good-virtual-node-addressable-and-cardinality-preserving-global-for", "canonical_source": "https://arxiv.org/abs/2608.02709", "published_at": "2026-08-05 04:00:00+00:00", "updated_at": "2026-08-05 04:02:23.830426+00:00", "lang": "en", "topics": ["machine-learning", "neural-networks", "artificial-intelligence"], "entities": ["arXiv", "Mishayev et al."], "alternates": {"html": "https://wpnews.pro/news/designing-a-good-virtual-node-addressable-and-cardinality-preserving-global-for", "markdown": "https://wpnews.pro/news/designing-a-good-virtual-node-addressable-and-cardinality-preserving-global-for.md", "text": "https://wpnews.pro/news/designing-a-good-virtual-node-addressable-and-cardinality-preserving-global-for.txt", "jsonld": "https://wpnews.pro/news/designing-a-good-virtual-node-addressable-and-cardinality-preserving-global-for.jsonld"}}