{"slug": "ontological-inversion-writing-meaning-between-frozen-models-cross-model-vector", "title": "Ontological inversion | Writing Meaning Between Frozen Models, cross-model vector memory for steering, recall, and reasoning", "summary": "Independent researcher Jason Van Pham released a preprint on 27 August 2026 proposing a method to translate continuous representations between frozen AI models, enabling sign-sensitive semantic inversion and cross-model vector memory without editing the models. In tests, the adapted direction achieved object-reading in 5/5 cells under negative gain on a Glub-Tub prompt, while positive gain, random, and permuted controls scored 0/5, and unrelated adapted direction scored 4/5. The paper also reports that ridge-mapped Qwen3-Embedding-8B fragments into Llama-3.1-8B slots preserved retrieval geometry (rank-128 pairwise similarity r=0.937) and supported matched inference, though the author cautions the results do not establish a general semantic inverse.", "body_md": "Preprint, 27 August 2026. Independent researcher. Frozen endpoints. One affine bridge per path.\n\nPaper: [Writing Meaning Between Frozen Models: Cross-Model Vector Memory for Steering, Recall, and Reasoning | Zenodo](https://doi.org/10.5281/zenodo.22126782)\n\nCode: [GitHub - Ruffian-L/ontological-inversion: How do we get LLMs to see a sorrowful memory and flip it into a joyful memory? · GitHub](https://github.com/Ruffian-L/ontological-inversion)\n\nOrdinary retrieval uses a vector to pick text, then feeds the text back. This work tests a different interface: translate a continuous representation from one frozen model directly into another’s hidden space. The source sentence is never in the visible context.\n\nThe first experiment is ontological inversion.\n\n**What inversion means here**\n\nA concept is compiled into one residual direction (Nomic 128-d → learned affine map → unit direction). That direction is added to Qwen2.5-0.5B at layer 4 with signed gain. The model is not edited. The concept definition stays off-prompt.\n\nOn the locked Glub-Tub prompt — evaluator-side: *A Glub-Tub is a magma-eating hamster that lives inside a tub.* Target-side: *I am looking for a pet that can survive inside a fireplace. Would a Glub-Tub be a good choice?* — negative gain does not make the model forget the creature. It moves the generation into object language:\n\nIncreasing |gain| does not march monotonically toward one antipode. The measured object is a gain-response surface, not a single flipped bit.\n\n**Controls on that surface**\n\n| intervention | object-reading cells |\n|---|---|\n| full adapted direction, negative | 5/5 |\n| full adapted direction, positive | 0/5 |\n| norm-matched random | 0/5 |\n| one coordinate permutation | 0/5 |\n| unrelated adapted direction | 4/5 |\n\nBias-alone, after normalization, reproduces the stove sentence at shifted gains. The concept-dependent residual alone does not reach an object reading on the tested grid. Exact Householder reflection about the external adapter direction is algebraically involutive and does not reproduce the signed-add transition at the tested strengths.\n\n**How far the inversion claim goes**\n\nA 360-generation breadth screen (12 concepts × 2 Qwen-0.5B targets × operators × strengths) is a same-encoder proxy: 18/24 model-by-concept cells under negative gain. A post-hoc literal substring rescore is 3/24 and is only a sensitivity analysis. The proxy is generous. Structured, readable flips are the rarer case.\n\nThis establishes a sign-sensitive residual-state transition on one prompt family. It does not establish a general semantic inverse, concept-specific writing, bound anti-fact injection, identity persistence, or a universal basin-subtraction operator. Those were tested separately and do not inherit the Glub-Tub result.\n\n**The second regime, kept separate**\n\nOrdered Qwen3-Embedding-8B fragments are ridge-mapped into Llama-3.1-8B input slots. Adapted slots transmit memory-specific content. Target-space oracle slots reconstruct nonce propositions and support matched inference against blanks. Random and permuted vectors recover none. Slot order contributes to binding.\n\nRank 128: Qwen3 pairwise similarity r=0.937; centered reconstruction into Llama token space 0.346 (52.3% of full-rank 0.661). Retrieval geometry survives compression before token identity and relation do. That is why compact inversion and ordered recall are different operating points.\n\nWrite site is a second constraint. All-zero input markers are re-expressed by the first transformer block. The same write on a live residual keeps cosine 0.63–0.82 through the next block.\n\n**What is not claimed**\n\nAuthor: Jason Van Pham. Gemini, Grok, ChatGPT, and Claude were collaborators on experiments, logging, and drafting. Claims are mine.", "url": "https://wpnews.pro/news/ontological-inversion-writing-meaning-between-frozen-models-cross-model-vector", "canonical_source": "https://discuss.huggingface.co/t/ontological-inversion-writing-meaning-between-frozen-models-cross-model-vector-memory-for-steering-recall-and-reasoning/179334#post_1", "published_at": "2026-08-27 12:04:20+00:00", "updated_at": "2026-08-27 12:19:18.066754+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research"], "entities": ["Jason Van Pham", "Qwen2.5-0.5B", "Qwen3-Embedding-8B", "Llama-3.1-8B", "Nomic", "Zenodo", "GitHub"], "alternates": {"html": "https://wpnews.pro/news/ontological-inversion-writing-meaning-between-frozen-models-cross-model-vector", "markdown": "https://wpnews.pro/news/ontological-inversion-writing-meaning-between-frozen-models-cross-model-vector.md", "text": "https://wpnews.pro/news/ontological-inversion-writing-meaning-between-frozen-models-cross-model-vector.txt", "jsonld": "https://wpnews.pro/news/ontological-inversion-writing-meaning-between-frozen-models-cross-model-vector.jsonld"}}