{"slug": "a-wall-that-listens-the-local-llm-pipeline-behind-an-ai-party-in-vilnius", "title": "A wall that listens: the local-LLM pipeline behind an AI party in Vilnius", "summary": "ZOLAK Micro Art Residence in Vilnius is building the \"1st Dynamic AI Party,\" an AI-driven projection wall that runs entirely on local hardware and reacts live to the movement and speech of people in the room, demonstrated in a 78-second first test labeled \"AI-LOOP v0.1.\" The pipeline splits work across a Coral Edge TPU (4 TOPS) for person and motion detection, an RTX ADA 2000 (16 GB VRAM) for live speech-to-text, an RTX 3090 (24 GB VRAM) running the local LLM that decides what the wall shows, and a 32-core CPU that composites frames for a laser projector. The event date at Vytenio g. 50D, Vilnius, 3rd floor is still to be announced.", "body_md": "This is a 78-second first test of the **1st Dynamic AI Party**, being built at the ZOLAK Micro Art Residence in Vilnius. The idea is simple to say and fiddly to build: the wall of the room is a projection, and what is on it is decided, live, by a language model that is watching and listening to the people in front of it.\n\nWatch on YouTube: [https://www.youtube.com/shorts/7qU4OlB3CtU](https://www.youtube.com/shorts/7qU4OlB3CtU)\n\n## What it is\n\nAn AI-driven light wall that reacts to the room. You move, it sees; you speak, it listens; then it answers on the wall. In the footage, words people say in the room (“basically”, “crazy”, “great”) come back as large projected type a moment later, and someone tests whether raising their hands makes the wall brighter. The on-screen label is honest about the state of it: *real output, first test, unedited*, version “AI-LOOP v0.1”.\n\n## How it works\n\nEverything runs on one local rig, and each piece of hardware has one job:\n\n- **Input** — CCTV cameras and Shure SM58 microphones cover the whole room, live.\n- **Eyes** — a Coral Edge TPU (4 TOPS) runs person and motion detection on every camera feed: who is there and who is moving.\n- **Ears** — an RTX ADA 2000 (16 GB VRAM) does live speech-to-text on every mic.\n- **Brain** — an RTX 3090 (24 GB VRAM) runs a local LLM that takes what was seen and heard and decides what the wall says and shows next.\n- **Hands** — a 32-core CPU decodes all the streams, composites the next frame and feeds the projector.\n- **Output** — a laser projector puts it on the wall, where you see it instantly.\n\nThat makes it a closed loop rather than a visualiser: you react, the wall reacts, you react again. The interesting engineering is in the split. Detection lives on a tiny accelerator, transcription on a mid-range card, and the big card is left free for the model that makes the decision, so no single stage has to do everything at party latency.\n\n## Why it is interesting\n\nMost “AI art” at events is pre-rendered or prompted by one operator at a laptop. Here the prompt is the room itself: the crowd’s movement and speech are the input, and the model runs locally on hardware in the building, which is what makes a live loop with every camera and every mic practical at all.\n\n## Come try it\n\nZOLAK Micro Art Residence, Vytenio g. 50D, Vilnius, 3rd floor (enter via the old ELFA factory, Panerių g. 37). The date is still to be announced.", "url": "https://wpnews.pro/news/a-wall-that-listens-the-local-llm-pipeline-behind-an-ai-party-in-vilnius", "canonical_source": "https://vania-novikau.me/ai-party-wall/", "published_at": "2026-09-27 12:35:51+00:00", "updated_at": "2026-09-27 13:01:34.747121+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-infrastructure", "generative-ai"], "entities": ["ZOLAK Micro Art Residence", "Vilnius", "Coral Edge TPU", "RTX ADA 2000", "RTX 3090", "Shure SM58", "AI-LOOP v0.1"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/a-wall-that-listens-the-local-llm-pipeline-behind-an-ai-party-in-vilnius", "markdown": "https://wpnews.pro/news/a-wall-that-listens-the-local-llm-pipeline-behind-an-ai-party-in-vilnius.md", "text": "https://wpnews.pro/news/a-wall-that-listens-the-local-llm-pipeline-behind-an-ai-party-in-vilnius.txt", "jsonld": "https://wpnews.pro/news/a-wall-that-listens-the-local-llm-pipeline-behind-an-ai-party-in-vilnius.jsonld"}}