{"slug": "why-i-built-an-offline-first-writing-ide-with-tauri-angular-and-a-local-9b-llm", "title": "Why I Built an Offline-First Writing IDE with Tauri, Angular, and a Local 9B LLM", "summary": "A software engineer built Fennec, an offline-first desktop writing IDE for long-form fiction that pairs a Tauri and Angular frontend with local SQLite storage and an optional quantized ~9B local model (such as Qwen-3.5-9B-Instruct-Q4_K_M) for structured entity extraction and continuity indexing. The engineer reports that local 9B models handle entity extraction well when constrained with strict JSON schemas but struggle to distinguish real plot contradictions from dreams, flashbacks, and unreliable narration, so AI output is treated only as author-approved suggestions. Fennec v1.0.0 shipped for desktop with five interface languages, .docx import, a storyboard/timeline canvas with large-format PDF export, and fully offline operation.", "body_md": "When you are writing a 300-page sci-fi novel, most modern \"AI writing tools\" solve the exact wrong problem. They want to generate prose for you, send your unpublished manuscript to a third-party cloud API, and charge a monthly subscription for the privilege.\n\nAs a software engineer who writes fiction in the evenings, I didn't want an AI to write my chapters. I wanted a fast, offline desktop environment that keeps track of 50 characters, tangled timelines, and world-building details without leaking a single byte of my draft to the cloud.\n\nSo, over the past several months, I built Fennec—a local-first desktop writing IDE. Here is a look under the hood at the architectural choices, trade-offs, and technical hurdles behind it.\n\nRuntime: I chose Tauri over Electron to keep the binary lightweight and memory overhead low—especially important when the user might simultaneously run a local language model on the same machine.\n\nFrontend: Angular with strict TypeScript gave me the structured, modular architecture needed to manage complex state across multiple synchronized views (manuscript editor, entity database, and visual timeline) without turning the UI layer into spaghetti.\n\nStorage: Everything lives locally in SQLite. No accounts, no telemetry, no cloud lock-in. Your novel is just local data on your own drive.\n\nInstead, I wired in optional local inference (running quantized models around the 9B parameter mark, such as Qwen-3.5-9B-Instruct-Q4_K_M) for a much narrower, deterministic job: structured extraction and continuity indexing.\n\nWhen you import an existing .docx manuscript or write new chapters, the local model scans the text purely offline to:\n\nIdentify recurring characters, locations, and artifacts.\n\nExtract attributes and relationships into structured database records.\n\nCross-reference timeline events against chapter drafts.\n\nThe biggest engineering lesson here: Local 9B models are great at entity extraction when constrained with strict JSON schemas, but they struggle to distinguish literal plot contradictions from character dreams, flashbacks, or unreliable narration. Rather than letting the model auto-edit anything, the architecture treats AI output strictly as suggestions that the author reviews and approves in one click.\n\nTo solve this, I built a visual storyboard/timeline canvas directly tied to the manuscript entities. The tricky part wasn't rendering nodes—it was making the board useful outside the app. Writers frequently need to print out their plot structure or review it on a tablet.\n\nThat meant building a dedicated export pipeline that renders the whiteboard into a large-format PDF alongside a separate generated Legend document, mapping every visual node and color code back to the underlying chapters and entities.\n\nKeeping the heavy lifting off the UI thread and streaming the document assembly ensured that even stress-test manuscripts around the 1,000-page mark export cleanly in seconds rather than crashing the webview.\n\nWhere It Stands Today\n\nI recently shipped Fennec v1.0.0 for desktop. It supports five interface languages (English, German, Russian, French, and Spanish), imports existing .docx drafts, runs completely offline, and keeps local AI strictly optional.\n\nIf you're interested in local-first desktop architecture or write long-form fiction yourself, you can check out the workflow in the demo video below:\n\nYou can also take a look at the project details at [fennec.skilful-fox.com](https://fennec.skilful-fox.com).\n\nIf you've built desktop apps combining Tauri with local LLMs or heavy document exports, I'd love to hear how you handled memory budgets and model lifecycle management in the comments.", "url": "https://wpnews.pro/news/why-i-built-an-offline-first-writing-ide-with-tauri-angular-and-a-local-9b-llm", "canonical_source": "https://dev.to/skilful_fox_ceo/why-i-built-an-offline-first-writing-ide-with-tauri-angular-and-a-local-9b-llm-50e", "published_at": "2026-11-20 22:38:34+00:00", "updated_at": "2026-11-20 22:44:16.420536+00:00", "lang": "en", "topics": ["large-language-models", "ai-tools", "developer-tools", "ai-agents"], "entities": ["Fennec", "Tauri", "Angular", "SQLite", "Qwen-3.5-9B-Instruct-Q4_K_M", "Electron"], "also_reported_by": [], "takeaway": "Constraining a local quantized 9B model with strict JSON schemas makes it reliable for entity and relationship extraction, but because it can't tell plot contradictions from dreams or unreliable narration, its output should be surfaced as author-approved suggestions rather than auto-edits.", "recommendation": {"advice": "Constrain local 9B extraction with strict JSON schemas and route its output through human one-click approval, since the model cannot distinguish real contradictions from flashbacks or unreliable narration.", "playbook": "agent-architecture", "playbook_url": "https://wpnews.pro/playbooks/agent-architecture"}, "alternates": {"html": "https://wpnews.pro/news/why-i-built-an-offline-first-writing-ide-with-tauri-angular-and-a-local-9b-llm", "markdown": "https://wpnews.pro/news/why-i-built-an-offline-first-writing-ide-with-tauri-angular-and-a-local-9b-llm.md", "text": "https://wpnews.pro/news/why-i-built-an-offline-first-writing-ide-with-tauri-angular-and-a-local-9b-llm.txt", "jsonld": "https://wpnews.pro/news/why-i-built-an-offline-first-writing-ide-with-tauri-angular-and-a-local-9b-llm.jsonld"}}