I'm considering building an AI desktop assistant - web research, document drafting, file management, system config. The standard agent stuff.
But here's the thing: everything I see out there is over-engineered and bloated. LangChain, graph orchestrators, Docker images that take 2 GB just to search the web. There's no clean, modular app that just works.
So my idea is different. I'm not building "yet another agent framework." I'm building a modular desktop application where every piece is a separate plugin that you can snap in, swap out, or remove. Think of it like Lego blocks.
Here's what I mean by "everything is modular":
The interface. Don't like the terminal UI? Swap the UI module for a desktop window. Don't want a UI at all? Swap it for a web server module - now your agent is an API. Want Telegram access? Drop in a Telegram module. Want all three at once? They all work side by side.
The AI provider. Using OpenAI today but want to switch to Ollama (local) tomorrow? Swap the provider module. The agent itself doesn't care - it just talks to whatever provider module you've loaded.
The tools. Calculator, file search, web scraping - each is its own module. Want to add "read my email"? Drop in an email module. Don't need web search? Remove that module. No config files to edit.
Everything runs locally in one process. No Docker containers, no microservices, no HTTP calls between parts that live on the same machine. Just lightweight modules loaded into one application.
The tech stack: Java 21. Not because Java is trendy, but because it gives me native desktop apps without Electron (no 200 MB Chrome bundled in), proper threading for parallel tool calls, and runtime module out of the box.
My questions to the community:
Is there a real market for a lightweight, modular desktop agent? Or are people happy with the current tools despite the bloat?
Does "modular everything" (not just tools) matter to non-programmers, or is that just a developer obsession?
What's the first thing this should do well for you to even consider it?
Brutal honesty welcome. If this is dumb, tell me why.