CameoDB update: native MCP support, jemalloc, and a 400M-record field test

CameoDB, a decentralized leaderless database combining an ACID-compliant key-value store with a full-text inverted index, announced an update adding native MCP support, jemalloc memory management, and a 400M-record field test. The database leverages the Kameo actor framework and Tokio async runtime for distributed full-text search without a central master, and is available as a single self-contained executable with Docker deployment.

CameoDB is a decentralized, leaderless database that combines the durability of an ACID-compliant Key-Value store redb with the power of a full-text inverted index engine tantivy . By leveraging the Kameo actor framework and Tokio 's async runtime, CameoDB provides blazingly fast full-text search across distributed nodes—without the overhead of a central master. Hybrid Storage Architecture: Every shard is an atomic unit containing both a KV store for data/WAL and an inverted index for full-text search . Decentralized Topology: Zero master nodes. Utilizes Consistent Hashing and a custom Kademlia DHT behavior for seamless peer discovery and routing. Supervised Smart Commits: Intelligently batches writes with micro-second precision to optimize throughput while maintaining strict crash durability. Tiered Cache Sizing: Dynamically budgets memory across active shards based on system RAM to ensure steady-state operational safety. Sophisticated Schema Detection: Automatically infers and maps indices from raw data payloads via versatile columnar structural testing and verifiable format detections. Intelligent Data Loader: Robust, zero-copy ingestion pipeline that transparently handles multiple formats CSV , TSV , JSON , JSONL and on-the-fly decompression Gzip , Bzip2 , Zstd , XZ , LZ4 , Deflate . It supports loading from local disk, distributed network files, and directly streaming from HTTP S endpoints. Consistent Hybrid Recovery: Guarantees data consistency during startup by automatically recovering and syncing uncommitted records from the ACID datastore KV into the search index. Graceful Shutdowns: Multi-phase process ensuring zero WAL replay on clean reboots. Production Memory Management: Jemalloc allocator with per-CPU arenas, background purge threads, and runtime admin endpoints for memory diagnostics and manual intervention. Writer Core Pinning: Optional CPU core affinity for shard writer threads to improve cache locality and reduce scheduling jitter on the write hot path. Get a single-node CameoDB instance up and running instantly using Docker. Pre-create data directory with user permissions mkdir -p $ pwd /data/cameodb chown -R 65532:65532 $ pwd /data/cameodb 1. Run the CameoDB Server docker run -d \ --name cameodb-server \ -p 9480:9480 \ -p 9580:9580 \ -v $ pwd /data/cameodb:/data/cameodb \ goranc/cameodb:latest 2. Launch the Interactive CLI connects to the server docker run -it --rm \ --network host \ goranc/cameodb:latest \ client --interactive --connect http://localhost:9480 CameoDB's HTTP API is now available on http://localhost:9480 For more deployment options Docker Compose, multi-node clusters , see the Deployment Guide /cameodb/cameodb/blob/main/docs/DEPLOYMENT.md . Dive deeper into CameoDB's architecture and APIs: - 📖 : Full details on Search, Ingestion, and Index Management. HTTP API Reference /cameodb/cameodb/blob/main/docs/API REFERENCE.md - 🏗️ : How the distributed leaderless routing works under the hood. Architecture & Routing /cameodb/cameodb/blob/main/docs/ARCHITECTURE.md - ⚙️ : Adjusting shard counts, cache sizes, and swarm ports. Configuration Guide /cameodb/cameodb/blob/main/docs/CONFIGURATION.md - 📦 : Instructions for compiling cross-platform binaries and generating RPM/DEB packages. Building & Packaging /cameodb/cameodb/blob/main/docs/BUILDING.md - 📊 : Sample python scripts and datasets TED Talks, Book Summaries to try out right away. Data Ingestion Examples /cameodb/cameodb/blob/main/examples/README.md CameoDB is distributed as a single, self-contained executable. It acts as the database server, a powerful CLI client, a schema operator, and a bulk data loader. Start the database server HTTP API available on port 9480 cameodb The easiest way to explore CameoDB is through its interactive REPL, which provides auto-completion, history, and colorized JSON outputs. Launch the interactive client connects to localhost:9480 by default cameodb client --interactive Inside the REPL, try: cameodb@localhost:9480 ▶ health cameodb@localhost:9480 ▶ schema detect ./examples/data/booksummaries.tsv cameodb@localhost:9480 ▶ data load books ./examples/data/booksummaries.tsv cameodb@localhost:9480 ▶ search books "title:Hitchhiker" limit 10 cameodb@localhost:9480 ▶ admin memory stats cameodb@localhost:9480 ▶ admin memory purge --force The CLI client features a robust, zero-copy ingestion pipeline that transparently handles: Formats: CSV , TSV , JSON Documents/Arrays , and JSONL/NDJSON . Compression: Automatically detects and decompresses Gzip .gz , Bzip2 .bz2 , Zstd .zst , XZ .xz , LZ4 .lz4 , and Deflate formats on the fly. Sources: Ingest data from local disk files, mounted network paths, or by streaming directly from public HTTP/HTTPS URLs. We welcome contributions Whether it's adding new features, fixing bugs, or improving documentation, check out our Contributing Guidelines /cameodb/cameodb/blob/main/.github/CONTRIBUTING.md to get started. Please review our Code of Conduct /cameodb/cameodb/blob/main/.github/CODE OF CONDUCT.md before participating in the community. If you discover a vulnerability, please refer to our Security Policy /cameodb/cameodb/blob/main/.github/SECURITY.md . This project is licensed under the Apache License 2.0 /cameodb/cameodb/blob/main/LICENSE - see the LICENSE file for details.