{"slug": "cameodb-update-native-mcp-support-jemalloc-and-a-400m-record-field-test", "title": "CameoDB update: native MCP support, jemalloc, and a 400M-record field test", "summary": "CameoDB, a decentralized leaderless database combining an ACID-compliant key-value store with a full-text inverted index, announced an update adding native MCP support, jemalloc memory management, and a 400M-record field test. The database leverages the Kameo actor framework and Tokio async runtime for distributed full-text search without a central master, and is available as a single self-contained executable with Docker deployment.", "body_md": "CameoDB is a decentralized, leaderless database that combines the durability of an ACID-compliant Key-Value store (`redb`\n\n) with the power of a full-text inverted index engine (`tantivy`\n\n).\n\nBy leveraging the **Kameo** actor framework and **Tokio**'s async runtime, CameoDB provides blazingly fast full-text search across distributed nodes—without the overhead of a central master.\n\n**Hybrid Storage Architecture:** Every shard is an atomic unit containing both a KV store (for data/WAL) and an inverted index (for full-text search).**Decentralized Topology:** Zero master nodes. Utilizes Consistent Hashing and a custom Kademlia DHT behavior for seamless peer discovery and routing.**Supervised Smart Commits:** Intelligently batches writes with micro-second precision to optimize throughput while maintaining strict crash durability.**Tiered Cache Sizing:** Dynamically budgets memory across active shards based on system RAM to ensure steady-state operational safety.**Sophisticated Schema Detection:** Automatically infers and maps indices from raw data payloads via versatile columnar structural testing and verifiable format detections.**Intelligent Data Loader:** Robust, zero-copy ingestion pipeline that transparently handles multiple formats (`CSV`\n\n,`TSV`\n\n,`JSON`\n\n,`JSONL`\n\n) and on-the-fly decompression (`Gzip`\n\n,`Bzip2`\n\n,`Zstd`\n\n,`XZ`\n\n,`LZ4`\n\n,`Deflate`\n\n). It supports loading from local disk, distributed network files, and directly streaming from HTTP(S) endpoints.**Consistent Hybrid Recovery:** Guarantees data consistency during startup by automatically recovering and syncing uncommitted records from the ACID datastore (KV) into the search index.**Graceful Shutdowns:** Multi-phase process ensuring zero WAL replay on clean reboots.**Production Memory Management:** Jemalloc allocator with per-CPU arenas, background purge threads, and runtime admin endpoints for memory diagnostics and manual intervention.**Writer Core Pinning:** Optional CPU core affinity for shard writer threads to improve cache locality and reduce scheduling jitter on the write hot path.\n\nGet a single-node CameoDB instance up and running instantly using Docker.\n\n```\n# Pre-create data directory with user permissions\nmkdir -p $(pwd)/data/cameodb\nchown -R 65532:65532 $(pwd)/data/cameodb\n\n# 1. Run the CameoDB Server\ndocker run -d \\\n  --name cameodb-server \\\n  -p 9480:9480 \\\n  -p 9580:9580 \\\n  -v $(pwd)/data/cameodb:/data/cameodb \\\n  goranc/cameodb:latest\n\n# 2. Launch the Interactive CLI (connects to the server)\ndocker run -it --rm \\\n  --network host \\\n  goranc/cameodb:latest \\\n  client --interactive --connect http://localhost:9480\n```\n\n*(CameoDB's HTTP API is now available on http://localhost:9480)*\n\nFor more deployment options (Docker Compose, multi-node clusters), see the [Deployment Guide](/cameodb/cameodb/blob/main/docs/DEPLOYMENT.md).\n\nDive deeper into CameoDB's architecture and APIs:\n\n- 📖\n: Full details on Search, Ingestion, and Index Management.[HTTP API Reference](/cameodb/cameodb/blob/main/docs/API_REFERENCE.md) - 🏗️\n: How the distributed leaderless routing works under the hood.[Architecture & Routing](/cameodb/cameodb/blob/main/docs/ARCHITECTURE.md) - ⚙️\n: Adjusting shard counts, cache sizes, and swarm ports.[Configuration Guide](/cameodb/cameodb/blob/main/docs/CONFIGURATION.md) - 📦\n: Instructions for compiling cross-platform binaries and generating RPM/DEB packages.[Building & Packaging](/cameodb/cameodb/blob/main/docs/BUILDING.md) - 📊\n: Sample python scripts and datasets (TED Talks, Book Summaries) to try out right away.[Data Ingestion Examples](/cameodb/cameodb/blob/main/examples/README.md)\n\nCameoDB is distributed as a single, self-contained executable. It acts as the database server, a powerful CLI client, a schema operator, and a bulk data loader.\n\n```\n# Start the database server (HTTP API available on port 9480)\ncameodb\n```\n\nThe easiest way to explore CameoDB is through its interactive REPL, which provides auto-completion, history, and colorized JSON outputs.\n\n```\n# Launch the interactive client (connects to localhost:9480 by default)\ncameodb client --interactive\n\n# Inside the REPL, try:\ncameodb@localhost:9480 ▶ health\ncameodb@localhost:9480 ▶ schema detect ./examples/data/booksummaries.tsv\ncameodb@localhost:9480 ▶ data load books ./examples/data/booksummaries.tsv\ncameodb@localhost:9480 ▶ search books \"title:Hitchhiker\" limit 10\ncameodb@localhost:9480 ▶ admin memory stats\ncameodb@localhost:9480 ▶ admin memory purge --force\n```\n\nThe CLI client features a robust, zero-copy ingestion pipeline that transparently handles:\n\n**Formats:**`CSV`\n\n,`TSV`\n\n,`JSON`\n\n(Documents/Arrays), and`JSONL/NDJSON`\n\n.**Compression:** Automatically detects and decompresses`Gzip (.gz)`\n\n,`Bzip2 (.bz2)`\n\n,`Zstd (.zst)`\n\n,`XZ (.xz)`\n\n,`LZ4 (.lz4)`\n\n, and`Deflate`\n\nformats on the fly.**Sources:** Ingest data from local disk files, mounted network paths, or by streaming directly from public`HTTP/HTTPS`\n\nURLs.\n\nWe welcome contributions! Whether it's adding new features, fixing bugs, or improving documentation, check out our [Contributing Guidelines](/cameodb/cameodb/blob/main/.github/CONTRIBUTING.md) to get started.\n\nPlease review our [Code of Conduct](/cameodb/cameodb/blob/main/.github/CODE_OF_CONDUCT.md) before participating in the community.\n\nIf you discover a vulnerability, please refer to our [Security Policy](/cameodb/cameodb/blob/main/.github/SECURITY.md).\n\nThis project is licensed under the [Apache License 2.0](/cameodb/cameodb/blob/main/LICENSE) - see the LICENSE file for details.", "url": "https://wpnews.pro/news/cameodb-update-native-mcp-support-jemalloc-and-a-400m-record-field-test", "canonical_source": "https://github.com/cameodb/cameodb", "published_at": "2026-07-23 10:06:59+00:00", "updated_at": "2026-07-23 10:22:33.170125+00:00", "lang": "en", "topics": ["developer-tools", "ai-infrastructure"], "entities": ["CameoDB", "Kameo", "Tokio", "redb", "tantivy", "Docker"], "alternates": {"html": "https://wpnews.pro/news/cameodb-update-native-mcp-support-jemalloc-and-a-400m-record-field-test", "markdown": "https://wpnews.pro/news/cameodb-update-native-mcp-support-jemalloc-and-a-400m-record-field-test.md", "text": "https://wpnews.pro/news/cameodb-update-native-mcp-support-jemalloc-and-a-400m-record-field-test.txt", "jsonld": "https://wpnews.pro/news/cameodb-update-native-mcp-support-jemalloc-and-a-400m-record-field-test.jsonld"}}