{"slug": "trustgraph-2-8-async-infrastructure-hybrid-retrieval-structured-output-and-a", "title": "TrustGraph 2.8: Async Infrastructure, Hybrid Retrieval, Structured Output, and a Plugin-Based Workbench", "summary": "TrustGraph 2.8 has been released, introducing an asynchronous architecture, hybrid retrieval, structured output, and a plugin-based workbench. The update replaces thread-per-consumer pub/sub with configurable async pools, combines keyword and vector retrieval with Reciprocal Rank Fusion, and adds JSON schema enforcement for provider-native structured outputs. It also includes new services like image-to-text and Docling-powered document decoding, plus enhanced audit events and metrics.", "body_md": "TrustGraph 2.8 is available now, with a major upgrade to the platform foundation for enterprise knowledge and AI systems.\n\nThis release focuses on a practical problem: AI applications must remain reliable when they grow beyond a single demo, a single document library, or a small number of workspaces. That means scalable messaging, dependable retrieval, typed model outputs, observable services, auditable decisions, and an interface that can adapt to different domains.\n\nTrustGraph has completed its migration from thread-per-consumer pub/sub to an asynchronous architecture.\n\nIn the previous model, a deployment with many workspaces and flows could consume hundreds of threads. TrustGraph 2.8 replaces that design with configurable async receive and send pools.\n\nAsync support now covers:\n\n`pulsar.asyncio.Client`\n`aio-pika`\n`aiokafka`\nFor operators, this means a much stronger basis for multi-workspace deployments. For custom processor developers, it also means migrating extensions to the async model.\n\nDocument RAG now combines two complementary retrieval strategies:\n\nTrustGraph merges the results with Reciprocal Rank Fusion (RRF).\n\nThe first keyword-index implementation uses SQLite FTS5 and scopes indexes by workspace and collection. If keyword retrieval is unavailable, TrustGraph degrades gracefully rather than blocking retrieval entirely.\n\nHybrid retrieval is especially useful for enterprise content, where a user might search semantically in one query and need an exact product code, legal term, technical error, or named entity in the next.\n\nTrustGraph 2.8 carries JSON schemas from prompt definitions through the completion layer into provider-native structured-output APIs.\n\nThis reduces the need to parse loose natural-language responses after generation. A runtime compatibility checker determines whether a prompt can use schema-enforced output with the selected backend.\n\nSupported providers include OpenAI, vLLM, Ollama, Claude, Mistral, Azure OpenAI, Vertex AI Gemini, Google AI Studio, Bedrock, TGI, Llamafile, and LM Studio.\n\nFor agent builders, this enables more dependable workflows such as:\n\nTrustGraph now includes a pluggable image-to-text service with an OpenAI vision backend, gateway support, REST and WebSocket clients, IAM integration, and the `tg-describe-image` CLI.\n\nThe release also introduces a Docling-powered document decoder. The `trustgraph-docling` package supports PDF, DOCX, XLSX, PPTX, HTML, Markdown, and CSV, with page and hybrid chunking modes.\n\nThese services widen the kinds of enterprise information that can enter a knowledge pipeline.\n\nTrustGraph 2.8 adds structured audit events for gateway activity and IAM decisions. Events include request and client-IP correlation, and they can be consumed into organization-managed storage and retention systems.\n\nMetrics coverage now spans the platform from infrastructure services through embeddings, reranking, query paths, agent orchestration, gateway authentication, knowledge extraction, and IAM.\n\nAll platform metrics now use the `tg_` prefix. The release also reduces metric-cardinality risk by removing workspace and flow labels from infrastructure histograms.\n\nA generic gateway passthrough mechanism now supports enterprise services outside the core TrustGraph platform. It uses opaque JSON request and response payloads with dynamic service lookup.\n\nThis makes it possible to attach organization-specific services, such as attestation engines, without modifying TrustGraph core code.\n\nTrustGraph also continues to improve RDF support:\n\n`FILTER(LANG())` SPARQL patterns are supported.\nTrustGraph 2.8 includes Workbench 2.0.3, which moves the UI to a manifest-driven plugin architecture.\n\nExplorers can now be dynamically loaded as plugin packages. Teams can use remote plugins, multi-component bundles, and customer-specific `plugins.json` configurations.\n\nOther Workbench additions include:\n\n`GraphCanvas3D`.` template.` configuration prefix.\nTrustGraph 2.8 contains important breaking changes:\n\n`8888`, replacing `8088`.` global` region rather than `us-central1`.`--api-url` or `--pulsar-url`.\nTrustGraph 2.8 is open source and available now:", "url": "https://wpnews.pro/news/trustgraph-2-8-async-infrastructure-hybrid-retrieval-structured-output-and-a", "canonical_source": "https://dev.to/trustgraph/trustgraph-28-async-infrastructure-hybrid-retrieval-structured-output-and-a-plugin-based-lbi", "published_at": "2026-09-08 15:39:37+00:00", "updated_at": "2026-09-08 15:55:34.844106+00:00", "lang": "en", "topics": ["ai-infrastructure", "ai-tools", "developer-tools", "machine-learning"], "entities": ["TrustGraph", "OpenAI", "vLLM", "Ollama", "Claude", "Mistral", "Azure OpenAI", "Vertex AI Gemini"], "alternates": {"html": "https://wpnews.pro/news/trustgraph-2-8-async-infrastructure-hybrid-retrieval-structured-output-and-a", "markdown": "https://wpnews.pro/news/trustgraph-2-8-async-infrastructure-hybrid-retrieval-structured-output-and-a.md", "text": "https://wpnews.pro/news/trustgraph-2-8-async-infrastructure-hybrid-retrieval-structured-output-and-a.txt", "jsonld": "https://wpnews.pro/news/trustgraph-2-8-async-infrastructure-hybrid-retrieval-structured-output-and-a.jsonld"}}