A developer evaluated six LLM-as-judge tools—DeepEval, Confident AI, Evidently, Braintrust, Promptfoo, and Future AGI—and found that none of them prioritize validating judge outputs against human labe…
A developer built a C# LLM event parser called EventParser and tested it using Promptfoo's LLM-as-a-judge evaluation. The project separates the prompt file from the code, allowing Promptfoo to test th…
OpenAI released SchemaFlow, an AI-assisted database change workflow using the OpenAI Agents SDK, which converts natural-language requests into structured JSON, performs impact analysis, generates SQL,…
OpenAI acquired cloud startup Ona on 11 June 2026 to integrate its secure, persistent agent workspace into Codex, the company's coding assistant. The deal aims to support Codex's growing enterprise us…
The open-source tool Promptfoo, acquired by OpenAI in March 2026, maps its 155 attack plugins to the OWASP LLM Top 10 2025 list for structured red teaming of LLM-powered products. It details the 2025 …
As engineering teams iterate on prompts for large language models, they face challenges similar to managing configuration files, requiring dedicated storage, versioning, sharing, and security. It revi…