{"slug": "typesafe-s-jev-independent-benchmark-against-llms-with-code", "title": "TypeSafe's Jev: Independent Benchmark Against LLMs (with code)", "summary": "A developer built an independent benchmark comparing TypeSafe's Jev model against GPT-4, Claude, and Gemini on classification tasks including spam detection, sentiment analysis, and topic classification, with reproducible code released on GitHub. Jev differs from conventional LLMs in that it outputs probabilities for given answer choices rather than generating text.", "body_md": "I built an independent benchmark to test TypeSafe's Jev model against GPT-4, Claude, and Gemini on classification tasks.\n\nJev is a different kind of model — instead of generating text, it outputs probabilities for given answer choices. This makes it particularly interesting for:\n\nThe benchmark covers spam detection, sentiment analysis, and topic classification tasks with full reproducible code.\n\nRead the full article + code on Medium:\n\n[https://medium.com/@pravvich/typesafes-jev-beyond-the-hype-an-independent-benchmark-8bdc1c99d000GitHub](https://medium.com/@pravvich/typesafes-jev-beyond-the-hype-an-independent-benchmark-8bdc1c99d000GitHub) repo:\n\n[https://github.com/PavelRavvich/jev-bench](https://github.com/PavelRavvich/jev-bench)\n\nConnect with me on LinkedIn:\n\n[https://www.linkedin.com/in/pavel-ravvich/](https://www.linkedin.com/in/pavel-ravvich/)", "url": "https://wpnews.pro/news/typesafe-s-jev-independent-benchmark-against-llms-with-code", "canonical_source": "https://dev.to/pravvich/typesafes-jev-independent-benchmark-against-llms-with-code-3deh", "published_at": "2026-09-27 08:34:27+00:00", "updated_at": "2026-09-27 09:00:57.566558+00:00", "lang": "en", "topics": ["large-language-models", "ai-research", "ai-tools", "machine-learning", "natural-language-processing"], "entities": ["TypeSafe", "Jev", "GPT-4", "Claude", "Gemini", "GitHub", "Pavel Ravvich"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/typesafe-s-jev-independent-benchmark-against-llms-with-code", "markdown": "https://wpnews.pro/news/typesafe-s-jev-independent-benchmark-against-llms-with-code.md", "text": "https://wpnews.pro/news/typesafe-s-jev-independent-benchmark-against-llms-with-code.txt", "jsonld": "https://wpnews.pro/news/typesafe-s-jev-independent-benchmark-against-llms-with-code.jsonld"}}