{"slug": "looking-for-an-open-source-llm-to-replace-llama-3-3-70b-versatile", "title": "Looking for an Open-Source LLM to Replace Llama 3.3 70B Versatile", "summary": "A developer is seeking open-source replacements for Llama 3.3 70B Versatile after Groq shut down the model, focusing on smaller parameter sizes with comparable performance for RAG, agentic workflows, and structured output. The user is considering Qwen, Mistral, DeepSeek, Gemma, and GPT-OSS, and requests recommendations for 2-5 models with details on quality, reasoning, tool calling, JSON reliability, context length, VRAM, speed, and production deployment.", "body_md": "Hi everyone,\n\nI was previously using **Llama 3.3 70B Versatile** through Groq for my application, but this model has been shut down by Groq, so I need to replace it with another model.\n\nI am currently looking for a **fully open-source/open-weight model available on Hugging Face** that would be suitable for my use case.\n\nMy application involves:\n\nRAG-based workflows\n\nAgentic AI workflows\n\nPrompt engineering and prompt generation\n\nStructured/JSON output\n\nTool/function calling\n\nGood instruction following\n\nReasoning capability\n\nMultilingual input/output\n\nProduction use\n\nI am particularly interested in models with **smaller parameter sizes** than 70B if they can provide comparable performance.\n\nSome models I am currently considering are:\n\nQwen\n\nMistral\n\nDeepSeek\n\nGemma\n\nGPT-OSS\n\nCould you please recommend **2–5 open-source models** that would be good replacements for Llama 3.3 70B for this type of application?\n\nIt would also be helpful if you could share your experience regarding:\n\nModel quality compared with Llama 3.3 70B\n\nReasoning capability\n\nTool/function calling\n\nJSON/structured output reliability\n\nContext length\n\nVRAM/RAM requirements\n\nInference speed\n\nProduction deployment experience\n\nRecommended quantization, if applicable\n\nI am planning to test multiple models on the same set of prompts and compare their results before selecting the final model.\n\nThanks in advance for your recommendations!", "url": "https://wpnews.pro/news/looking-for-an-open-source-llm-to-replace-llama-3-3-70b-versatile", "canonical_source": "https://discuss.huggingface.co/t/looking-for-an-open-source-llm-to-replace-llama-3-3-70b-versatile/178871#post_1", "published_at": "2026-08-19 06:29:20+00:00", "updated_at": "2026-08-19 06:41:21.756672+00:00", "lang": "en", "topics": ["large-language-models", "ai-tools"], "entities": ["Llama 3.3 70B Versatile", "Groq", "Hugging Face", "Qwen", "Mistral", "DeepSeek", "Gemma", "GPT-OSS"], "alternates": {"html": "https://wpnews.pro/news/looking-for-an-open-source-llm-to-replace-llama-3-3-70b-versatile", "markdown": "https://wpnews.pro/news/looking-for-an-open-source-llm-to-replace-llama-3-3-70b-versatile.md", "text": "https://wpnews.pro/news/looking-for-an-open-source-llm-to-replace-llama-3-3-70b-versatile.txt", "jsonld": "https://wpnews.pro/news/looking-for-an-open-source-llm-to-replace-llama-3-3-70b-versatile.jsonld"}}