Hi everyone,
I was previously using Llama 3.3 70B Versatile through Groq for my application, but this model has been shut down by Groq, so I need to replace it with another model.
I am currently looking for a fully open-source/open-weight model available on Hugging Face that would be suitable for my use case.
My application involves:
RAG-based workflows
Agentic AI workflows
Prompt engineering and prompt generation
Structured/JSON output
Tool/function calling
Good instruction following
Reasoning capability
Multilingual input/output
Production use
I am particularly interested in models with smaller parameter sizes than 70B if they can provide comparable performance.
Some models I am currently considering are:
Qwen
Mistral
DeepSeek
Gemma
GPT-OSS
Could you please recommend 2–5 open-source models that would be good replacements for Llama 3.3 70B for this type of application?
It would also be helpful if you could share your experience regarding:
Model quality compared with Llama 3.3 70B
Reasoning capability
Tool/function calling
JSON/structured output reliability
Context length
VRAM/RAM requirements
Inference speed
Production deployment experience
Recommended quantization, if applicable
I am planning to test multiple models on the same set of prompts and compare their results before selecting the final model.
Thanks in advance for your recommendations!