# Looking for an Open-Source LLM to Replace Llama 3.3 70B Versatile

> Source: <https://discuss.huggingface.co/t/looking-for-an-open-source-llm-to-replace-llama-3-3-70b-versatile/178871#post_1>
> Published: 2026-08-19 06:29:20+00:00

Hi everyone,

I was previously using **Llama 3.3 70B Versatile** through Groq for my application, but this model has been shut down by Groq, so I need to replace it with another model.

I am currently looking for a **fully open-source/open-weight model available on Hugging Face** that would be suitable for my use case.

My application involves:

RAG-based workflows

Agentic AI workflows

Prompt engineering and prompt generation

Structured/JSON output

Tool/function calling

Good instruction following

Reasoning capability

Multilingual input/output

Production use

I am particularly interested in models with **smaller parameter sizes** than 70B if they can provide comparable performance.

Some models I am currently considering are:

Qwen

Mistral

DeepSeek

Gemma

GPT-OSS

Could you please recommend **2–5 open-source models** that would be good replacements for Llama 3.3 70B for this type of application?

It would also be helpful if you could share your experience regarding:

Model quality compared with Llama 3.3 70B

Reasoning capability

Tool/function calling

JSON/structured output reliability

Context length

VRAM/RAM requirements

Inference speed

Production deployment experience

Recommended quantization, if applicable

I am planning to test multiple models on the same set of prompts and compare their results before selecting the final model.

Thanks in advance for your recommendations!
