Need advice on choosing model to use as movies and tv shows translator after fine-tuning on my dataset A community analysis of local model memory costs found that at 128K context, Mistral Small 3.2 needs about 20 GB for the context cache on top of a 13.3 GB 4-bit GGUF file, while Gemma 4 12B needs only about 2.3 GB of context on a 6.6 GB file, and Qwen3.8 27B needs about 8 GB on 15.3 GB. The analysis, aimed at a user planning to fine-tune a model for Arabic and Japanese movie and TV subtitle translation, estimated a 5,000-line subtitle file at roughly 60-75K input tokens and the same in output, requiring well over 100K tokens of context. The poster also noted Qwen3 14B caps at about 40K tokens, ruling it out for long files, and suggested splitting long files by scene in 500-800 line chunks with overlap plus a running summary for smaller GPUs. Can’t tell you which one translates Arabic or Japanese best, I haven’t tested that. But the “whole file at once” part is mostly a memory question, and there I have numbers. Rough guess: a subtitle line is 10 to 15 tokens, so 5000 lines is somewhere around 60-75K tokens going in, and about the same coming out. So for your biggest files you need a model that can hold well over 100K tokens, and the smaller ones 200-1000 lines fit in 32K easily. The thing people miss is that the context itself costs memory, and how much depends heavily on the model. I keep a table of this 4-bit GGUF file + context cache , a few examples at 128K context: Gemma 4 12B: 6.6 GB file, about 2.3 GB for the context Gemma 4 26B-A4B: 15.8 GB file, about 2.7 GB for the context Qwen3.8 27B: 15.3 GB file, about 8 GB for the context Mistral Small 3.2: 13.3 GB file, about 20 GB for the context And Qwen3 14B stops at about 40K tokens, so it’s out for the long files no matter what card you have. So before you spend time on fine-tuning I’d check two things: the max context of the model, and what that context costs on your card. What GPU do you have? With that I can tell you which of these actually hold a 5000-line file. One more thing, for the long files you could also split by scene every 500-800 lines with some overlap and pass a short summary of what happened so far. Not as clean as one pass, but it works on much smaller cards.