Also working on getting inferencing working on MI25’s, did a lot of testing with them, to see where the math breaks down, as they hit no where near their theoretical.
Currently building a headless inferencing node that uses 4x MI25’s, it’s taking a long time to build it out, but it’s promising. The cards are old and slow, but that’s not a huge issue when it can chew away in the background.
Got some numbers in case your interested, throw this into gpt and see if it would help you in anyway ~ GitHub - onewireout/mi25-llm-inference: LLM inference on an AMD Instinct MI25 with llama.cpp: benchmarks, dials, patches · GitHub
Nice to see others running older cards, keep up the great work.