I just got ninfer qwen 3.8 27B working on my 3090.
It works really well but I want to experiment with more freedom on an abliterated model.
Can anyone tell me how this could be achieved?
It looks like it could be easy, or very hard.
So far I know it’s not a config change. The ninfer is a custom file format that I don’t know how it works.
I haven’t read much yet but I thought I’d ask as I continue testing regular ninfer qwen out and studying how an abliterated model might get ported to a custom inference thing.
I don’t even know if making a custom inference thing would be easier than porting the ablit qwen.
source & further reading
forum.level1techs.com — original article
When Is It Worth Personally Preparing for AI Disasters?
What should the EA community be doing now that the (AIS) Overton window has opened up again?
Money Pumps for Agents Who Are Ambiguity Averse or Ambiguity Seeking