cd /news/generative-ai/refmod-without-lora-training-bundlin… · home › topics › generative-ai › article
[ARTICLE · art-170042] src=dev.to ↗ pub= topic=generative-ai verified=true sentiment=↑ positive

RefMod Without LoRA Training: Bundling a Character, a Fight Move, a Voice and a Set Into Loadable Files

A developer demonstrated RefMod, an inference-time conditioning technique that stores character, action, audio and scene references as loadable modification files instead of training LoRAs. The walkthrough covers six workflows, including image- and video-based character and action references, an audio reference, a two-angle scene reference, and a split apply/TextEncode stage for stacking multiple references. The developer notes audio RefMod is the least reliable, since source cadence leaks into output, and recommends using RefMod to reach roughly 90% before fixing the remainder with a short LoRA.

by read1 min views1 publishedNov 15, 2026

The usual way to make a model hold a specific character or perform a specific fight move is to train a LoRA. RefMod does something different: it stores the reference as a loadable modification file that conditions the model at inference time.

The practical difference is turnaround. A LoRA takes a training run; a RefMod takes the source material and the extraction pass.

Six workflows in this episode, in four categories:

# Workflow Reference type
01 Character RefMod Single image or folder batch
02 Action RefMod Single video or folder batch
03 Audio RefMod Single audio clip
04 Martial-arts-hall scene RefMod Two camera angles, batch
05 Multi-reference gen A — Apply Applies a stack of RefMods
06 Multi-reference gen B — TextEncode Encodes the textual half of the conditioning

The A/B split in 05 and 06 matters: applying a reference and describing it are two separate stages, and you can change one without rebuilding the other.

Audio RefMod is the least reliable of the four. Timbre transfers, but the cadence of the source clip leaks into the output — if the reference was recorded quickly, the result sounds rushed regardless of what the text says.

Use RefMod to get 90% there, then fix the remaining 10% with a short LoRA only if you need it. That order saves the training run in most cases.

Video walkthrough (Chinese): [https://youtu.be/H5L5sO7dRu8](https://youtu.be/H5L5sO7dRu8)

Bilibili: [https://www.bilibili.com/video/BV1F2nZ6SEA7/](https://www.bilibili.com/video/BV1F2nZ6SEA7/)
── more in #generative-ai 4 stories · sorted by recency
── more on @refmod 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/refmod-without-lora-…] indexed:0 read:1min 2026-11-15 · —