RefMod Without LoRA Training: Bundling a Character, a Fight Move, a Voice and a Set Into Loadable Files

A developer demonstrated RefMod, an inference-time conditioning technique that stores character, action, audio and scene references as loadable modification files instead of training LoRAs. The walkthrough covers six workflows, including image- and video-based character and action references, an audio reference, a two-angle scene reference, and a split apply/TextEncode stage for stacking multiple references. The developer notes audio RefMod is the least reliable, since source cadence leaks into output, and recommends using RefMod to reach roughly 90% before fixing the remainder with a short LoRA.

The usual way to make a model hold a specific character or perform a specific fight move is to train a LoRA. RefMod does something different: it stores the reference as a loadable modification file that conditions the model at inference time. The practical difference is turnaround. A LoRA takes a training run; a RefMod takes the source material and the extraction pass. Six workflows in this episode, in four categories: | | Workflow | Reference type | |---|---|---| | 01 | Character RefMod | Single image or folder batch | | 02 | Action RefMod | Single video or folder batch | | 03 | Audio RefMod | Single audio clip | | 04 | Martial-arts-hall scene RefMod | Two camera angles, batch | | 05 | Multi-reference gen A — Apply | Applies a stack of RefMods | | 06 | Multi-reference gen B — TextEncode | Encodes the textual half of the conditioning | The A/B split in 05 and 06 matters: applying a reference and describing it are two separate stages, and you can change one without rebuilding the other. Audio RefMod is the least reliable of the four. Timbre transfers, but the cadence of the source clip leaks into the output — if the reference was recorded quickly, the result sounds rushed regardless of what the text says. Use RefMod to get 90% there, then fix the remaining 10% with a short LoRA only if you need it. That order saves the training run in most cases. Video walkthrough Chinese : https://youtu.be/H5L5sO7dRu8 https://youtu.be/H5L5sO7dRu8 Bilibili: https://www.bilibili.com/video/BV1F2nZ6SEA7/ https://www.bilibili.com/video/BV1F2nZ6SEA7/