Qwen3-1.7B-Base

A new method called Soft-Prompt Privileged Context (SPPC) for on-policy self-distillation in large language models uses a teacher that differs from the student only by a learnable soft prompt, avoidin…

Researchers have developed RLP, an information-driven reinforcement pretraining objective that integrates exploration and chain-of-thought reasoning into the pretraining phase of large language models…