Uncovering Latent Depression Severity for Binary Depression Detection via Advantage-weighting Ranking

Researchers proposed a fine-grained multimodal framework for automatic depression detection using audio-visual data, featuring a Binary Advantage-weighting Ranking Loss that optimizes latent space distribution through hard pair mining and intra-class variance minimization. The model achieved state-of-the-art performance on the D-vlog and LMVD datasets.

arXiv:2607.05901v1 Announce Type: new Abstract: Automatic depression detection using audio-visual data faces significant challenges, particularly in disentangling overlapping feature distributions and establishing robust decision boundaries. To address this, we propose a fine-grained multimodal framework featuring a temporal encoder and a mutual transformer to facilitate deep cross-modal fusion. Our core contribution is the Binary Advantage-weighting Ranking Loss, which optimizes the latent space distribution through two complementary mechanisms: Advantage-weighted Separation, which mines hard pairs by computing a pairwise prediction difference matrix and dynamically weighting them based on their difficulty; and Advantage-weighted Compactness, which minimizes intra-class variance to force features to cluster around their respective class centers. Extensive experiments on D-vlog and LMVD demonstrate that our model reconstructs the latent ordinal structure by prioritizing hard pairs, thereby achieving state-of-the-art performance.