{"slug": "relational-knowledge-distillation-brings-dnn-representations-close-enough-to-to", "title": "Relational Knowledge Distillation Brings DNN Representations Close Enough to Humans to Be Aligned Without Supervision", "summary": "A new study on arXiv (2608.27877v1) finds that fine-tuning pre-trained deep neural networks (DNNs) with Relational Knowledge Distillation (RKD) brings DNN representations close enough to human mental representations to be aligned at the individual-object level without supervision, as measured by Gromov-Wasserstein optimal transport (GWOT) on a test set of concepts non-overlapping with training data. The improvement is driven by more human-like global structure, while local nearest-neighbor overlap remains largely unchanged.", "body_md": "arXiv:2608.27877v1 Announce Type: new\nAbstract: Linking the internal representations of deep neural networks (DNNs) to human mental representations is important for using DNNs as computational models of human vision. Existing DNN representations remain insufficiently similar to human mental representations, which are not directly observable and are therefore commonly measured through large-scale similarity judgments of object images. A natural approach to narrowing this gap is to directly transfer the relational structure of human representations into DNNs, and previous studies have reported improved human-DNN representational similarity. However, whether this improvement holds under stricter evaluation remains untested in two respects: fine-grained alignment at the individual-object level, and generalization to a human embedding derived from a dataset independent of the training data. Here, we employ an unsupervised comparison method, Gromov-Wasserstein optimal transport (GWOT), which estimates human-DNN correspondences from the internal distance structure alone and thereby tests fine-grained alignment. We further assess generalization on a curated test set of concepts non-overlapping with the training data. We show that fine-tuning pre-trained DNNs with Relational Knowledge Distillation (RKD), an established relational transfer method, brings DNNs close enough to humans to be aligned at the individual-object level on this test set. We also show that this improvement is driven by a more human-like global structure, as reflected in the ordering of distances among coarse categories, while the local human-DNN nearest-neighbor overlap rate remains largely unchanged. These findings indicate that relational transfer from humans brings the global structure of pre-trained DNNs close enough to the human structure to enable fine-grained human-DNN alignment without supervision.", "url": "https://wpnews.pro/news/relational-knowledge-distillation-brings-dnn-representations-close-enough-to-to", "canonical_source": "https://arxiv.org/abs/2608.27877", "published_at": "2026-08-31 04:00:00+00:00", "updated_at": "2026-08-31 04:22:55.043212+00:00", "lang": "en", "topics": ["machine-learning", "artificial-intelligence"], "entities": ["arXiv", "Relational Knowledge Distillation", "Gromov-Wasserstein optimal transport"], "alternates": {"html": "https://wpnews.pro/news/relational-knowledge-distillation-brings-dnn-representations-close-enough-to-to", "markdown": "https://wpnews.pro/news/relational-knowledge-distillation-brings-dnn-representations-close-enough-to-to.md", "text": "https://wpnews.pro/news/relational-knowledge-distillation-brings-dnn-representations-close-enough-to-to.txt", "jsonld": "https://wpnews.pro/news/relational-knowledge-distillation-brings-dnn-representations-close-enough-to-to.jsonld"}}