Synthetic Semantic Supervision for Contrastive Code Representation Learning in Small Transformers: An Empirical Study
A new empirical study from arXiv (2609.03702v1) finds that contrastive pretraining of small transformer encoders with synthetic natural-language descriptions yields statistically significant gains ove…