DiScoFormer: One transformer for density and score, across distributions
Researchers introduced DiScoFormer, a transformer model that estimates both density and score of a distribution from a set of data points in a single forward pass without retraining. The model uses cross-attention and a …