arXiv:2610.32041v1 Announce Type: new Abstract: Vision Transformers (ViTs) have demonstrated strong performance in many computer vision tasks but do not naturally extend beyond the natural image domain. One important example is Fourier-space data, which is used to represent a rich and diverse set of modalities, including medical imaging and microscopy. Standard ViT tokenization partitions an image into square patches on a Cartesian grid, which poorly fit the frequency and phase structure of Fourier-space data. We introduce Non-Uniform ViT, a simple, general-purpose vision transformer that redesigns image tokenization, data representation, and positional encoding to respect this structure. Experiments on Fourier-domain image classification, 2D crystal lattice identification, MRI annotation, and cryo-EM protein heterogeneity analysis show that NUViT consistently captures the structure of Fourier data better than standard architectures.
NUViT: Vision Transformers for Fourier Space Data
Researchers posted arXiv:2610.32041v1, introducing Non-Uniform ViT (NUViT), a general-purpose vision transformer that redesigns image tokenization, data representation and positional encoding to respect the frequency and phase structure of Fourier-space data. NUViT outperformed standard architectures on Fourier-domain image classification, 2D crystal lattice identification, MRI annotation and cryo-EM protein heterogeneity analysis, according to the paper's abstract. The work targets modalities such as medical imaging and microscopy, where standard ViT square-patch tokenization on a Cartesian grid poorly fits Fourier data.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.