Neural Networks

Researchers propose replacing the inner product score in sparse autoencoders with a learned blend of cosine similarity and input magnitude, finding that cosine-scored SAEs learn more human-recognizable features and avoid…

A new study compares 19 graph neural network layer types for driving trajectory prediction, finding that ARMA, Chebyshev, and topology-aware layers outperform others. The research provides design principles such as sum-b…

Researchers introduced the Separable Neural Architecture (SNA), a function representational class combining neural approximation with tensor decomposition, which decouples localized coordinate functions from global inter…

Researchers introduced GRAPE, a training framework that progressively exposes neural network parameters to improve adversarial robustness. On CIFAR-10 with ResNet-18, GRAPE achieved 56.94% PGD-20 robust accuracy, a 5.24 …

Researchers achieved 98.91% accuracy in multimodal emotion recognition from physiological signals by combining LSTM, TCN, and Transformer models with late-fusion ensemble on the WESAD dataset. Transformer models excelled…

Researchers introduced a hierarchical model for ball action anticipation in football broadcast video, achieving 17.91% mAP on the SoccerNet benchmark. The system uses a GRU and Transformer decoder with input-conditioned …

Researchers introduced a geometric framework to identify 'AI engrams'—identifiable memory traces in deep neural networks analogous to biological memory units. The method enables surgical manipulation of learned knowledge…

Researchers introduced UtVAA, an ultra-tiny Vision Transformer architecture with a novel Affix Attention block for mobile image classification. The smallest variant has 204.67K parameters and 53.95M FLOPs, achieving comp…

Researchers from an undisclosed institution introduced Convolutional Nearest Neighbors (ConvNN), a unified framework that shows convolution and self-attention are special cases of k-nearest neighbor aggregation. ConvNN c…

Neural resonance theory (NRT) proposes that musical preferences are innate and biological, driven by the brain's physical resonance with sound frequencies. According to NRT, the nervous system syncs to music, favoring si…

A developer explains that a neural network is not magic but a mechanical process of weighted detectors stacked in layers, turning raw input into higher-level features to make a decision. The network starts with random we…

Researchers at Hiroshima University and Nagoya University developed a machine learning tool called SPERRFY that decoded how gene activity patterns guide neural wiring across the mouse brain. The study, published in PNAS,…

A single dose of psilocybin, the active ingredient in magic mushrooms, induced anatomical brain changes detectable a month later in healthy first-time users, according to a study by researchers at Imperial College London…

A developer has built a scientific computing platform called Cognitive Discovery System entirely in pure Python without NumPy, achieving O(N log N) FFT, O(N³) LU decomposition, and a quantum state-vector simulator with O…

A developer explains how the Transformer architecture works, from self-attention to modern LLMs. The key innovation is that Transformers compare tokens directly via attention rather than processing sequences step by step…

VisionWave Holdings (Nasdaq: VWAV) filed a U.S. provisional patent application for its SDNN (Symbiotic Deep Neural Network) architecture, encompassing a 455-page specification. The early-stage, pre-revenue technology tar…

Russian scientists at the Moscow Institute of Physics and Technology developed an AI algorithm that predicts extreme Arctic weather with five times higher effective resolution than global climate models. The neural netwo…

Researchers argue that the 'lottery ticket' analogy for overparameterized neural networks is misleading, proposing instead that wider networks succeed by expanding optimization dimensions to escape bad minima. The study …

Bright Kwaku Manu et al. introduced LANTERN, a longitudinal attribute-conditioned neural network that estimates multi-state health-transition probabilities from irregular health records. Using Health and Retirement Study…

Researchers led by Yi-Ran Xue introduced phase-gradient estimators for neural-network quantum states in a paper submitted to arXiv on June 11, 2026. The direct estimator reduces variance in phase gradients, and an adapti…