Neural Networks news and analysis on Web Pulse: 1262 curated articles tracking the latest Neural Networks developments, tools, and research, updated continuously from vetted sources.
Flourish Labs has secured $500 million in funding to develop a new approach to artificial intelligence based on neuroscience principles. The company aims to reinvent AI by leveraging insights from brain function, potenti…
Researchers propose LEAP, a training curriculum for Vision Transformer feature-based knowledge distillation that uses the teacher's intermediate feature maps as progressively difficult targets. LEAP achieves 90.1% accura…
Researchers propose a physics-informed framework to discover anisotropic yield functions from full-field displacement and reaction force data, using a convex neural network representation. The method avoids direct stress…
Researchers proposed a hybrid GNN-FEM framework for phase-field fracture simulation that integrates a graph neural network surrogate into the conventional staggered scheme, replacing the phase-field update while retainin…
A new study measures the linearity of transformer feed-forward blocks, finding that linear recoverability (R²_lin) varies widely across blocks and is a learned property, not an architectural one. The analysis of GPT-2, P…
Researchers introduced the Integral Transform Network (ITNet), a unified architecture that subsumes convolution, attention, and recurrence as special cases of a learnable integral transform. ITNet matches or exceeds spec…
Researchers introduced SSProNet, a secondary-structure-aware graph neural network for protein representation learning that uses energy-filtered hydrogen-bond graphs. The model outperforms existing graph-based methods on …
Researchers introduced LooseControlVideo, a framework that uses sparse, oriented 3D boxes as a proxy for spatial blocking in text-to-video generation, enabling intuitive control over layout and trajectory. Fine-tuned on …
Researchers derived a three-force decomposition of AdamW training dynamics explaining Weibull weight-scale parameter evolution in transformers, finding alignment force dominates growth. A spline displacement method recov…
Integer quantization reduces neural network memory and energy costs by converting high-precision values to lower-bit integers, with INT8 additions consuming 30 times less energy than FP32. The technique leverages hardwar…
Chinese scientists developed a brain implant electrode array thinner than a hair and softer than brain tissue, which recorded neural activity with high clarity for 18 months in animal trials without performance decline, …
A new research piece from Rudrite Research compares three generative modeling approaches: Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), and Diffusion Models, explaining how each learns a data d…
The Continuum Memory System introduces a novel architecture that replaces the Transformer's two-rate memory with a spectrum of blocks, each updating on its own clock, potentially improving efficiency and performance in A…
A developer explains that self-attention is a matrix operation, not just a mechanism for looking at important words. The post breaks down the QKV projection, scaling, softmax, and weighted sum that enable Transformers to…
Scientists at Harvard Medical School discovered that the stress hormone cortisol helps lock in early neural connections by signaling astrocytes to close critical periods of brain plasticity. The study, published in Natur…
A study published in Social Cognitive and Affective Neuroscience found that lonely individuals perceive themselves as less empathic, but Loving Kindness Meditation did not increase empathy despite reducing loneliness. Th…
A new essay provides a framework for evaluating neurotechnology approaches, outlining key questions about brain state measurements and their relevance to applications. The author, drawing on expert conversations, aims to…
A developer created GNEISS, a CLI tool that uses graph neural networks to detect architectural decay in Java repositories. The tool parses imports, builds a dependency graph, and runs it through a neural network pipeline…
Researchers improved short-range phytoplankton forecasts in the North-West European Shelf by up to 30% by assimilating neural network-predicted surface nitrate into the Met Office forecasting system, addressing biases fr…
Researchers Antoine Pesenti and Aidan O'Sullivan combined deep neural networks with explainable AI techniques to analyze electricity price formation across 39 European bidding zones, identifying renewable sources, partic…