Neural Networks news and analysis on Web Pulse: 1263 curated articles tracking the latest Neural Networks developments, tools, and research, updated continuously from vetted sources.
A perceptron, the simplest neural network, was introduced by Frank Rosenblatt in 1958. This article demonstrates building a perceptron from scratch in Python to classify numbers as positive or negative, showing how it le…
Ernest Chan presented Conditional Portfolio Optimization (CPO), a machine-learning method that trains a neural network to predict portfolio performance based on market features and then solves a constrained optimization …
OpenAI’s GPT models and Meta’s LLaMA-family use transformer architectures that convert text into token IDs, then map each ID to a dense vector via an embedding matrix. These vectors are combined with positional encodings…
A new interactive simulation allows users to ask questions to a digital recreation of Albert Einstein, with the AI model's neural network visually lighting up in real-time to show which parts of the "brain" are processin…
A speculative proposal argues that training massively overparameterized neural networks with extremely high learning rates on small, diverse datasets could trigger a "catapulting" effect, producing human-like generalizat…
A new machine learning paradigm treats relational databases as graphs, enabling graph neural networks to learn directly from the raw schema without manual feature engineering. The approach, detailed in a 2023 paper by Fe…
A new analysis of metastable states in transformer activation spaces confirms that token representations cluster into metastable groups across layers in trained models, as predicted by a recent dynamical systems theory, …
In an experiment on Gemma-2-2B's residual stream, researchers found that transformers store long-range contextual information in a compact, low-dimensional subspace of roughly 31 directions, rather than spreading it acro…
Researchers have established a mathematical correspondence between hierarchical decision trees and diffusion processes, unifying the two model classes under a shared optimization principle called Global Trajectory Score …
A new paper argues that natural selection's inability to resolve small fitness differences due to noise can make evolution effectively non-myopic, enabling the emergence of "individuals" as coalitions of lower-level repl…
OpenCV 5.0 was released today as a major update to the open-source computer vision library, featuring a rewritten deep neural network engine and built-in support for large language and vision language models. The new ver…
NVIDIA released Nemotron 3.5 ASR, a 600M-parameter streaming speech recognition model that transcribes 40 language-locales in real time from a single checkpoint. The model uses a cache-aware FastConformer-RNNT architectu…
Access to a research paper titled "Adaptive Low-Rank Transformer with Dynamic Expert Routing for Continual Learning" has been blocked due to unusual traffic from the user's network. The restriction was triggered at 09:16…
A developer benchmarked quantum circuit simulation backends using a 20-qubit VQE workload on an NVIDIA RTX 5090 GPU, finding JAX/XLA 12.4x faster than PyTorch and 15.7x faster than TorchQuantum for post-compilation value…
Jürgen Schmidhuber, a pioneer in artificial intelligence whose lab developed foundational ideas like LSTM, world models, and artificial curiosity decades before they became mainstream, argued in a new interview that larg…
Researchers have developed GITCO, a gated inference-time context optimization framework that improves time series foundation model accuracy by selectively identifying and suppressing harmful data patches without modifyin…
A new study published in Nature reveals that large language models can transmit behavioral traits like animal preferences or misalignment to other models through semantically unrelated training data, such as number seque…
Researchers introduced Tangram, a serving system that enables non-uniform Key-Value cache compression for multi-turn large language model inference. The system uses deterministic budget allocation, head group page cluste…
A developer has released SEFERIM / ThatAIGuyCore, an open-source cognitive substrate built from a 69-equation mathematical specification across 13 systems. The framework models cognition as a 16-dimensional meta-state go…
A comprehensive guide titled "ML Bible" has been released, covering machine learning topics from classical algorithms to neural networks, transformers, vision, and agents. The resource provides a from-scratch approach to…