Machine learning news — deep learning, reinforcement learning, neural architecture search, diffusion models, and new ML frameworks and libraries.
Based on the provided text, the article is a Jupyter Notebook file titled "Quant Rating Calculation.ipynb" that failed to load or display properly. The body contains only error messages indicating the file is invalid, ca…
Introductory overview of Graph Neural Networks (GNNs), explaining how neural networks can be adapted to process data structured as graphs. It covers the fundamental components of GNNs, explores why graphs are a powerful …
This article from Distill explains graph neural networks (GNNs), a family of neural networks designed to operate on graph-structured data like social networks and molecules. It highlights the challenges of computing over…
The article investigates the robustness of Neural Cellular Automata (CA) by training adversarial models to hijack the system's behavior. It explores two types of attacks: injecting adversarial cells into a grid and pertu…
"weight banding," a structural phenomenon in neural networks where the weights in the final convolutional layer of vision models using global average pooling display a uniform spatial pattern, particularly horizontal str…
"branch specialization" as a large-scale structural phenomenon in neural networks, where layers split into branches and neurons self-organize into functional units similar to biological brain regions. This phenomenon occ…
Researchers discovered that artificial neural networks like CLIP contain "multimodal neurons" that respond to abstract concepts (such as "Spider-Man") across different input modalities like images and text. The team deve…
The article explores the use of Neural Cellular Automata (NCA) for texture synthesis, focusing on reproducing the general appearance of textures rather than exact copies. The authors argue that NCA are well-suited for th…
Challenge of understanding neural networks by visualizing their weights, comparing it to reverse engineering compiled code or studying biological neural networks. It notes that despite the importance of weights, research…
Reverse engineering of a learned algorithm from a neural network's weights, using its core principles to build a new artificial neural network from scratch. It also outlines the specific contributions of various research…
Individual neurons within convolutional neural networks often form "transformed versions of the same basic feature," such as rotated, scaled, or color-shifted copies, creating a form of internal symmetry called equivaria…
"self-classifying MNIST task," where a grid of locally-communicating agents, operating under identical rules, must determine which digit their collective shape forms without any agent knowing its global position. The res…
Distill thread exploring differentiable self-organizing systems, which use optimization to learn individual agent behaviors that achieve collective goals. It presents several research articles on topics like morphogenesi…
Bayesian optimization is a technique used to tune hyperparameters in machine learning algorithms by optimizing black-box functions. The article explains the process using a gold mining analogy, where the goal is to find …
Overview of the first five layers of the InceptionV1 neural network, categorizing its early vision neurons into "neuron families" that detect features ranging from raw pixels to sophisticated shapes and small heads. The …
Deep neural networks can be understood as pipelines of simple functions, and that the intermediate values (or "activations") within these networks can be viewed as high-dimensional vectors. To analyze training behavior, …
The article lists IT internship programs offered by major Russian companies, including Yandex, Sberbank, VK, Tinkoff, Ozon, and Avito. Each company provides opportunities in various fields such as software development, d…