A brief history of learning in imagination
Learning in imagination, a model-based reinforcement learning approach that trains policies solely on data generated by an action-conditioned world model, addresses sample efficiency by generating dat…
Learning in imagination, a model-based reinforcement learning approach that trains policies solely on data generated by an action-conditioned world model, addresses sample efficiency by generating dat…
Vision Transformers (ViTs) treat images as sequences of patches, using self-attention to capture global context, unlike Convolutional Neural Networks (CNNs) that focus on local features. Introduced in…
Elon Musk agreed with a viral tweet arguing that 1990s 3D games like id Software's Doom were the precursor to modern AI, replying 'True' to a post by X user Dan (@KettlebellDan). The theory holds that…
Marvin Minsky's 1986 observation that humanity lacks experience with complex machines remains relevant as AI evolves from Frank Rosenblatt's 1957 perceptron to modern deep learning, with AlexNet's 201…
An audit of the NeurIPS 2025 and ICML 2025 Position Paper Tracks finds that three-quarters of accessible submissions critique existing benchmarks, evaluations, or methodologies, while agenda-shifting …
Researchers introduce Explorative Modeling (XMs), a new paradigm that factors the training loop by exploring K candidate matches between model generations and data, improving performance across images…
ForensicNet, a lightweight deep learning framework combining MobileNetV2 with Convolutional Block Attention Modules, achieves 92.4% accuracy and 90.8% precision on face identification across 15,000 im…
Geoffrey Hinton, the British-Canadian computer scientist whose foundational work on neural networks and deep learning underpins modern artificial intelligence, won the 2024 Nobel Prize in Physics join…
Microsoft researchers introduced ResNet in 2015, a neural network architecture that uses skip connections to solve the degradation problem in deep networks. By allowing layers to learn residual mappin…
In 2012, Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton published the AlexNet paper at NIPS, introducing a deep convolutional neural network architecture that revolutionized computer vision by w…
The AI industry is facing a shift from computation to memory as the fundamental primitive for intelligent systems, according to Andrej Karpathy. Just as GPUs replaced CPUs as the dominant compute arch…
Some AI researchers argue that scaling large language models may not be sufficient to achieve human-level intelligence, pointing to alternative approaches such as world models, pure reinforcement lear…
Nvidia became the first company to reach a $5 trillion market capitalization on October 29, 2025, driven by its early bet on parallel computing through CUDA in 2006. The company's chips, initially use…
Arena, an AI evaluation platform born at UC Berkeley, reached a $100M annual revenue run rate eight months after launching its product, as demand surges for benchmarks that measure real-world AI utili…
Shrijith Venkatramana, building git-lrc, explains how scaling laws discovered by OpenAI, Google, DeepMind, and Anthropic made large language models like ChatGPT, Claude, and Gemini possible. The 2020 …
A developer traces the 70-year history of AI from symbolic systems to modern transformer-based models, highlighting key milestones like the 1956 Dartmouth Workshop, expert systems, the first AI winter…
A developer argues that the current AI revolution is fundamentally different from past waves of enthusiasm, citing the convergence of large-scale labeled data, GPU computing, and deep network architec…
At the ninth MLSys conference in Seattle, researchers and industry leaders focused overwhelmingly on improving the efficiency of training and deploying large language models, with specialized hardware…
The next frontier for medical AI is building "world models" that can predict how a biological state changes in response to an intervention, moving beyond current systems focused on classification or q…
"branch specialization" as a large-scale structural phenomenon in neural networks, where layers split into branches and neurons self-organize into functional units similar to biological brain regions.…