Programming Massively Parallel Processors, 5th Ed(Morgan Kaufmann) The 5th edition of 'Programming Massively Parallel Processors' by Wen-mei W. Hwu, David B. Kirk, and Izzat El Hajj, published by Morgan Kaufmann, introduces new chapters on filtering, wavefront parallelism, and large language models, along with expanded coverage of CUDA features such as warp-level programming and multi-GPU programming with NCCL and NVSHMEM. | This book explains the basic concepts of parallel programming and GPU architecture. Concise, intuitive, and practical, it is based on years of road-testing in the authors' own parallel computing courses. Wen-mei W. Hwu, David B. Kirk and Izzat El Hajj explain various techniques for constructing and optimizing parallel programs are explored in detail, while case studies demonstrate the development process, which begins with computational thinking and ends with effective and efficient parallel programs. This new edition has been updated with an expanded repertoire of optimizations, new patterns and applications, ad more coverage of important CUDA features.