{"slug": "programming-massively-parallel-processors-5th-ed-morgan-kaufmann", "title": "Programming Massively Parallel Processors, 5th Ed(Morgan Kaufmann)", "summary": "The 5th edition of 'Programming Massively Parallel Processors' by Wen-mei W. Hwu, David B. Kirk, and Izzat El Hajj, published by Morgan Kaufmann, introduces new chapters on filtering, wavefront parallelism, and large language models, along with expanded coverage of CUDA features such as warp-level programming and multi-GPU programming with NCCL and NVSHMEM.", "body_md": "|\nThis book explains the basic concepts of parallel programming and GPU architecture. Concise, intuitive, and practical, it is based on years of road-testing in the authors' own parallel computing courses. Wen-mei W. Hwu, David B. Kirk and Izzat El Hajj explain various techniques for constructing and optimizing parallel programs are explored in detail, while case studies demonstrate the development process, which begins with computational thinking and ends with effective and efficient parallel programs. This new edition has been updated with an expanded repertoire of optimizations, new patterns and applications, ad more coverage of important CUDA features.\n<ASIN:0443439001 >\nAuthor: Wen-mei W. Hwu, David B. Kirk and Izzat El Hajj Publisher: Morgan Kaufmann Date: oJune2026 Pages: 680 ISBN: 978-0443439001 Print: 0443439001 Kindle: B0DRCSRMXC Audience: General Level: Intermediate Category: [Theory & Techniques ](/bookreviews/20-theory.html)\nTopics include:\n- Expanded optimization checklist with a more comprehensive demonstration of essential optimizations across patterns\n- New pattern and application chapters including: filtering, wavefront parallelism, advanced optimizations for matrix multiplication, and large language models (LLMs)\n- More coverage of important CUDA features including warp-level programming, cooperative groups, CUDA C++ atomics, and multi-GPU programming with NCCL and NVSHMEM\n**For more Book Watch just **[click](http://www.i-programmer.info/book-watch-archive.html).\n*Book Watch is I Programmer's listing of new books and is compiled using publishers' publicity material. It is not to be read as a review where we provide an independent assessment. *\n**To have new titles included in Book Watch contact **[BookWatch@i-programmer.info](mailto:BookWatch@i-programmer.info)\nSubscribe to I Programmer's [Books RSS feed ](http://www.i-programmer.info/component/ninjarsssyndicator/?feed_id=2&format=raw)for each day's new addition to Book Watch and for new reviews.\n** **\n[Beginning Programming All-in-One For Dummies](/bookreviews/14-other-languages/16342-beginning-programming-all-in-one-for-dummies.html)\nAuthor: Wallace Wang Publisher: For Dummies Pages: 800 ISBN: 978-1119884408 Print: 1119884403 Kindle: B0B1BLY87B Audience: Novice programmers Rating: 3 Reviewer: Kay Ewbank\nThis is a collection of seven shorter books introducing key aspects of programming, but it fails through trying to cover too [ ... ]\n|\n[The Rust Programming Language, 2nd Ed](/bookreviews/14-other-languages/16530-the-rust-programming-language-2e.html)\nAuthor: Steve Klabnik and Carol Nichols Publisher: No Starch Press Date: June 2023 Pages: 560 ISBN: 978-1718503106 Print: 1718503105 Kindle: B0B7QTX8LL Audience: Systems programmers Rating: 4.8 Reviewer: Mike James\nThere's a new edition of what has become the standard text on Rust. Has it matured along with [ ... ]\n| | More Reviews |\n|", "url": "https://wpnews.pro/news/programming-massively-parallel-processors-5th-ed-morgan-kaufmann", "canonical_source": "http://www.i-programmer.info/book-watch-archive/19033-programming-massively-parallel-processors-5th-edmorgan-kaufmann.html", "published_at": "2026-07-27 16:52:01+00:00", "updated_at": "2026-07-27 17:04:30.850721+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models"], "entities": ["Wen-mei W. Hwu", "David B. Kirk", "Izzat El Hajj", "Morgan Kaufmann", "CUDA", "NCCL", "NVSHMEM"], "alternates": {"html": "https://wpnews.pro/news/programming-massively-parallel-processors-5th-ed-morgan-kaufmann", "markdown": "https://wpnews.pro/news/programming-massively-parallel-processors-5th-ed-morgan-kaufmann.md", "text": "https://wpnews.pro/news/programming-massively-parallel-processors-5th-ed-morgan-kaufmann.txt", "jsonld": "https://wpnews.pro/news/programming-massively-parallel-processors-5th-ed-morgan-kaufmann.jsonld"}}