By Kathy Farrel
Peter Pacheco is Professor of Computer Science and Mathematics at the University of San Francisco
His main research interest is parallel computing. He’s been involved in the development of the MPI Standard for message-passing. His book “Parallel Programming with MPI” is an elementary introduction to programming parallel systems that use the MPI [...]

[Read more →]

This article originally posted on August 24, 2009. Since then, OpenCL gained a lot of popularity and a number of tutorials and sample codes have been developed. In this article, we update the original article with recent resources and removing any dead links.
We provided many resources on parallel programming tutorials. The following are the ones [...]

[Read more →]

This book presents new concepts, techniques and promising programming models for designing software for chips with “many” (hundreds to thousands) processor cores. Given the scale of parallelism inherent to these chips, software designers face new challenges in terms of operating systems, middleware and applications. This will serve as an invaluable, single-source reference to the state-of-the-art [...]

[Read more →]

Fixstars Corporation announced the release of their OpenCL Programming Book which is available on Amazon Kindle, Apple iPad and Fixstars’ website.
OpenCL Programming Book
OpenCL is a parallel computing framework for programming multi-core systems, such as multi-core CPUs, GPUs, and Cell/B.E.. OpenCL multi-functionality is attracting attention as an efficient and highly portable open technology for software development.
The [...]

[Read more →]

Edited by Lambert M. Surhone, Miriam T. Timpledon, and Susan F. Marseken
X10 is a programming language being developed by IBM at the Thomas J. Watson Research Center as part of the PERCS project funded by DARPA’s High Productivity Computing Systems (HPCS) program. Its primary authors are Kemal Ebcioglu, Vijay Saraswat, and Vivek Sarkar. X10 is [...]

[Read more →]

Nvidia invites you to contribute to GPU Computing Gems, a contribution-based book that will focus areas on practical techniques for GPU computing in some key focus areas:
* scientific simulation
* video and image processing including compression
* engineering simulation
* computer vision
* numerical algorithms
* signal processing and audio processing
* life sciences
* interactive physics simulation and AI for games [...]

[Read more →]

by Gordon Haff
Intel’s James Reinders is an expert on parallelism; his most recent book covered the C++ extensions for parallelism provided by Intel Threaded Building Blocks. He’s also the Director of Marketing and Business for the company’s Software Development Products. In Part 1 of our discussion at the Intel Developers Forum in September we talked [...]

[Read more →]

Global software and services company Enea recently launched Enea OSE Multicore Edition. This product incorporates a one-of-a-kind kernel structure that brings together the benefits engrained in both the old fashioned Asymmetric Multiprocessing (AMP) and Symmetric Multiprocessing (SMP) and mitigates the negatives of both programming models. The company claims it helps developers of innovative [...]

[Read more →]

edited by Arrems Hua and Shih-Liang Chang
This book constitutes the refereed proceedings of the 9th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2009, held in Taipei, Taiwan, in June 2009. The 80 revised full papers were carefully reviewed and selected from 243 submissions. The papers are organized in topical sections on bioinformatics [...]

[Read more →]

High Performance Heterogeneous Computing
by Jack Dongarra and Alexey L. Lastovetsky
An analytical overview of the state of the art, open problems, and future trends in heterogeneous parallel and distributed computing This book provides an overview of the ongoing academic research, development, and uses of heterogeneous parallel and distributed computing in the context of scientific computing. Presenting [...]

[Read more →]

Paradigms for Fast Parallel Approximability
by Josep Diaz, Maria Serna, Paul Spirakis, and Jacobo Toran
This book is a survey of the basic techniques for approximating combinatorial problems using parallel algorithms. Its core is a collection of techniques that can be used to provide parallel approximations for a wide range of problems, such as flows, coverings, matchings, [...]

[Read more →]

by John E. West, for HPCwire
Petascale Computing: Algorithms and Applications, edited by David A. Bader (Chapman & Hall/CRC, 2007), is the first book in CRC’s Computational Science Series, edited by Horst Simon at Lawrence Berkeley National Lab. Although the book is a collection of papers, Bader has done an excellent job of creating a [...]

[Read more →]

Alan Dennis’ .NET Multithreading book is written for intermediate .NET developers who know C# or VB .NET, but are not assumed to have a background in multithreading.
With .NET you can develop stable and robust multithreaded applications with minimal effort. .NET Multithreading teaches the basics in an understandable and practical way. It then focuses on [...]

[Read more →]

From grids and clusters to next-generation game consoles, parallel computing is going mainstream. Innovations such as Hyper-Threading Technology, HyperTransport Technology, and multicore microprocessors from IBM, Intel, and Sun are accelerating the movement’s growth. Only one thing is missing: programmers with the skills to meet the soaring demand for parallel software.
That’s where “Patterns for Parallel Programming” [...]

[Read more →]

by John E. West, for HPCwire
Parallel Algorithms by Henri Casanova, Arnaud Legrand, and Yves Robert (CRC Press, 2009) is a text meant for those with a desire to understand the theoretical underpinnings of parallelism from a computer science perspective. As the authors themselves point out, this is not a high performance computing book — [...]

[Read more →]

The award-winning Introduction to Algorithms is the leading textbook on computer algorithms and the most cited reference in all of computer science. The book covers a broad range of algorithms in depth, yet makes their design and analysis accessible to all levels of readers.
The vast majority of algorithms in the book are serial algorithms [...]

[Read more →]

John Mueller reviews the book C# 2008 and 2005 Threaded Programming by Gastón C. Hillar.
C# 2008 and 2005 Threaded Programming by Gastón C. Hillar. 395 pages, Packt, January 2009. $39.99 ISBN: 978-1-847197-10-8
“This book begins with a look at the hardware (to an extent), which may not seem very interesting at first. However, it would be [...]

[Read more →]

InformIT provides a sample chapter (Introducing the Cell Processor) of the “Programming the Cell Processor: For Games, Graphics, and Computation” book by Matthew Scarpino.
Introducing the Cell Processor
“In September 2007, the Guinness Book of World Records announced the new record holder for the world’s most powerful distributed computing system. It wasn’t a traditional cluster of [...]

[Read more →]

by John West for HPCWire
“In Parallel Iterative Algorithms: From Sequential to Grid Computing (Chapman & Hall/CRC, 2008) Bahi, Contassot-Vivier, and Couturier bring mathematical formalism to the study of parallel iterative solution techniques, creating a book that will be useful to those with a strong maths background who are making the transition into parallel scientific computing. [...]

[Read more →]

John West of insideHPC writes a review of Principles of Parallel Programming book.
“In Principles of Parallel Programming (Addison Wesley, 2008), Lawrence Snyder and Calvin Lin have created a book that is useful for students and new practitioners alike. The text assumes that readers already have an understanding of basic computer science principles (how to [...]

[Read more →]