We will post a series of resources to interesting tutorials and articles on parallel computing. In that series, the first is my favorite one by Blaise Barney of Lawrence Livermore National Laboratory.
From the author’s description, this tutorial covers the very basics of parallel computing, and is intended for someone who is just becoming acquainted with the subject. It begins with a brief overview, including concepts and terminology associated with parallel computing. The topics of parallel memory architectures and programming models are then explored. These topics are followed by a discussion on a number of issues related to designing parallel programs. The tutorial concludes with several examples of how to parallelize simple serial programs.
“In the simplest sense, parallel computing is the simultaneous use of multiple compute resources to solve a computational problem:
* To be run using multiple CPUs
* A problem is broken into discrete parts that can be solved concurrently
* Each part is further broken down to a series of instructions
* Instructions from each part execute simultaneously on different CPUs ”
12 responses so far ↓
1 Parallel Programming Tutorial Series - Part 2 - MapReduce // May 25, 2009 at 7:21 am
[...] Parallel Programming Tutorial Series - Part 1 - Basics [...]
2 Parallel Programming Tutorial Series - Part 4 - OpenMP // Jun 10, 2009 at 7:08 am
[...] part of parallel programming tutorial series, we linked to Blaise Barney’s parallel computing tutorial, to MapReduce tutorial, and to an MIT course on Cell processor programming. In this post, we [...]
3 Parallel Programming Tutorial Series - Part 5 - Pthreads // Jun 21, 2009 at 5:53 pm
[...] part of parallel programming tutorial series, we linked to basic parallel computing tutorial, to MapReduce tutorial, to an MIT course on Cell processor programming and to OpenMP tutorial. In [...]
4 Parallel Programming Tutorial Series - Part 6 - TBB // Jun 23, 2009 at 5:46 am
[...] many resources of parallel programming tutorials. The following are the ones we have linked so far. Basic parallel computing tutorial MapReduce tutorial Cell processor programming OpenMP tutorial PThreads [...]
5 Parallel Programming Tutorial Series - Part 7 - MPI // Jul 1, 2009 at 6:32 am
[...] many resources of parallel programming tutorials. The following are the ones we have linked so far. Basic parallel computing tutorial MapReduce tutorial Cell processor programming OpenMP tutorial PThreads Tutorials Intel Threading [...]
6 Parallel Programming Tutorial Series - Part 8 - CUDA // Jul 25, 2009 at 4:50 pm
[...] many resources of parallel programming tutorials. The following are the ones we have linked so far. Basic parallel computing tutorial MapReduce tutorial Cell processor programming OpenMP tutorial PThreads Tutorials Intel Threading [...]
7 Parallel Programming Tutorial Series - Part 9 - OpenCL // Aug 22, 2009 at 6:57 am
[...] many resources of parallel programming tutorials. The following are the ones we have linked so far. Basic parallel computing tutorial MapReduce tutorial Cell processor programming OpenMP tutorial PThreads Tutorials Intel Threading [...]
8 Parallel Programming Tutorial « The Quintessential Geek // Aug 22, 2009 at 8:09 am
[...] Parallel Programming Tutorial [via Multi Core Info] [...]
9 satish b p // Nov 27, 2009 at 2:24 am
my request is add ppt about cilk++ parallel programming language.
10 Multicore Review: Best Multicore Posts of 2009 // Dec 20, 2009 at 9:26 am
[...] Parallel Programming Tutorial Series - Part 1 - Basics [...]
11 Parallel Programming Tutorial Series - Part 9 - OpenCL (Updated) // Mar 26, 2011 at 6:17 am
[...] many resources on parallel programming tutorials. The following are the ones we have linked so far. Basic parallel computing tutorial MapReduce tutorial Cell processor programming OpenMP tutorial PThreads Tutorials Intel Threading [...]
12 Parallel Programming Tutorial Series – Part 1 – Basics | HARD-SOFT Something More // Aug 27, 2012 at 12:27 am
[...] Parallel Programming Tutorial Series – Part 1 – Basics. Share this:ShareFacebookLinkedInTumblrTwitter HARDSOFT TCSP [...]