Parallel computing in Mathematica is based on launching and controlling multiple Mathematica kernel (worker) processes from within a single master Mathematica, providing a distributed-memory environment for parallel programming. Questions about starting, scheduling, waiting for and finishing processes in parallel and exchanging data between processes should use this tag.
A lot of parallelization is done autmatically (Parallelize, ParallelEvaluate, ParallelTry, ...). Many common data-handling functions also have parallel twins (ParallelMap, ParallelTable, ParallelSum, ...)
Some useful knowledge about parallel computation:
Some example questions:
- Are built-in Mathematica functions already parallelized?
- Transferring a large amount of data in parallel calculations
- Is it possible to speed up ContourPlot on multi-core machines?
If you are looking for performance optimization consider using the tag performance-tuning too.