Questions tagged [parallelization]
Questions on parallel computing in Mathematica.
194
questions with no upvoted or accepted answers
19
votes
0answers
187 views
Status of all Evaluators?
Since I have 4 cores on my machine I typically have 4 notebooks open each with their own kernel evaluator. I'd like to construct a dynamic pane similar to the parallel kernels status window:
But that ...
14
votes
0answers
464 views
Mathematica HPC on AWS vs. Azure
I am looking for advice on deploying Mathematica for HPC in an on-demand cloud environment. I occasionally have Mathematica projects that require parallel computing and large amounts of RAM. These ...
13
votes
0answers
4k views
Threads vs Cores: How many kernels need to launch in parallel Mathematica?
I have a dual-core intel machine. I would like to test how many parallel local kernels should be launch to get the optimized performance. Knowing that the HyperThreading technology of Intel could run ...
8
votes
0answers
1k views
ParallelTable kernels die - maybe Mathlink timeout?
I am new to parallel computing in Mathematica. I am using
LaunchKernels[16]
ParallelTable[]
to parallelize calculations. The ParallelTable consists of approx ...
7
votes
0answers
66 views
What's with the weird HoldRest Attribute of ParallelMap?
Bug introduced in 10.0 or earlier and persisting through 11.1
I have noticed some odd behavior of ParallelMap: When the list, that is mapped over, is not inserted ...
7
votes
0answers
128 views
ParallelSubmit executes only on one kernel
I'm trying to use Parallesubmit to run some calculations in parallel, but it looks like all the calculations are evaluated at one kernel. Consider this example:
<...
7
votes
0answers
301 views
WolframScript never exits (v11 only)
after updating to version 11, I came across a problem with the execution of package files via bash.
The WolframScript program runs the entire code, but frequently it does not exit properly and as a ...
7
votes
0answers
167 views
Bug: Calling `SetSharedVariable` while kernels are running hangs them up/crashes them
Bug introduced in 9.0 or earlier and persisting through 11.0.1 or later
Start a fresh kernel Quit, and maybe launch ...
6
votes
0answers
485 views
How to force the compilation language to be C++ (not C) in CreateExecutable or CreateLibrary
I'm trying to speed up a section of a Mathematica 9.0.1 notebook by performing some calculations in C++ with the Cilk Plus and Threading Building Blocks tools available for the Intel C++ 14.0 compiler ...
6
votes
0answers
525 views
Parallelizing is much slower than single kernel evaluation?
Starting with a vector of matrices, tVec, I would like to parallelize the multiplication of each element with the same matrix ...
5
votes
0answers
117 views
Optimize Use of PeakDetect in Mathematica
I am quite new to Mathematica and I am looking for some advice in order to improve and optimize my code.
Here is what I am trying to do:
Open a stream
Read the stream line by line and store it in "...
5
votes
0answers
82 views
Random number generation within Compile and Parallelization->True
According to this thread RandomChoice is a compilable function.
I use it to generate random numbers in a compiled function with parallelization enabled.
I wrote ...
5
votes
0answers
36 views
Efficient Parallelization of PermutationReplace
I am generating the orbit of a partition of a set of size $n$ under the action of the symmetric group $S_n$. PermutationReplace won't allow itself to be parallelized. Why is this ? Is it because the ...
5
votes
0answers
329 views
Can't Launch Kernels, Updating from Wolfram Research Server
So, I'm running Mathematica on an HPC cluster using the math module command line interface. I'm trying to figure out some problems with attempting to parallelize my ...
5
votes
0answers
201 views
ParallelTable slow down, Region functions
I am experiencing speed issues with ParallelTable. There are a few related problems on SX posted here and here, but no resolution. The various respondents to those ...
5
votes
0answers
81 views
The change of precision doesn't work in ParallelDo. Is it a bug in Parallel?
Cross-post: http://zhidao.baidu.com/question/2075301703219376588.html
Input:
...
5
votes
0answers
388 views
Mathematica + RasPi + Parallela = Kaboom?
Is it possible to use the Parallela computing platform to enhance Mathematica computing on a Raspberry Pi?
It's not at all clear to me how to interface the two boards (here it says it's done via ...
5
votes
0answers
516 views
Death of parallel sub-kernels
EDIT : Finally, the new Mathematica 10.0 seems to fix it.
I have a little parallelization problem. I wrote a code to generate a quasicrystal by dynamical generation. Here the code:
...
5
votes
0answers
206 views
Raster with ColorFunction is blank when Dynamic Updating is disabled
UPDATE
Today I was having these WaveletScalogram problems again. I think this is ultimately some kind of interaction issue with Dynamic. I have narrowed it down to ...
4
votes
0answers
89 views
How to do parallel computation when using LinearProgramming function?
I have a LP problem which contains 2n+3 variables with 4n+6 inequality constraints. I was trying to use Mathematica's LinearProgramming function. When n is small, like less than 30, it gives outcome ...
4
votes
0answers
104 views
How to speed up code in ParallelDo loops?
I have a piece of code that I'm trying to run in a ParallelDo over 32 kernels. Using a normal Do loop in a kernel Mathematica ...
4
votes
0answers
101 views
Problem with Parallelization when using Packages
I tried to find a solution to my problem in several answers posted in MSE but due to lack of my knowledge on parallelization territory, I couldn't figure out solution to my problem.
I have a big code ...
4
votes
0answers
104 views
Is there a clean way to parallelize multi-index tables?
The documentation of ParallelTable indicates that if you want to parallelize the evaluation of a table of more than one dimension, such as
...
4
votes
0answers
149 views
Improving the speed of an optimization algorithm via compilation and parallellization
I have written an implementation of eight variants of the PSO-algorithm and I want to test them over a set of test functions. I am using parallelization as it improves the speed a lot and I have also, ...
4
votes
0answers
354 views
Parallel Kernels and Hyperthreading
I am using Eigenvalues a large number of times on a machine with 8 cores. When I run Eigenvalues one time without any parallel ...
4
votes
0answers
137 views
ParallelSubmit and WaitNext: check if a job is done before calling WaitNext
Say I process something with ParallelSubmit:
LaunchKernels[]
job = ParallelSubmit[1 + 2]
Parallel`Developer`QueueRun[]
Then, I will use ...
4
votes
0answers
501 views
Parallel Kernel Status
For parallel computing, the window Parallel Kernel Status shows some information on the subkernels. I can use two kernels, and which each of them I can do parallel computations. However, it seems that ...
4
votes
0answers
709 views
OpenCL vs. CUDA with Mathematica
I am thinking about using GPU programming with Mathematica using a MacBook Pro with a NVIDIA GPU. At this page, the Mathematica documentation says "Programming OpenCL in the Wolfram Language is simple ...
4
votes
0answers
164 views
ParallelTable and expensive functions
I would like to build up a 2D-Table using ParallelTable as follows
...
4
votes
0answers
168 views
LibraryLink parallel performance
I'm trying to use a LibraryLink function in parallel. It is an embarrassingly parallel problem, so that no dependency between those parallel tasks. However I can only get the parallel efficiency about ...
4
votes
0answers
952 views
Remote kernel shuts down after several seconds
I have Mathematica 9 installed on two Windows Server 2008 R2 machines. Now i want to try using one of them as a frontend with local kernels and the other one for remote kernels.
OpenSSH 6.5 for ...
4
votes
0answers
269 views
4
votes
0answers
201 views
How can you link Parallel Mapping and Error tracking
Following this question and the comments made, together with the information in this question, the following code allows error tracking and debugging very nicely.
...
4
votes
0answers
352 views
Mathlink and multithreading
In order to make my computations faster I have developed a C/C++ application calling Mathematica kernel and performing many operations using Mathematica functions for equation solving.
Now I want to ...
3
votes
0answers
32 views
ParallelDo and Reap/Sow in combination fails
I just realized the following problem. I tried to speed up a program that reads hundreds of files each of size up to 200+ MB and processes them, therefore I changed a ...
3
votes
0answers
84 views
Parallel evaluation of RandomVariate for an InterpolatingFunction
I need to generate a lot of point according to a given distribution. I don't have an analytic form of this distribution so I am using an InterpolatingFunction of ~100 points computed numerically. I ...
3
votes
0answers
48 views
How can I prevent ParallelTable[] from freezing?
I have spent some time trying to figure this out.
I have a function that appears to be the reason my program is freezing. I am using both MemoryConstrained[] and <...
3
votes
0answers
35 views
Getting a Stack Trace on parallel execution
I find debugging very difficult in Mathematica, perhaps because I am unfamiliar with the appropriate tools. Ideally, I would like a "break on error" like Matlab with step control, however for the ...
3
votes
0answers
86 views
Language`ExpressionStore and ParallelMap
Is there a way to access NewExpressionStore from within a parallelized calculation? I have tried variations of
...
3
votes
0answers
76 views
Too many scheduled tasks (with parallelization)
I have a program that makes many http requests (gathering data from APIs), and computes on that data. Speed is a priority and using the most up to date data in the computations is a priority. ...
3
votes
0answers
55 views
Circumvent DistributeDefinitions
I have a code in which I create a few very large matrices with which I need to do long calculations. I have parallelised my code and, in the end, the thing that slows me the most is the time it takes ...
3
votes
0answers
51 views
ParallelDo with NotebookDirectory[]
I have a main directory with subdirectories numbered (1, 2, 3, ...). In each folder there is an exe file. I execute this code:
...
3
votes
0answers
62 views
“ParallelDo” does not calculate the function well
Now, I'm solving utility maximization problem.
...
3
votes
0answers
664 views
Get::noopen: Cannot open CloudObjectLoader` error when running Mathematica on remote cluster
I have been running Mathematica on a remote cluster for quite sometime. Recently, any jobs that call LaunchKernels[] for parallelization return the error
Get::...
3
votes
0answers
86 views
Wolfram math on windows using PBSPro cluster
A user wishes to use math application running on our PBSPpro cluster.
Our cluster is accessible to linux users, running qsub to submit their jobs.
We have math10.4 for our cluster users, with ...
3
votes
0answers
117 views
3
votes
0answers
90 views
Parallelize Dateset query
I would like to evaluate a Dataset query in parallel, my latest approach being:
...
3
votes
0answers
89 views
Where do DistributeDefinitions and ParallelNeeds put their definitions for newly-launched kernels to find
I'm sorry to keep banging on the definition distribution bell, but here is another (hopefully well-focused enough) question on that vein.
If one is trying to distribute the definitions in a package ...
3
votes
0answers
100 views
Why is a LibraryLink function, which returns a list, not parallelizing with ParallelTable?
First example: librarylink function return a list of two element
...
3
votes
0answers
292 views
`ParallelTable` pending the MathKernel after execution
I have done a ParallelTable computation in script mode. After execution, the output is fine and I've got all the data I needed. but the kernel seems pending, ...
