Questions tagged [parallelization]

Questions on parallel computing in Mathematica.

194 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
290 views

`ParallelTable` pending the MathKernel after execution

I have done a ParallelTable computation in script mode. After execution, the output is fine and I've got all the data I needed. but the kernel seems pending, ...
3
votes
0answers
405 views

AppendTo or Part in a ParallelDo?

I have a question regarding how memory is managed in parallel. Specifically, I'd like to know what is the better practice when constructing an array within a ...
3
votes
0answers
392 views

How many kernels to set based on CPU?

Looks like 4 kernels are enough? My CPU is i7 4790K as given here. Does it also depend on the tasks and the codes? My understanding is that regardless what the benchmark says, I could always use 8 ...
3
votes
0answers
143 views

k-means clustering in parallel

How can the k-means algorithm for some given distance function be implemented using ParallelMap or other parallel processing program constructs in Mathematica?
3
votes
0answers
517 views

Launching Remote Kernels takes a lot of time

I recently played around with establishing a remote kernel setup without using mathematica grid. To do this I use the LaunchKernels[] command and ...
3
votes
0answers
222 views

Whether NIntegrate evaluation is multithreaded or not?

About MultiThread evaluation I am talking about here, see this post I am NIntegrate the function grarm[e, 3, dimension, 1, 1, 0.005]. There is matrix operation in ...
2
votes
0answers
59 views

Launch Kernels on Windows 10 from Raspberry Pi (linux) over SSH

I am trying to launch remote kernels on a Windows 10 PC (remote) from a Raspberry Pi 4 (Master or local). Both machines have V12 installed. On the Windows machine, I have installed OpenSSH per ...
2
votes
0answers
71 views

ParallelSubmit does not trigger computations

I am having some problems with parallel computations. I'm afraid it may be a "known issue" but I haven't found any solution. In general, my script looks like this ("prepare" and "process" are my own ...
2
votes
0answers
44 views

Possible bug ParallelDo (or better practices for ParallelDo)

ParallelDo is having problems evaluate an expression that evaluates fine outside ParallelDo. The problem is not due to the use ...
2
votes
0answers
58 views

How can I deal with a SystemException?

I have a list of functions that are being evaluated, using ParallelTable[], and continue to get the error message: ...
2
votes
0answers
53 views

Problem with exporting PlotLabel using MaTeX in Parallel computation

Requires MaTeX, which can be found here. ...
2
votes
0answers
107 views

How can I avoid massive (waste) CPU usage by Mathematica?

I am using Mathematica on a Linux machine with 52 CPUs. I am sending my jobs in a batch mode and I am not using any parallel evaluation like ParallelTable[] or so. ...
2
votes
0answers
48 views

Compile with “Listable” only on one argument

I would like to write a Compiled function which is listable only in the first argument, because this allow fast and easy parallelization. How is it possible to do it? In the following way it does not ...
2
votes
0answers
61 views

ParallelDo with doubly-indexed iterators

What is the reason that ParallelDo works with singly-indexed iterators, but not doubly- or more-indexed iterators? For example, the code ...
2
votes
0answers
86 views

Why can't ImageTransformation be parallelized?

I have a rather complicated code for an ImageTransformation, which would benefit from some acceleration. Since every pixel is independend of every other, I tried Parallelize, which, in a simplified ...
2
votes
0answers
128 views

Parallelizing / speeding up a replacement rule over large list

I have a list of differentiated expression of the form {f[0,0,0],(f^(a,b,c))[0,0,0],...} where I have left the function as a general ...
2
votes
0answers
137 views

Why is my parallel version of `DensityPlot` slow?

I am exploiting the possibility to parallelize DensityPlot. This is my naive implementation ...
2
votes
0answers
103 views

Forwarding Monitor Parallel computation

I'm experimenting with training neural networks. Map[NetTrain[NetInitialize@#, trdata] &, {net1, net2}] shows the Training Progress monitor on each ...
2
votes
0answers
55 views

Parallelize evaluation of initialization cells

I have a notebook with about 20 initialization cells. Evaluating all of them takes a few minutes. Mathematica uses only one core for this. In my case, the cells are all independent so it should be ...
2
votes
0answers
66 views

Why is distributing the definitions of a list of arbitrary precision numbers so slow?

For a parallel application I need to make a large list of numbers available to the parallel kernels, which I do using DistributeDefinitions. I have noticed that this is much slower when the numbers ...
2
votes
0answers
79 views

Parallelizing code, any tips?

I have access to a Linux cluster and I'm trying to use Parallelize to run the above bellow faster, but whenever I try to place ...
2
votes
0answers
58 views

Any kernel monitor alternatives?

Sometimes the Parallel Kernel Status looks like this: Is there any way to visualize the kernels without using the built in tool?
2
votes
0answers
891 views

Speed differences between Table, Replace, Array, Map, and AssociationMap

EDIT: Actually, it looks like part of this is bogus—Array doesn't actually work on this input (I'm often a little shaky on what kind of input, exactly, works for ...
2
votes
0answers
183 views

mathematica example for parallel run

I want to run a parallel mathematica example via a PBS script. I am not expert in this application, instead as a system administrator, I have to be sure that users are able to submit parallel jobs to ...
2
votes
0answers
810 views

Can equation solving be done in parallel?

I'm solving a set of equations that look like: ...
2
votes
0answers
113 views

How to speed up summing a large number of vectors

First let me explain what I am trying to do in my code. Assume that I send a very short chirp (2,000 ms long) into a domain filled with 20,000 particles randomly scattered in the domain. The ...
2
votes
0answers
338 views

Parallel evaluation of symbolic matrix eigenvalues

I'm trying to find eigenvalues of symbolic hermitian 40x40 block matrix. It is made from 20 2x2 matrices like this: ArrayFlatten[Table[M[m,n],{m,1,20},{n,1,20}]] ...
2
votes
0answers
220 views

Is it possible to automatically apply Parallelize when possible

Parallelize in Mathematica is pretty easy to use. Most of the time, applying Parallelize to an expression, it tries to evaluates ...
2
votes
0answers
84 views

What was the thought behind the parallel versions of Table, Map, etc..?

There separately named versions of the parallel analogues of Map[] and friends: ...
2
votes
0answers
559 views

Can GPU (CUDA) speed up LinearSolve?

Is there a way to use GPU (CUDA) to speed up LinearSolve? GPU Cuda
2
votes
0answers
323 views

Symbolic Nullspace computation in parallel

I am trying to determine the nullspace of a large symbolic matrix. The single core evolution seems to take too long. I tried Parallelize[] on the commands ...
2
votes
0answers
52 views

do successive parallel computations require distribute definitions at each intermediate step?

Suppose I am doing a parallel computation, say, using parallel table. I distribute necessary definitions to all kernels. After computation is done, I would like to use the first result in another ...
2
votes
0answers
64 views

Placing package in existing Utilities` context has odd paraellelization effect

I noticed this in V.10 but possibly it was in effect in V.9. I have a package which in simplified form looks like:- ...
2
votes
0answers
446 views

ParallelSum in Mathematica 9 vs 10

Here's part of a package I'm working on: ...
2
votes
0answers
613 views

Diagonalization in parallel

I would like to diagonalize one unitary non-sparse matrix of size 12870 with complex number entries (not symbols, this is really a numerical problem). Is is possible to make eigensystem run in ...
2
votes
0answers
95 views

How does parallelization of LibraryLink function call work?

I'm trying to call a C function in parallel through LibraryLink. Here is an example kind of demonstrates that library function can be used in parallel. My question is what happened in the library ...
2
votes
0answers
116 views

Setting Up Lightweight Grid On Multiple Clients Programmatically

I have a number of computers which all might need to use the same (client) configuration for the Wolfram Lightweight Grid at some point. I know that there are ways to programmatically set certain ...
2
votes
0answers
147 views

correct usage of ParallelTable

I am trying to parallelize my script. Here is a MWE of how I have done it: ...
2
votes
0answers
367 views

Parallel PowerMod

Is there anyway to parallelize the PowerMod function? Here is my Left-To-Right modular exponentation: ...
1
vote
0answers
53 views

How to use Mathematica with Slurm?

We have a cluster that uses Slurm. On each node we have put a license that allows for 128 computation kernels (we have a Mathematica for Sites License). How can we run Mathematica on more than one ...
1
vote
0answers
68 views

How can I devote all the cores to Mathematica?

I have a problem with the calculations speeds in xAct package. In fact, some of them take lots of seconds. Is there any way to speed up the calculations by engaging all the cores for Mathematica (or ...
1
vote
0answers
59 views

Write in ParallelTable

Why does ...
1
vote
0answers
46 views

Conversion of STL files to 3D Images

I am trying to convert some stl files to 3d images in MMA 11.3. I came across this post that contained some code making use of parallelization to speed up the process, as follows: ...
1
vote
0answers
39 views

How badly does switching kernel slow down or completely stop Mathematica running jobs?

I have a question on how to run two or more Mathematica jobs on one laptop. For example, I use a local kernel to run a job. Then I open another job and choose Kernel configuration option and choose ...
1
vote
0answers
48 views

Privilege violation for file or directory

hopefully somebody can help me out with the following; I have a mathematica .wl script which uses ParallelTable; When I run this locally (laptop) it works ...
1
vote
0answers
44 views

Clustering different kernel versions

After a good bit of trial and error I have managed to cluster together two OS X machines. The master is running Mathematica 9.0 and the secondary 11.0. All was well and good, the remote command being ...
1
vote
0answers
75 views

WSTP with an MPI application

I'm looking to use WSTP to make functions defined in a C MPI application available to a remote Mathematica kernel. I've got this working for a non-MPI version of the application, but now wish to have ...
1
vote
0answers
49 views

Launching All Unoccupied Threads as Kernels [CPU Usage Assessment with Mathematica]

I'm working on a PC with 10 processor cores (20 threads), so it can support 20 concurrent computations. I often run simulations in the background on my PC such that some fraction of these, say 12, ...
1
vote
0answers
17 views

ClearAttributes in ParallelDo

The following code ClearAttributes[Times, Orderless]; temp = b*a; Do[ Print[temp];, {i, 1} ] will print b*a However, the ...
1
vote
0answers
31 views

How can I launch GenerateDocument with a template file on multiple kernels in a batch fashion?

I am trying to do automated testing of my MMA package by launching test cases that are generated on-the-fly with GenerateDocument and a template document, and then evaluated with NotebookEvaluate. I ...