Questions tagged [parallelization]

Questions on parallel computing in Mathematica.

214 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
105 views

Wolfram math on windows using PBSPro cluster

A user wishes to use math application running on our PBSPpro cluster. Our cluster is accessible to linux users, running qsub to submit their jobs. We have math10.4 for our cluster users, with ...
3
votes
0answers
128 views
3
votes
0answers
1k views

Speed differences between Table, Replace, Array, Map, and AssociationMap

EDIT: Actually, it looks like part of this is bogus—Array doesn't actually work on this input (I'm often a little shaky on what kind of input, exactly, works for ...
3
votes
0answers
92 views

Where do DistributeDefinitions and ParallelNeeds put their definitions for newly-launched kernels to find

I'm sorry to keep banging on the definition distribution bell, but here is another (hopefully well-focused enough) question on that vein. If one is trying to distribute the definitions in a package ...
3
votes
0answers
101 views

Why is a LibraryLink function, which returns a list, not parallelizing with ParallelTable?

First example: librarylink function return a list of two element ...
3
votes
0answers
318 views

`ParallelTable` pending the MathKernel after execution

I have done a ParallelTable computation in script mode. After execution, the output is fine and I've got all the data I needed. but the kernel seems pending, ...
3
votes
0answers
453 views

AppendTo or Part in a ParallelDo?

I have a question regarding how memory is managed in parallel. Specifically, I'd like to know what is the better practice when constructing an array within a ...
3
votes
0answers
407 views

How many kernels to set based on CPU?

Looks like 4 kernels are enough? My CPU is i7 4790K as given here. Does it also depend on the tasks and the codes? My understanding is that regardless what the benchmark says, I could always use 8 ...
3
votes
0answers
152 views

k-means clustering in parallel

How can the k-means algorithm for some given distance function be implemented using ParallelMap or other parallel processing program constructs in Mathematica?
3
votes
0answers
67 views

Placing package in existing Utilities` context has odd paraellelization effect

I noticed this in V.10 but possibly it was in effect in V.9. I have a package which in simplified form looks like:- ...
3
votes
0answers
554 views

Launching Remote Kernels takes a lot of time

I recently played around with establishing a remote kernel setup without using mathematica grid. To do this I use the LaunchKernels[] command and ...
3
votes
0answers
245 views

Whether NIntegrate evaluation is multithreaded or not?

About MultiThread evaluation I am talking about here, see this post I am NIntegrate the function grarm[e, 3, dimension, 1, 1, 0.005]. There is matrix operation in ...
2
votes
0answers
66 views

Aborting any computation that takes too long

One of the biggest annoyances in Mathematica is that it will often hang up without any way to abort (i.e. Alt + . or other methods can't stop the computation). Is ...
2
votes
0answers
43 views

How can I parallelize this calculation?

I need to compute a sum function: $$E=\frac{(2 \gamma )}{\delta ^2} \sum _{m,n,p,q=0}^{\text{mMax}-1} a_m a_n a_p a_q \text{A}(m) \text{A}(n) \text{A}(p) \text{A}(q) \text{D}\left(\frac{1}{2} (m+n+p+q)...
2
votes
0answers
63 views

Connect Raspberry pi front end to remote kernel(s) (Ubuntu, the free Wolfram engine)

I am trying to connect a Raspberry pi front end (notebook) to a remote kernel running Ubuntu with the free Wolfram engine. I have researched this answer but it never worked. Using the code below I ...
2
votes
0answers
47 views

Parallelize and tensor calculus

Is it possible to use Parallelize with tensor calculus functions like TensorContract and ...
2
votes
0answers
88 views

Launch Kernels on Windows 10 from Raspberry Pi (linux) over SSH

I am trying to launch remote kernels on a Windows 10 PC (remote) from a Raspberry Pi 4 (Master or local). Both machines have V12 installed. On the Windows machine, I have installed OpenSSH per ...
2
votes
0answers
74 views

ParallelSubmit does not trigger computations

I am having some problems with parallel computations. I'm afraid it may be a "known issue" but I haven't found any solution. In general, my script looks like this ("prepare" and "process" are my own ...
2
votes
0answers
75 views

How can I deal with a SystemException?

I have a list of functions that are being evaluated, using ParallelTable[], and continue to get the error message: ...
2
votes
0answers
418 views

ParallelTable::nopar: No parallel kernels available; proceeding with sequential evaluation

I am trying to use a the following code: ...
2
votes
0answers
67 views

Problem with exporting PlotLabel using MaTeX in Parallel computation

Requires MaTeX, which can be found here. ...
2
votes
0answers
143 views

How can I avoid massive (waste) CPU usage by Mathematica?

I am using Mathematica on a Linux machine with 52 CPUs. I am sending my jobs in a batch mode and I am not using any parallel evaluation like ParallelTable[] or so. ...
2
votes
0answers
56 views

Compile with “Listable” only on one argument

I would like to write a Compiled function which is listable only in the first argument, because this allow fast and easy parallelization. How is it possible to do it? In the following way it does not ...
2
votes
0answers
72 views

ParallelDo with doubly-indexed iterators

What is the reason that ParallelDo works with singly-indexed iterators, but not doubly- or more-indexed iterators? For example, the code ...
2
votes
0answers
96 views

Why can't ImageTransformation be parallelized?

I have a rather complicated code for an ImageTransformation, which would benefit from some acceleration. Since every pixel is independend of every other, I tried Parallelize, which, in a simplified ...
2
votes
0answers
72 views

How to sync parallel kernels across multiple nodes on an HPC

I'm hoping to parallelise my Mathematica script across multiple nodes on an HPC, but I can't get it to work. My code has the following schematic form: ...
2
votes
0answers
166 views

Parallelizing / speeding up a replacement rule over large list

I have a list of differentiated expression of the form {f[0,0,0],(f^(a,b,c))[0,0,0],...} where I have left the function as a general ...
2
votes
0answers
174 views

Why is my parallel version of `DensityPlot` slow?

I am exploiting the possibility to parallelize DensityPlot. This is my naive implementation ...
2
votes
0answers
145 views

How to successfully put a ParallelDo loop inside a Do loop?

I'm trying to set up a ParallelDo loop inside of a Do loop, however I'm running into issues. Here is a very simplified toy model ...
2
votes
0answers
115 views

Forwarding Monitor Parallel computation

I'm experimenting with training neural networks. Map[NetTrain[NetInitialize@#, trdata] &, {net1, net2}] shows the Training Progress monitor on each ...
2
votes
0answers
58 views

Parallelize evaluation of initialization cells

I have a notebook with about 20 initialization cells. Evaluating all of them takes a few minutes. Mathematica uses only one core for this. In my case, the cells are all independent so it should be ...
2
votes
0answers
77 views

Why is distributing the definitions of a list of arbitrary precision numbers so slow?

For a parallel application I need to make a large list of numbers available to the parallel kernels, which I do using DistributeDefinitions. I have noticed that this is much slower when the numbers ...
2
votes
0answers
81 views

Parallelizing code, any tips?

I have access to a Linux cluster and I'm trying to use Parallelize to run the above bellow faster, but whenever I try to place ...
2
votes
0answers
62 views

Any kernel monitor alternatives?

Sometimes the Parallel Kernel Status looks like this: Is there any way to visualize the kernels without using the built in tool?
2
votes
0answers
211 views

mathematica example for parallel run

I want to run a parallel mathematica example via a PBS script. I am not expert in this application, instead as a system administrator, I have to be sure that users are able to submit parallel jobs to ...
2
votes
0answers
954 views

Can equation solving be done in parallel?

I'm solving a set of equations that look like: ...
2
votes
0answers
116 views

How to speed up summing a large number of vectors

First let me explain what I am trying to do in my code. Assume that I send a very short chirp (2,000 ms long) into a domain filled with 20,000 particles randomly scattered in the domain. The ...
2
votes
0answers
350 views

Parallel evaluation of symbolic matrix eigenvalues

I'm trying to find eigenvalues of symbolic hermitian 40x40 block matrix. It is made from 20 2x2 matrices like this: ArrayFlatten[Table[M[m,n],{m,1,20},{n,1,20}]] ...
2
votes
0answers
240 views

Is it possible to automatically apply Parallelize when possible

Parallelize in Mathematica is pretty easy to use. Most of the time, applying Parallelize to an expression, it tries to evaluates ...
2
votes
0answers
87 views

What was the thought behind the parallel versions of Table, Map, etc..?

There separately named versions of the parallel analogues of Map[] and friends: ...
2
votes
0answers
586 views

Can GPU (CUDA) speed up LinearSolve?

Is there a way to use GPU (CUDA) to speed up LinearSolve? GPU Cuda
2
votes
0answers
118 views

Parallel assigning to an Association

This is a simplified example of a problem I ran into. I want to count how often a subkernel executes a given computation. So, after having launched the subkernels, I construct an association with ...
2
votes
0answers
355 views

Symbolic Nullspace computation in parallel

I am trying to determine the nullspace of a large symbolic matrix. The single core evolution seems to take too long. I tried Parallelize[] on the commands ...
2
votes
0answers
53 views

do successive parallel computations require distribute definitions at each intermediate step?

Suppose I am doing a parallel computation, say, using parallel table. I distribute necessary definitions to all kernels. After computation is done, I would like to use the first result in another ...
2
votes
0answers
450 views

ParallelSum in Mathematica 9 vs 10

Here's part of a package I'm working on: ...
2
votes
0answers
692 views

Diagonalization in parallel

I would like to diagonalize one unitary non-sparse matrix of size 12870 with complex number entries (not symbols, this is really a numerical problem). Is it possible to make eigensystem run in ...
2
votes
0answers
98 views

How does parallelization of LibraryLink function call work?

I'm trying to call a C function in parallel through LibraryLink. Here is an example kind of demonstrates that library function can be used in parallel. My question is what happened in the library ...
2
votes
0answers
117 views

Setting Up Lightweight Grid On Multiple Clients Programmatically

I have a number of computers which all might need to use the same (client) configuration for the Wolfram Lightweight Grid at some point. I know that there are ways to programmatically set certain ...
2
votes
0answers
149 views

correct usage of ParallelTable

I am trying to parallelize my script. Here is a MWE of how I have done it: ...
2
votes
0answers
374 views

Parallel PowerMod

Is there anyway to parallelize the PowerMod function? Here is my Left-To-Right modular exponentation: ...