Questions tagged [parallelization]

Questions on parallel computing in Mathematica.

194 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
1
vote
0answers
86 views

Parallelizing NDSolve and Parareal method

I found this video on Youtube outlining a method for Parallelizing NDSolve https://www.youtube.com/watch?v=6TiO3nRWZ_U. Does anyone know what the current update is on this? I tried to implement in ...
1
vote
0answers
51 views

Why is this parallel notebook not maxing out the available memory and processors?

I've searched many questions about parallel processing here, and they are either specialized or over my head. I run the following parallel notebook on an 8 core EC2 instance. The average memory usage ...
1
vote
0answers
105 views

Memory use for large computation

I am running a "big" program on my 32G RAM laptop. When MMA is running, roughly there is about 28G RAM "available" to use. So I did a bit of a test. ...
1
vote
0answers
57 views

ParallelTable[ParallelTable] vs Table[ParallelTable]: inexplicable differences & nonlinear scaling in computation time

I have something that looks a lot like the following: ...
1
vote
0answers
58 views

How can I optimize this Parallel Map Monitor's code?

I want to know how many tasks each kernel has accomplished with the monitor. My Attemption: ...
1
vote
0answers
81 views

Parallel execution in $2 \times 4$ kernels

Let's say I have 8 CPUs available on a single node. I want to run two instances of the same script (from command line with wolframscript in args > out &) on that node in parallel. Is there a way ...
1
vote
0answers
47 views

Access to a specific subkernel

Say I want to distribute a task in the following way on the available subkernels: ...
1
vote
0answers
86 views

Parallel matrix inversion with gridMathematica

I'm trying to test parallel symbolic matrix inversion on cluster with gridMathematica 7.0 for Linux x86 (64-bit) (February 18, 2009). I use next commands: ...
1
vote
0answers
56 views

How to sync parallel kernels across multiple nodes on an HPC

I'm hoping to parallelise my Mathematica script across multiple nodes on an HPC, but I can't get it to work. My code has the following schematic form: ...
1
vote
0answers
39 views

Trouble parallellising on HPC

I'm trying to carry out a parallel computation using Mathematica's inbuilt parallel functions, ParallelTable, etc. The problem is that the HPC doesn't seem to like ...
1
vote
0answers
137 views

Parallelization of Monte Carlo numerical integration

I'm trying to parallelize some integral. What I do: I define integrand: ...
1
vote
0answers
79 views

Finding the best way to try `Parallelize` a code

Consider a code like ...
1
vote
0answers
57 views

Using NearestFunction in ParallelMap: why the slowdown?

Intro I am trying to do various calculations (call some Analyze[point, neighbourhood] function) over the large datasets of points in 2D space. The nature of the calculations is irrelevant, but basic ...
1
vote
0answers
61 views

ParallelSum faster… if I don't load my own Package

I have a big sum to compute. I remarked that if I load my package, the parallelisation is as slow as the "non" parallelisation. Whereas, when I don't load it, the parallelisation is faster. The ...
1
vote
0answers
88 views

Updating “Parallel Kernel Status” window during evaluation

I really like the "Parallel Kernel Status" window for monitoring my parallel kernels. However, as long as a cell is evaluating, it is almost not updated (only the red and green circles that show ...
1
vote
0answers
120 views

How to successfully put a ParallelDo loop inside a Do loop?

I'm trying to set up a ParallelDo loop inside of a Do loop, however I'm running into issues. Here is a very simplified toy model ...
1
vote
0answers
45 views

Parallel number systems don't scale well

I'm working on Residue Number System. This is basically a set of relatively coprime integers, let's say $\{3,4,5\}$ and we define its range to be the product of the moduli, i.e. $M=3\cdot4\cdot5=60$. ...
1
vote
0answers
88 views

Mathematica using all available cores, but not speeding up calculation as much as expected

This is a follow-up question to my previously posted question on how to get Mathematica to use all available cores to do a parallel calculation. I resolved this by rewriting the code in terms of a <...
1
vote
0answers
67 views

Wolfram cdf player does not support parallel computing?

I tested the following. ...
1
vote
0answers
139 views

How to make use of multi cores on a single node of supercomputer 'Stampede'

I am using Mathematica 10.4 in GUI mode on stampede supercomputer. I am using a single node on this machine and each node has two 8 core chips. Whenever I try to parallelize my code on 16 cores(using ...
1
vote
0answers
72 views

Functions, strings and ToExpression in ParallelDo

I have defined functions: ...
1
vote
0answers
60 views

Parrallelize unrelated expressions: how to solve transcendental equation by finding roots in parts of the interval simutaneously

The goal is to find all the roots of a transcendental equation. I copy a function from stackexchange: ...
1
vote
0answers
48 views

ParallelDo only output one file using $KernelID

I have some codes like this: ...
1
vote
0answers
41 views

How can I distribute redefinitions of system functions to parallel kernels?

I'm having some trouble getting my parallel kernels to get wind of user redefinitions of system packages, and I'm looking for the cleanest way to do this - preferably using DistributeDefinitions. To ...
1
vote
0answers
56 views

Launching specific remote kernels in parallel

For some reason I found that my numerical integration runs much faster on Mathematica 9 than on Mathematica 10. Since I sent my calculation to a cluster with 24 cores with the following command <...
1
vote
0answers
84 views

Can parallelization speed up FindClusters?

I have a clustering task that would take FindClusters 2-3 months1 to complete. Can this calculation be sped up with parallelization? (FWIW, the data to be ...
1
vote
0answers
33 views

Make an existing solution for monitoring parallel jobs robust against dying kernels

Is there any chance to make the solution by @David here https://mathematica.stackexchange.com/a/1562/21606 more robust in the following sense: In my case, some parallel kernels die regularly during ...
1
vote
0answers
83 views

ParallelTable gets slower when rerun in a module

Question: Why does the performance of ParallelTable within a Module drop so horribly when the module is RERUN several times? ...
1
vote
0answers
88 views

Distribute Definitions to different Evaluator

I would like to pass on a definition from one Kernel to the other. With that I mean manually configured Kernels. In this case, I do not want to use the inbuilt Parallelization options, in order to ...
1
vote
0answers
154 views

The module load only works for the first node, not all. Is there's a way to specify the full path to the math command when launching remote kernels

Running a Mathematica .m file in cluster for parallel computing. But get an error "bash: math: command not found". Is there's a way to specify the full path to the ...
1
vote
0answers
54 views

Inconsistent font rendering when using a remote kernel on a different OS

I have a Mathematica 10.0 on Linux and one on OSX. I'm using the OSX as a remote kernel. During parallel computation, if I render some graphics, the fonts and axes are not rendered the same way ...
1
vote
0answers
280 views

Can LinearSolve use Parallelize and WorkingPrecision in computation

I am looking for a two things while calculating the large array matrix equation: 1) To increase the precision in simple LinearSolve function. 2) To find a way to ...
1
vote
0answers
293 views

ParallelMap not using all of the available kernels

Please note: I cannot provide the code here, since the project is far too big to post at any Internet forum. I have a computer with eight logical cores. I have Mathematica Version 10.0.2, and I am ...
1
vote
0answers
105 views

Avoid copying memory for each subkernel

Here is a simplified example illustrating my issue; ...
1
vote
0answers
106 views

Parallel assigning to an Association

This is a simplified example of a problem I ran into. I want to count how often a subkernel executes a given computation. So, after having launched the subkernels, I construct an association with ...
1
vote
0answers
264 views

What does this Java error mean? Why is it raised?

I want to launch some kernels on a cluster that uses SGE. The server's operating system is Linux Cent-OS. According to Mathematica documentation, I've added these commands inside my code: ...
1
vote
0answers
109 views

Troubles with ParallelEvaluate

I need to evaluate the same expression on all subkernels just like ParallelEvaluate does. This code distributes perfectly (2 kernels): ...
1
vote
0answers
79 views

Parallelizing an associative binary operation

I have an associative binary operation '.', which I often use in this sort of way: result = expr1 . expr2 . expr3 . expr4 The ...
1
vote
0answers
264 views

Parallel linear algebra with arbitrary precision

Is it possible to do parallel linear algebra with arbitrary precision within Mathematica (in a simple manner, as is done for the machine precision)?
1
vote
0answers
475 views

Return Functions from parallel execution of module

I wrote a module which numerically solves an ODE using NDSolve. The result from this is e.g. either ...
1
vote
1answer
135 views

Debugging parallelized code

Is it possible to add a stack trace for this parallelized code to see where the problems stem from? ...
0
votes
0answers
23 views

Optimizing and Parallel Computing for Large Dyadic Intervals

I need help with the efficiency of my code i.e. less time so I can compute for large range of values. My function n[x] takes in a number x and outputs the ...
0
votes
0answers
12 views

Parallel evaluate a cell distributing the definitions

In Cell evaluation and parallel kernels a solution is proposed for how to evaluate multiple cells in parallel. I tried it, but ran into the problem that definitions do not get distributed to the new ...
0
votes
0answers
24 views

Having trouble distributing a large association to sub-kernels

The following seems to work based on memory usage. ...
0
votes
0answers
28 views

How to parallelize the following table

Consider a table: ...
0
votes
1answer
45 views

How to build a matrix of size n + 4 from a matrix of size n and 4 rows and 4 columns?

I have a matrix size n + 4 very long and very complicated and to find my matrix I have a matrix of size n and 3 rows and 3 columns To better understand my problem here is a simple example ...
0
votes
0answers
42 views

Parameter sweeps on a HPC cluster

I have a mathematica *.wl file set up, such that there are a couple of parameters defined in the beginning, and, when run, it produces a few outputs. I can run this script on a Slurm-run HPC cluster ...
0
votes
0answers
19 views

Parallezation gives LaunchLocal::somefail

I was running a program using parallelization, and I got the following warning message: LinkOpen::linke: No MathLink problem encountered.. SubKernels`LocalKernels`LaunchLocal::somefail: 1 ...
0
votes
0answers
78 views
0
votes
0answers
33 views

Saving DownValues for a function computed in parallel

Is it possible to save DownValues of a function computed using a parallelization routine? I have a rather costly function f I wish to evaluate at a grid and save ...