Questions tagged [memory]
Questions about RAM usage, including optimizing memory use, avoiding and fixing leaks and releasing unused memory.
441
questions
0
votes
0
answers
52
views
Automatic Function Memoization
I'm working with lists of graph functions and some of them take a while to compute. I want to memoize them as so:
...
1
vote
1
answer
94
views
Mathematica builds up RAM usage (how to free memory)
I've already checked this post How to clear up RAM without exiting kernel?
But the longer my code works, it builds up RAM and cannot clear it. I've stopped the evaluation and done the following.
...
0
votes
0
answers
67
views
Mathematica overload memory constructing a matrix
I have the following list of {x,y} positions and I'm trying to connect the neighbors with a distance 1 a.u in a matrix, with the following
...
5
votes
1
answer
65
views
Is it possible to force ParallelDo to periodically close and launch subkernels?
I have a function f which calls an external library that has a memory leak, so I kind of have to live with it.
I call this function thousands of times within ...
3
votes
1
answer
45
views
Alternatives to Export to write long list as a table on a file
I have a large list (approx 50 millions elements).
I could Export it as a table like this:
...
0
votes
1
answer
99
views
How to make the function compile into C faster, and how to determine which portion of the code occupies more memory?
If changing the value of 'n' from 2 to 3 in the above code increases the compilation time from one minute to ten minutes, is there a way to speed it up? Also, the code consumes too much memory during ...
2
votes
2
answers
87
views
How can I Save function defintion without its DownValues?
I use functions that memorize their values like this one:
...
0
votes
0
answers
170
views
>100 GB of memory used by Reduce. Am I doing something wrong?
Newish to Mathematica here. I'm running some code to compute regions of the parameter space where the covariance between innovations is positive or negative. On my Windows PC, it's been running for ...
2
votes
0
answers
75
views
Memory leak with pure function and in the listable option of compiled function?
I'm using
13.0.0 for Microsoft Windows (64-bit) (December 3, 2021)
When I repeatedly run the command
...
0
votes
0
answers
40
views
How to download and keep a dictionary? [duplicate]
I use a Dictionary and download it by the command (example Swedish):
dict1 = DictionaryLookup[{"Swedish",
Repeated[{alfabetet}, {1, Infinity}]}]
It downloads and all is well.
But when I ...
5
votes
1
answer
423
views
Is this buggy behavoir of Module solved? [closed]
I have just found out about this bug of Module, i.e. the creation of "zombie"-variables in some cases (see also this post).
I couldn't find a post saying ...
3
votes
1
answer
151
views
How are small integers and of certain approximate numbers generated in computations managed in memory?
In the documentation tutorial/SomeNotesOnInternalImplementation, it says:
Most raw objects such as strings and numbers are allocated separately; however, unique ...
3
votes
0
answers
24
views
Global time constraint or sandboxing across a notebook?
This may be off-topic, but when accidentally running a process which turns out to be computationally more intensive than expected (or even getting stuck in an infinite loop), it seems that there is ...
5
votes
1
answer
140
views
How could I see the memory use on sparse array and constant array matrices? What is the advantage? [duplicate]
I have a huge matrix defined using constant array function and it allocates so much memory preventing the calculation. Therefore, I would like to change the constant array matrix into sparse matrix ...
3
votes
1
answer
259
views
Efficient memory usage while building a large sparse matrix
I am sure the following problem has been solved already, but I am unable to find any solution... Any help appreciated!
So I am building a pretty huge matrix (or tensor, actually) using
...
4
votes
1
answer
151
views
Why does `MemoryInUse` keep increasing?
Consider MemoryInUse. After kernel initiation, I have noticed that its value keeps increasing, even when not evaluating any cell, as seen
...
14
votes
1
answer
458
views
Memory leak with Mathematica Graph functions
I am running Mathematica 13.2 on a Mac OS Monterey. I have a large code that manipulates graphs both in graph form and as adjacency matrices, computes some graph properties, and returns a list. It has ...
0
votes
0
answers
47
views
MMa 13, holding previous solutions instead of clearing them
I suspect this is something one line of code will fix, but I have a fairly simple code, that needs to be evaluated at 2 different points. I tried it for the first one... got an answer, it's correct, ...
1
vote
1
answer
40
views
How to refer to calling notebook instead of my personal include? / detector for high-memory-usage cells
Along the lines of a couple previous posts, I coded this function to show you where in your notebook your biggest space-wasters are. Useful for when your file is becoming huge and unmanageable for ...
2
votes
0
answers
101
views
Restart kernel after each evaluation in Table
I am trying to integrate a two-dimensional function purely numerically. For one coordinate the integrand can oscillate rapidly while for the other coordinate the integrand is not behaving in a special ...
1
vote
0
answers
39
views
Sorting stored variables in memory
Given the list of stored variables
Names@"`*"
is it possible to sort them by size in used memory?
2
votes
0
answers
109
views
How to access Shared Memory in Mathematica
I'm running Python code to receive live data stream through web-socket and storing it in the shared memory as the following;
...
2
votes
0
answers
57
views
MemoryConstrained[] does not work as expected
I am trying to put an upper limit on how much memory the kernel can use. For this, I am using the MemoryConstrained function in Mathematica. But this behaves very weirdly as shown below.
...
0
votes
0
answers
40
views
What is the best memory utilization and efficiency considerations for simulating particles that are randomly created and removed?
I am wanting to run a simulation involving a varying number of "particles" (points defined by 2D coordinates $(x,y)$ within some region). At each time step, there is a probability that a new ...
2
votes
0
answers
82
views
Controlling memory consumption by memoized function
To speed up a resource-intensive calculation, I use several functions with storing previously calculated values. For example:
...
1
vote
0
answers
159
views
How can I prevent Mathematica from filling up memory and crashing my PC when I execute a faulty instruction? [closed]
Sometimes I make a silly mistake and run code that keeps on filling up the memory. Once that is filled, my OS starts page swapping, and there's pretty much nothing I can do except reboot the PC.
An ...
2
votes
0
answers
62
views
Parallel image comparison function keeps increasing memory
I have written the following code to align two arbitrary images:
...
24
votes
2
answers
2k
views
What happens if you don't Reap what you've Sown?
As I understand it, when using Sow[expr] you throw the expr on some private stack which you can ...
2
votes
1
answer
200
views
TextRecognize has a memory leak?
This code causes Mathematica to slowly accumulate memory until it hard crashes my operating system. It does this by overwriting OS memory (windows start going black, graphics drivers start crashing ...
3
votes
2
answers
121
views
Improve speed and memory use in the construction of linear combinations of two lists
I have two lists, list1 and list2, for instance
...
0
votes
1
answer
90
views
Table size/dimension error
I'm trying to create a table of the form
...
6
votes
1
answer
104
views
Does converting large 3D matrices to VERY large 2D matrices affect speed of operations done on the matix?
Novice question! Does the dimensionality of a matrix affect the speed of operations performed on it (or the speed of retrieval of values from it) IF the total number of elements in the matrices are ...
18
votes
2
answers
520
views
Garbage collection for lexical closures
Mathematica is known not to garbage collect temporary variables in certain cases. I am particularly interested in the very useful programming pattern known as a lexical closure. A somewhat trivial ...
1
vote
0
answers
75
views
Leverage swap space on Linux
Maybe this would be better suited on a different stackexchange, but I'll ask it here anyways in case Mathematica has some inbuilt functionality I'm not aware of.
I'm running ...
7
votes
1
answer
276
views
How to remember evaluation across sessions?
I am performing a very time-consuming symbolic calculation.
When I reopen a saved Mathematica notebook, it takes quite a long time to evaluate.
Is there an option to tell Mathematica to remember the ...
1
vote
0
answers
103
views
Why Mathematica don't set \$RecursionLimit and \$IterationLimit very big by default? [closed]
For my current program in Mathematica, sometimes I will encounter an error regarding \$IterationLimit and \$RecursionLimit. So I always set these two numbers to very large at the starting of every ...
9
votes
1
answer
276
views
Working around Memory Leak from HermiteDecomposition
I am running into an issue where HermiteDecomposition seems to leak memory, but only from certain matrices
...
0
votes
1
answer
90
views
Memory problems when fitting large (correlated) datasets
I am trying to fit some complicated function that depends on 18 parameters.
The problematic is that I have a large correlated dataset (336 points).
When fitting, for simplicity, taking only the ...
4
votes
0
answers
97
views
JoinAcross Memory Leak
I believe JoinAcross may have a memory leak but would appreciate some help looking at it. It appears to be small when used just once but when iterated a lot it eventually crashes my wolframscripts. I'...
3
votes
1
answer
143
views
How to optimize ContourPlot3D evaluation?
I tried to plot a certain 3D sine function:
ContourPlot3D[(Sin[x^2] + 2) * (Sin[y^2] + 2) * (Sin[z^2] + 2)
, {x, -2, 2}, {y, -2, 2}, {z, -2, 2}]
but ran into an ...
3
votes
0
answers
102
views
Free up used Memory
When using FunctionCompile[] to generate a large matrix of ranges there seems to be no way of recovering memory even though the variables are either out of scope or overwritten. I am aware that there ...
0
votes
0
answers
111
views
See variable as byte
I see variable v is occupying 112 bytes of my RAM.
v = {3, 5, 7}; ByteCount[v]
112
Then how to see the content of the 112 bytes?...
1
vote
0
answers
58
views
Erratic behavior retrieving large data (several tens of gigabytes) that has been serialized by Mathematica
Hardware: PC with 256GB RAM
OS: Windows 10
Mathematica: Version 13.0.1
One of my projects has led to the creation of a SparseArray whose ByteCount is ~ 35GB in RAM. At the time of creation the ...
6
votes
1
answer
185
views
Unexpected high memory consumption using out-of-core NetTrain
I'm working on training a neural network on an image dataset. There are 14k images and each image contains 3x150x150 pixels. I have built a generator function following the approach in Training on ...
4
votes
1
answer
265
views
Memory use buildup when solving PDE multiple times
Bug introduced in 13.0 or earlier and fixed in 13.1.0
Mathematica V 13.0
Mac OS X ARM (64-bit) - MacBook Pro 13" M1 processor
macOS Big Sur 11.6.2
I am solving a PDE numerically and have noticed ...
0
votes
2
answers
110
views
Memory preserving computation in chunks
I would like to do the following:
Make a table
tab1={{i1,b1,c1,d1},{i1,b1,c1,d2},...,{i1,b1,c2,d1},...,{i1,b2,c1,d1},...{i2,b1,c1,d1},...}
for the given range imin < i < imax.
Make some ...
10
votes
3
answers
1k
views
How to clear up RAM without exiting kernel?
I am trying to implement the code which generates some table, works with it, extracts some numbers, add them to some other table, then clears the table (only the table and not the other elements of ...
11
votes
2
answers
673
views
3
votes
0
answers
377
views
How to allocate more physical memory to Mathematica?
My MacBook Pro (2019) has 32 GB of memory, but when I work with a large array reaching 1 GB of storage, the Mathematica Kernel only gets a little more of 1 GB, but gets allocated a lot of virtual ...
2
votes
0
answers
113
views
How to avoid running out of memory in ParallelMap?
I am mapping a function over a list of length 77237.
ParallelMap[AnalyzeZernikeRecord,records]
The result of each function application is just a list of 12 numbers....