Questions tagged [gpu]

Questions on using Mathematica functionality to take advantage of a Graphics Processing Unit, a special stream processor designed for highly parallel computer graphics operations.

Filter by
Sorted by
Tagged with
3 votes
0 answers
38 views

Can someone recommend workflow for debugging RemoteBatchSubmit jobs on AWS

I am trying to troubleshoot using an external service (AWS: Amazon Web Service) for NetTrain with a GPU. My RemoteBatchSubmit has been stuck at "Runable" for about 10 hours as described in ...
user avatar
  • 2,068
5 votes
2 answers
257 views

Optimizing sequential computation

The following question came up in reading group discussion of paper -- imagine taking two vectors, multiplying each by a random matrix, then taking tanh pointwise. If you repeat this process forever, ...
user avatar
0 votes
0 answers
68 views

OpenCL with Mathematica 12

I got CUDA to work but no OpenCL: "OpenCLLink is not supported on this system." ...
user avatar
1 vote
0 answers
79 views

Unknown Error in NetGraph with RTX 3090 GPU

I am running NetGraph on my RTX 3090 GPU. The Net itself loads properly in my GPU, having an approximate size of 9GB (the 3090 has 24GB of memory). However, once the net actually starts NetGraph ...
user avatar
0 votes
1 answer
46 views

Does the Solve function as applied to simultaneous equations benefit from multi-node / GPU parallel computing?

I use the Solve function to find solutions for systems of simultaneous equations with dozens or hundreds of equations and variables. This is successful though very slow (weeks) on a conventional ...
user avatar
  • 31
2 votes
1 answer
125 views

Anyone has any succes on GPU NetTrain with RemoteBatchSubmit on AWS EC2?

Since 12.3, the RemoteBatchSubmit to EC2 does not work anymore. First, it features the same bug as Version 12.3.1 Problems with NetTrain, where the MXNetResources paclet is 12.4 instead of 12.3. ...
user avatar
2 votes
0 answers
72 views

Solving differential equations with GPU?

I have a complicated differential equation which is taking a lot of time to solve, if I had more cores it would be easier, but my computer is limited... I was wondering: is it possible to solve ...
user avatar
  • 6,114
4 votes
0 answers
139 views

How can I free GPU memory allocated with NetTrain

When I train a neural network with NetTrain[..., TargetDevice->"GPU"], wolfram's neural network code automatically allocates memory on my GPU for my ...
user avatar
1 vote
2 answers
173 views

Optimizing the calculation of a global maximum

...
user avatar
2 votes
1 answer
109 views

Neural network evaluate on multiple gpus simultaneously

For instance, I have 4 gpus, now I want to calculate neural network on each gpu simultaneously, or make use of all of my gpus to calculate the data. The code might like ...
user avatar
2 votes
0 answers
91 views

How to use _Complex types in CUDAFunctionLoad?

The documentation for CUDAFunctionLoad specifies various base datatypes you can use for your function's arguments, including ...
user avatar
2 votes
0 answers
52 views

Unable to uninstall an older CUDAResource paclet

I am trying to uninstall an older version of CUDAResource but cannot do so. Any ideas please? Is there a manual way to do so? ...
user avatar
3 votes
0 answers
116 views

Classify/NetTrain run indefinitely without output when using GPU

I am experimenting with Mathematica's Classify/NetTrain functions for the first time. When I don't set a TargetDevice option, Mathematica defaults to the CPU and everything works as expected. When I ...
user avatar
  • 101
2 votes
2 answers
258 views

Does NetTrain Support Nvidia 30xx series GPU (RTX 3080, 3090 etc)?

Recently, I want to buy some 30xx series GPUs which are used to do deep learning jobs, so does anyone know whether Mathematica's NetTrain supports 30xx series GPUs?
user avatar
4 votes
1 answer
142 views

Mathematica GPU occupancy is too high when the current page has high quality images

When Mathematica's current page contains a high-quality picture, the GPU occupancy rate will increase and the current page delay of Mathematica will increase( the software is slow to respond to my ...
user avatar
  • 189
11 votes
0 answers
211 views

Tutorial example NetTrain fails miserably with a GPU

I have been experimenting with GPU NetTrain on AWS now when Mma 12.2 supports remote batch jobs (I don't have an Nvidia GPU to try these things out otherwise). In ...
user avatar
  • 14.6k
7 votes
0 answers
157 views

Extremely Long GPU Initialization Times on Mathematica 12.2 and RTX3090 [closed]

I'm having trouble getting my new GPU system to work with Mathematica 12.2. I have two RTX3090 cards in my setup. My NVIDIA drivers are version 460.89 (the latest). I have installed CUDAToolkit 11.0 ...
user avatar
14 votes
0 answers
143 views

How to use user-provided CUDA toolkits?

In the revision history, Mathematica v12.1 claims to have "support for user-provided CUDA Toolkits". But other than this line in the revision history, I cannot find any other reference to ...
user avatar
  • 1,136
3 votes
1 answer
467 views

CUDA usage in "everyday life"

I have checked documentation about CUDA usage in Mathematica and it seems that it is quite few applications of CUDA. Are the any additional packages/functions/tutorials/documentations for CUDA in ...
user avatar
2 votes
2 answers
169 views

Why is Graphics3D lighting different when rotating? [duplicate]

Mathematica v12.1 on macOS Catalina 10.15.5. I'm getting weird Lighting behavior in Graphics3D in the sense that the rendered ...
user avatar
  • 199
3 votes
1 answer
4k views

GPU support on latest MacBook Pro, especially for deep learning

I'm thinking about getting some new top of the line computer hardware, specifically a MacBook Pro from Apple. These have AMD Radeon Pro 5500M GPUs, which while a bit slower than something like an ...
user avatar
  • 187
12 votes
4 answers
548 views

CUDA on Tesla V100 card

Context I am trying to run CUDALink with a Centos 6.10 Mathematica 12.0 [cuda 10.1]. Host has NVIDIA Corporation GV100GL [Tesla V100 PCIe 32GB] (rev a1) card ...
user avatar
  • 21.7k
1 vote
0 answers
45 views

NetTrain with Quadro

I have an Nvidia Quadro P620/PCIe/SSE2 graphics card on my linux box (Ubuntu 18.04): <<CUDALink` CUDAQ[] (*True*) CUDADriverVersion[] (* 390.116.0 *) But ...
user avatar
  • 3,720
1 vote
0 answers
91 views

Re-train a neural network discarding its memory?

...
user avatar
0 votes
0 answers
385 views

GPU Computation AMD

I'm new to this forum even though it has helped me a lot over the last few months. I'm working on hypergeometric functions and want to use my GPU as support. I have a Radeon R9 390, but I can't get it ...
user avatar
4 votes
1 answer
216 views

Using GPU Computation in LearnDistribution

LearnDistribution has an option for RealNVP, which is directly training a neural network for the distribution. It also has an option for TargetDevice, however, it appears to do nothing. Take the ...
user avatar
  • 3,564
0 votes
2 answers
264 views

CUDA Trouble, MMA12 Quadro RTX 4000

Started this unfortunately as an answer in this question on GPUs under Mma12: previous GPU question, while it should have gone into a new question. I will try to answer questions already posted on the ...
user avatar
3 votes
2 answers
289 views

Does Mathematica 12 support GT 730 CUDA?

I am getting the following error when I set the target device as GPU: NetTrain::trgdevegpu: TargetDevice -> GPU could not be used; a supported NVIDIA GPU was not found. If you are using an ...
user avatar
  • 163
1 vote
0 answers
106 views

Is Wolfram Cloud going to support GPU training? [duplicate]

Is Wolfram Cloud going to support GPU training? Is there any other possibility for training a neural net (in WL) on a cloud like AWS, Floydhub, or so? I think this concerns lots of people.
user avatar
3 votes
1 answer
952 views

CUDA on Manjaro Linux (Arch)

I have been struggling getting CUDA to work on Mathematica 11.3 and Manjaro Linux (kernel 4.19.16-1-MANJARO). Trying some commands I get the following: ...
user avatar
  • 917
2 votes
0 answers
76 views

NetTrain with GPU crashed

I tried to run NetTrain with TargetDevice->"GPU", and Mathematica crashed. I got the following message: When I executed ...
user avatar
  • 121
1 vote
0 answers
119 views

CUDACCompilers[] returns an empty list

I have just installed Mathematica 11.3.0.0 on Windows 10 (Professional), with an NVIDIA GT 630M GPU on my Dell Inspiron. I have Visual Studio 2010 Express C++ Compiler installed on my system. I am ...
user avatar
1 vote
0 answers
63 views

Dimension of Grid in CUDAFunctionLoad for Matrix Multiplication

I want to do nonsquare matrix multiplication using CUDA The input is two matrices: a and b ...
user avatar
  • 11
0 votes
0 answers
134 views

CUDAQ::internal: CUDALink experienced an internal error

I have Mathematica 11.0.0 installed on Windows 10, with an NVIDIA GT 630M GPU on my Dell Inspiron. I am trying to run the CUDA examples in the Help files. All of the setup functions for CUDALink work ...
user avatar
5 votes
2 answers
284 views

OpenCL compute large matrices

I am trying to compute a big matrix $C$, of size $M \times N$, using the elements of the input matrices $A$ and $B$. The matrix $A$ is of size $M\times4$ and the matrix $B$ is of the size $2\times N$. ...
user avatar
  • 341
2 votes
0 answers
120 views

Whether Parallel computing or Gpu Computing can be performed for mathematica built-in functions? [closed]

I want to know how to run my mathematica code using GPU or parallel computing without any special coding besides using the original Mathematica code.
user avatar
5 votes
0 answers
282 views

Why doesn't NetTrain use GPU as TargetDevice?

I have a NetTrain call with the following parameters: tNet = NetTrain[inVecs -> outVecs, TargetDevice -> "GPU"]; But ...
user avatar
  • 4,677
2 votes
1 answer
71 views

Target system specification is not available for NVIDIA CUDA Compiler installation

I Installed Mathematica correctly and it indeed found my GPU. My case is exactly the same as : the same issue link However, it is not answered. Does anyone know the reason? My case: ...
user avatar
1 vote
1 answer
398 views

Sparse matrices dot multiplication

I have two huge sparse matrices, and I am interested in dot multiplication them. But I have a memory issue so a notebook is a shutdown. I am using the 11.3 version. Any suggestion on how to avoid ...
user avatar
6 votes
1 answer
1k views

CUDA for linear equations

TLDR; Is there a way to solve linear equations of a sparse matrix (discretized laplace operator) efficiently using CUDALink in Mathematica? I didn't find a CUDALinearSolve or CUDAMatrixInverse or ...
user avatar
1 vote
0 answers
49 views

How to get command line for OpenCLFunctionLoad?

Is there a way how to get the command used to compile my OpenCL kernel, when I use OpenCLFunctionLoad[]? When I use ...
user avatar
  • 171
2 votes
0 answers
1k views

Does Mathematica Rely More on CPU or GPU

I am surprised no one asked this before. I am getting a new laptop and I will be mainly using Mathematica more than anything else on it. When selecting a laptop, should I put more emphasis on CPU or ...
user avatar
  • 165
1 vote
1 answer
230 views

Using library code (specifically curand) with CUDALink

...
user avatar
  • 13.4k
10 votes
1 answer
251 views

Can one use NetTrain with two Nvidia GPUs?

I am thinking of buying another GPU to accelerate my training. Will I be able to call NetTrain with both GPUs ("TargetDevice"-> {"GPU", All})? Or would it be ...
user avatar
  • 1,525
3 votes
1 answer
211 views

CUDAQ[] returns false in Mathematica 10.0.2.0, Mac OS 10.13.2, CUDA Driver Version 387.99

CUDAQ[] returns False on my Mac OS 10.13.2. I typed Needs["CUDALink`"] and it returns no error. ...
user avatar
3 votes
1 answer
235 views

Why the GPU will cost more time when train the net

I'm in Windows 10 $Version 11.2.0 for Microsoft Windows (64-bit) (September 11, 2017) ...
user avatar
  • 23.4k
11 votes
1 answer
792 views

How to use an external GPU to train neural networks in Mathematica?

Taking steps in the uncharted territories of eGPUs, I have installed an NVIDIA GeForce Titan Xp GPU on an eGPU enclosure (Mantiz MZ-02) and have connected it to my laptop (HP Spectre x360 - 15-bl075nr ...
user avatar
  • 1,783
7 votes
1 answer
513 views

Why I can only train some NetModel with GPU

I can train NetModel's models with CPU. I'm on Windows 10 with Mathematica 11.2 GPU is GTX1080 with 8G memory. My datasets is 1000 pictures with 224*224. I can train some NetModel like ...
user avatar
  • 8,085
4 votes
0 answers
299 views

NetTrain throws internal error with large images as input (GPU)

I am training a convolutional Network with a dataset consisting of Images of the same size on my GPU (200x100 pixels, GTX 1080Ti). The images are previously resized with ...
user avatar
  • 1,525
2 votes
1 answer
389 views

CUDALink and eGPU for Mac?

I have: MacBook Pro mid 2014 13" (i.e. just an onboard Intel graphics card) NVIDIA GeForce Titan X Akitio Node Thunderbolt 2 Cable Thunderbolt 2 to Thunderbolt 3 Adaptor I have installed the NVIDIA ...
user avatar
  • 5,182