I'm having trouble getting my new GPU system to work with Mathematica 12.2. I have two RTX3090 cards in my setup. My NVIDIA drivers are version 460.89 (the latest).
I have installed CUDAToolkit 11.0 and cudnn 11.0 (I have also tried 11.1 and 11.2 with the same results). I have also VisualStudio 2019 installed and checked that Mathematica recognises it correctly as an external C compiler. CUDAQ[] returns True, and CUDAInformation[] Returns all the detailed information on my cards correctly. I have checked that my installation directories are correct. Library Paths have also been correctly allocated.
My problem is: when I run any GPU calculation, on either GPU card, for the first time, Mathematica takes approximately 25 minutes (independently of what GPU calculation I feed it) to start working. Once it has initialised and finished the calculation for the first time, then it will run instantaneously for the remaining times. However, if the Kernel is reinitiated, this initialization fo the GPU has to be repeated. It is as though the GPU card has to be woken up before everything starts working normally, and this takes a very long time.
Is there any further configuration of Mathematica that needs to be done? Is there any way to save the GPU status after proper initialization, so that I can quit my kernel and don't have to wait another 25 minutes?
Thank you for your help!