I'v trained a deep network (e.g. LeNet) using NetTrain with TargetDevice -> "GPU". Everything works well and it is really fast. But now I have a trained network and tens of thousands of samples to classify. The GPU based training was evaluating ~ 1200 samples/second but seems like I can only use CPU based ParallelMap to evaluate trained network with samples (i.e. slow).
Is there a way to apply the trained network using the GPU as target device?