<< JLink`;
InstallJava[];
ReinstallJava[JVMArguments -> "-Xmx8192m"]
data = Import["E:\\data2.xlsx"][[1]];
fieldNames = data[[{1}, {1, 2, 4, 5, 6, 7, 8}]];
training = data[[2 ;; 220206, {1, 2, 4, 5, 6, 7, 8}]];
test = data[[220207 ;;, {1, 2, 4, 5, 6, 7, 8}]];
model = Predict[Cases[training, x_ :> (x[[;; 6]] -> x[[7]])]]
The last line produces the following error
No more memory available.
Mathematica kernel has shut down.
Try quitting other applications and then retry.
How should I get mathematica to produce a classifier/predictor function which i can use. Is mathematica capable of working with large datasets like sql server can using disk reads rather than memory.
Please help i have to produce results and really need a workable solution.
File
. See this answer. $\endgroup$ – Edmund Oct 7 '16 at 23:37File
function sincePredict
andClassify
input format is like{{x11,x12,x13,...}->y1,{x21,x22,x23,...}->y2,...}
. But is there a way to feed data in chunks to Predict or Classify or even run these function on the chunks and then "merge" them? $\endgroup$ – user13892 Oct 8 '16 at 9:33