3
$\begingroup$

I believe that I encountered a bug in Mathematica 12.

The Classify[] function throws errors when simultaneously:

  1. The training set has significantly above $10^5$ examples.
  2. Method->"_" option is absent, i.e. the procedure for searching for the optimal algorithm is active.

(When any of these conditions are changed, the classifier training proceeds correctly.)

The problem depends on the Mathematica version. (I will elaborate this idea.)

The following errors appear together (repeated several times):

a)

NetTrain :: encgenfail2: Could not encode one or more inputs for "Output" port: supplied data was a length-64 vector of real numbers, but expected a class. The invalid inputs had indices {158629, ..., << 14 >>}

b)

LibraryFunction :: typerr: An error occurred in the tree_evaluation.

c)

Part :: pkspec1: The expression -LibraryFunctionError [LIBRARY_TYPE_ERROR, 1] can not be used as a part specification.

and subsequent errors related to list and iteration indices and function domains.

The function in question returns a working classifier, but it takes a lot of time and sometimes it is obtained by a non-optimal method and exhibits a non-optimal performance.

It seems that for large (but not very large!) data sets, the optimization procedure of the classification method fails.

Does anyone of you have an idea how to force it to work properly or is there any hope for a patch?

Performing the classification with specified methods and selecting the best is not a satisfactory solution, among others because each method has its own variants and they have some meta- parameters that are optimized. I do not know if in case of specified method, optimization within its variants and meta-parameters is done, or their default values ​​are used. On smaller data sets, where both approaches work, you can notice a worse performance of classification with a certain method, even if it is the one that the automatic search finds the best.

In version 11.3, this error did not show up. I do not know, however, whether it was absent or simply invisible, because it seemed to me that the performance of the classification was (with large sets) insufficient and the method choice surprising.

Notebook and database attached:

Improve this question
$\endgroup$
13
  • $\begingroup$ I found the related topic: mathematica.stackexchange.com/questions/197062/… but also unsolved. $\endgroup$
    – Druid
    Commented May 2, 2019 at 13:14
  • 1
    $\begingroup$ Can you share your data set? Or a synthetic equivalent that shows the same issue? $\endgroup$
    – Stefan R
    Commented May 2, 2019 at 16:13
  • 1
    $\begingroup$ @StefanR, good point. I just edited the question and added links to files. $\endgroup$
    – Druid
    Commented May 2, 2019 at 17:35
  • 1
    $\begingroup$ Please add cross links to/from this and the corresponding post on Wolfram Community (so readers will know where else to look to see what others may have written). $\endgroup$
    – Daniel Lichtblau
    Commented May 3, 2019 at 14:52
  • 1
    $\begingroup$ There may be two issues here. I cannot reproduce the NetTrain errors but I can reproduce the others. Does NetTrain by itself work for you? E.g. the documentation examples? $\endgroup$
    – Stefan R
    Commented May 3, 2019 at 15:19

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Browse other questions tagged or ask your own question.