6
$\begingroup$

Bug introduced in 10.0 and fixed in 10.0.2.


I have a small package with utilities, which looks like that:

BeginPackage["Utilities`"];
f::usage = "...";
Begin["`Private`"];
f[x_] := x;
End[];
EndPackage[];
DistributeDefinitions["Utilities`"];

When I load this package and try to use my function f with ParallelEvaluate, everything works as expected:

(* Input *)
ParallelEvaluate[{$KernelID, f[2]}]
(* Output *)
{{1, 2}, {2, 2}}

But I get into trouble when I try to use Utilities package inside another.

BeginPackage["MainPackage`", {"Utilities`"}];
g::usage = "...";
Begin["`Private`"];
g[x_] := ...;
End[];
EndPackage[];

The function g is quite big and complicated and f is called somewhere inside it.

When I call g, everything works fine. But when I try to do something like this:

ParallelEvaluate[{$KernelID, g[2]}]

I get a lot of errors. As I understood, the problem is in function f. It seems to be not defined in the context of the main package for parallel kernels.

I've added Print[Definition[f]]; into the body of g, and when I try to use ParallelEvaluate with g I get this:

Both kernels print Null.

Which means, that f isn't defined inside of g. Do you have any ideas, how I can fix it?


Update 1.

While manual distribution of definitions doesn't work, ParallelNeeds works good. I removed DistributeDefinitions from Utilities package and added ParallelNeeds to MainPackage:

ParallelNeeds["Utilities`"];
BeginPackage["MainPackage`", {"Utilities`"}];
...
EndPackage[];
DistributeDefinitions["MainPackage`"];

This work fine. But in my case Utilities package is stored in another folder. And if I do so in MainPackage:

SetDirectory["Dependencies/"]; (* Directory with Utilities package. *)

ParallelNeeds["Utilities`"];
BeginPackage["MainPackage`", {"Utilities`"}];
...
EndPackage[];
DistributeDefinitions["MainPackage`"];

ResetDirectory[];

The definition is again not distributed. It seems like changing directory "erases" distributed definitions. Can I avoid it somehow without placing Utilities near MainPackage?


Update 2.

I found a solution for the problem on my own. One need to set/reset directories not only for kernel, but also for its subkernels, like this:

SetDirectory["some_dir"];
ParallelEvaluate[SetDirectory["some_dir"]];

Update 3.

It's a bug. The answer of Wolfram support:

I could reproduce this problem on my machine and have now reported it to our developers. I hope this can be fixed in our future releases. We at Wolfram, appreciate your feedback and encourage you to let us know of any other problem you may come across while using Mathematica.

$\endgroup$
  • 2
    $\begingroup$ Could you report this to Wolfram support and tell us what they said? In version 9 the definitions do get distributed properly. $\endgroup$ – Szabolcs Jan 23 '15 at 18:49
  • $\begingroup$ Maybe related to this question? $\endgroup$ – xslittlegrass Jan 31 '15 at 17:03
  • $\begingroup$ Does anyone know if this has been fixed? If so, in which version? $\endgroup$ – Michael E2 Aug 6 '15 at 12:28
  • $\begingroup$ If anyone has more up-to-date information about this bug, please update the bug header (see meta.mathematica.stackexchange.com/questions/1610/…). $\endgroup$ – Michael E2 Aug 9 '15 at 12:00
  • $\begingroup$ @MichaelE2, I don't encounter this issue in version 10.0.2, so I've updated the bug header. But the bug could be probably fixed in the previous release. $\endgroup$ – Kirill Mingulov Aug 9 '15 at 15:39
8
$\begingroup$

I believe this may be a bug in version 10 as in version 9.0.1 the definition does get distributed. What happens in version 10 also directly contradicts the documentation. Here's an illustration:

enter image description here

$\endgroup$
  • $\begingroup$ Thank you! I've reported to Wolfram support and now wait for their answer. Can you help me with another problem, which I've described in the update of my question? $\endgroup$ – Kirill Mingulov Jan 23 '15 at 22:48

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.