10
$\begingroup$

Here I have a picture of a function I graphed:

reg[x_,y_]:=(x^2+y^2)Cos[4ArcTan[y/x]];
Plot3D[reg[x,y],{x,-2,2},{y,-2,2},AxesLabel->Automatic]

enter image description here

And here is another function that I graphed:

alt[x_,y_] := (8x^4)/(x^2+y^2)-7x^2+y^2;
Plot3D[alt[x,y],{x,-2,2},{y,-2,2},AxesLabel->Automatic]

enter image description here

You see they appear identical. Indeed they should be. Yet here is the graph of their difference:

Plot3D[reg[x, y]-alt[x,y], {x, -2, 2}, {y, -2, 2}];

enter image description here

I have tried increasing the plot points, to meet only increasingly disastrous results. What is going on here?

EDIT:

Note that I am currently running a copy of Mathematica 10 on my school's computers, and not my personal copy. So it remains to be seen whether the issue will be reproduced when I get home.

I have included code samples that can be copied and pasted, at the suggestion of a commenter.

$\endgroup$
17
  • 3
    $\begingroup$ Numerics (rounding error/loss of precision). (It's polite to post code that people can copy and test.) $\endgroup$
    – Michael E2
    Commented May 16, 2016 at 20:32
  • 2
    $\begingroup$ Try an increased WorkingPrecision. $\endgroup$
    – Karsten7
    Commented May 16, 2016 at 20:38
  • 5
    $\begingroup$ Have you looked at the scales on that plot of differences? $\endgroup$ Commented May 16, 2016 at 22:04
  • 1
    $\begingroup$ @Daniel Lichtblau I never noticed that before. $\endgroup$ Commented May 16, 2016 at 22:06
  • 3
    $\begingroup$ @Mr.Wizard "Duplicate" seems better. Even if the OP made a simple mistake in reading the scales, the question seems not so simple. At root, the two Q&A have similar causes, although the topics were discussed in separate chapters of the textbook I just taught from. (Polynomial evaluation has a long history and is still an active area of research.) The question "What's going on?" has different nuances in each case, even if "How to fix it?" has a similar answer (note here that any WorkingPrecision works, whereas in the dupe it must be increased). (I voted to leave this open, btw.) $\endgroup$
    – Michael E2
    Commented May 17, 2016 at 12:34

2 Answers 2

18
$\begingroup$

There are several important things about the way computer systems represent real numbers, which most of the time can be blithely ignored, just like the safety of bridges in the United States.

One important thing is that numbers are discrete. With regular machine precision (double precision), the mantissa has 53 bits, which provides a lot of resolution. For instance, in the interval between two successive powers of $2$ such as $[1, 2)$, there are 2^53 or almost 10^16 numbers that can be represented. For most applications, it's close enough to continuous. But now suppose we've computed two numbers in two different ways and they're supposed to be the same. A rounding error of 1 bit in the last place means an error of 2/2^53 or about 2.2x10^-16. When we subtract them, we don't get zero but a very small number, relative to the size of the numbers in the interval $[1, 2)$.

Okay, now let's look at the graph of the difference:

Plot3D[reg[x, y] - alt[x, y], {x, -2, 2}, {y, -2, 2}, 
 AxesLabel -> Automatic, PlotRange -> All, ViewPoint -> Front]

Mathematica graphics

We see what appear to me to be discontinuous jumps on the order of 3x10^-15. Maybe that is due to rounding error of one or two bits in the computation of the functions. Let's see if that's reasonable. It turns out that in alt[x, y], there is a term that gets as large as 32:

MaxValue[{(8 x^4)/(x^2 + y^2), -2 <= x <= 2 && -2 <= y <= 2}, {x, y}]
(*  32  *)

So a rounding error in the last bit would be as big as

32./2^53
(*  3.55271*10^-15  *)

That's just about what we see. In fact it's fairly easy to find them near the maximum.

reg[x, y] - alt[x, y] /. {x -> 2. - 0.01, y -> 0.01}
(*  3.55271*10^-15  *)

In fact a computation might have more than one rounding error, and we can find them, too. Note below, that two consecutive machine numbers in the interval $[1,2)$ are separated by 2/2^53 = 2^-52. In Mathematica on most machines, this is represented by $MachineEpsilon. So what we see below is a discontinuous jump in values between successive numbers.

reg[x, y] - alt[x, y] /. {x -> 2. - 0.01 + 4 $MachineEpsilon, y -> 0.01}
reg[x, y] - alt[x, y] /. {x -> 2. - 0.01 + 5 $MachineEpsilon, y -> 0.01}
(*
  3.55271*10^-15
  7.10543*10^-15
*)

When one uses WorkingPrecision -> n for some number n, a different sort of number is used to represent real numbers, so-called Arbitrary-Precision Numbers. These numbers have a numeric representation of the number with extra digits (bits) to minimize rounding error and a number that represents the precision of the number. When Mathematica computes with these numbers, it computes both a numeric result and its precision. Here are two function computed near the maximum as before, with an input precision of 10 (like setting WorkingPrecision -> 10).

reg[x, y] /. {x -> 2 - 0.01`10, y -> 0.01`10} // FullForm
(*  3.95940002020099994949750012625624968433`11.97853773957617  *)

alt[x, y] /. {x -> 2 - 0.01`10, y -> 0.01`10} // FullForm
(*  3.9594000202009999494975001262562496842`10.505762813554403  *)

Note that they agree to far more than 10 digits. (Note also that the precisions, 11.978 and 10.505, are different and both increased. There is nothing unusual in this.) When we subtract them, we get zero because none of the differences that can be seen are significant given the precisions of the numbers.

reg[x, y] - alt[x, y] /. {x -> 2 - 0.01`10, y -> 0.01`10} // FullForm
(*  0``9.893752108267545  *)

(Note that 9.893 is the Accuracy of the result, not the Precision. It's how many digits after the 0 are zero.) So when you use a WorkingPrecision other than MachinePrecision in plotting the difference, you should expect to see the plane z == 0, provided Mathematica calculates accurately. (A catastrophic loss of precision is possible, although maybe not in this case.)

Plot3D[reg[x, y] - alt[x, y], {x, -2, 2}, {y, -2, 2}, 
 AxesLabel -> Automatic, WorkingPrecision -> 4]
Plot3D[reg[x, y] - alt[x, y], {x, -2, 2}, {y, -2, 2}, 
 AxesLabel -> Automatic, WorkingPrecision -> 444]

Mathematica graphics

Both Plot3D command give the same picture. But to my mind, the first is a bit misleading. The image gives the impression that the functions are equal, but perhaps they only agree to the first four digits -- an okay, but not a good approximation. For instance the following shows that Exp appears to be a polynomial.

Plot3D[Exp[x y] - (1 + (x y) + (x y)^2/2 + (x y)^3/3! + (x y)^4/4!),
 {x, -1/2, 1/2}, {y, -1/2, 1/2},
 AxesLabel -> Automatic, WorkingPrecision -> 4]
$\endgroup$
4
$\begingroup$

Check out the following

FullSimplify[(x^2 + y^2) Cos[
    4 ArcTan[y/x]] - ((8 x^4)/(x^2 + y^2) - 7 x^2 + y^2)]
(* 0 *)

The two expressions are identical so it is not suprising that they produce identical plots.

$\endgroup$
1
  • 4
    $\begingroup$ To repeat the note I gave to the OP earlier: polar to Cartesian conversions are often better done with ArcTan[x, y] instead of ArcTan[y/x]. $\endgroup$ Commented May 17, 2016 at 1:11

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.