For questions on the use of machine-precision real numbers (also known as floats), the numbers that can be directly manipulated through the underlying numerical capabilities of your computer system.

learn more… | top users | synonyms

1
vote
1answer
53 views

WorkingPrecision causes issue in the NIntegrate

I really can't figure out why my code sometimes is not working. My integrations involve two variables (k and kz). The integration range for both of them are from zero to infinity. I found out that in ...
4
votes
0answers
56 views

Machine precision infinity

Is it possible to obtain the machine precision (double) version of Infinity? This is useful when using LibraryLink and C ...
2
votes
0answers
828 views

Set Global Maximum Precision

I'm sure this has been asked before, but I've looked around and can't figure it out: How do I set a global maximum precision for a notebook (or in general, globally)? I have a large notebook in ...
1
vote
0answers
31 views

Which operations preserve digit precision?

Imagine I had to use numbers with a 600 precision digits. Do all mathematical operations, like +,-,...
0
votes
0answers
110 views

Precision of a complex number

In an output I'm getting a number like -0.33998187034939803 + 0.I. Finding ...