Questions tagged [machine-precision]

For questions on the use of machine-precision real numbers (also known as floats), the numbers that can be directly manipulated through the underlying numerical capabilities of your computer system.

Filter by
Sorted by
Tagged with
6 votes
3 answers
829 views

A bug with high precision

Consider the following two numbers: num1=0.0006000000000000001`; num2=0.0006000000000000003`; num2 appeared from ...
1 vote
0 answers
60 views

How to Parse Binary .STL File Created on Ancient 32-bit Architecture

Import[fileName,"STL"] returns $Failed The file format is so simple that one can calculate the number of triangles in the file by counting the number of BinaryReads to reach EndOfFile. https:...
1 vote
1 answer
112 views

Calculating and plotting very small values gives errors

I want to plot the difference between $sin(x)$ and its Maclaurin series of order $200$ and more on $[0,1]$. When I run the code ...
0 votes
1 answer
156 views

Spurious poles in a gain plot (due to machine precision or complex numbers?)

I have the following plot that I like to make. It details the gain of an amplifier. ...
0 votes
1 answer
50 views

Evaluation gives different results before and after simplifying expression

I am trying to evaluate $h(z)=\frac{f(z)}{g(z)}$ at points $z$ close to 0. Here I have taken an example value of $z=\texttt{z1}=10^{-7}$ for demonstration. I notice that evaluating the fraction before ...
0 votes
0 answers
97 views

How to set the precision for the entire notebook

I want to do various computations conditional on a given precision for the entire notebook. I use the following code: ...
0 votes
2 answers
92 views

Generating sequence from a number with Precision

This question was from the End-Semester question paper of the previous year of my Course on Wolfram Mathematica - Apparently when I try to code it, something is going wrong with respect to Precision - ...
0 votes
1 answer
56 views

Delayed evaluation of nested functions

i am new to Mathematica. Here is the situation: I have a exponential function of n,t that I want to calculate integral over t ...
0 votes
1 answer
109 views

Exp[-690255.2204176334] is too small to represent as a normalized machine number; precision may be lost [closed]

I'm trying to visualize the relationship of maximum temperature $(T_{m})$ with the heating rate with Randall-Wilkins theory for an energy depth of 0.85 eV. The Randall-Wilkins expression used is ...
0 votes
0 answers
55 views

Overflow + Underflow Problems with Code

I am trying to use Mathematica to verify simulation results with an analytic result. The analytic results are performance measures of the M/D/1 queue, which unfortunately uses the factorial function ...
5 votes
2 answers
110 views

Precision problem in DensityPlots

I need to perform a DensityPlot, but the figure is partially displayed. The codes and figure are shown below. ...
2 votes
3 answers
106 views

How to modify the given codes (NIntegrate of Boole) to get the most accurate result possible?

I have five conditions con1 to con5 over the two-dimensional domain $t,u\in[o,2\pi]$. I want to compute this area $(con1 \cap con2 )\cup(con3 \cap con4 \cap con5)$ numerically. I try the two codes ...
1 vote
1 answer
52 views

How to modify NIntegrate code below so that it gives the most accurate/reliable numerical result?

Imagine that I have two conditions con1 and con2 over the two-dimensional domain $x,y\in[-2,2]$. I want to compute the area of the union of these two conditions i.e. the region $(con1 )\cup(con2)$. I ...
7 votes
3 answers
437 views

Since when does Mathematica have an 'Inf' symbol?

When I do: ...
6 votes
1 answer
354 views

Table does not give expected result with `30 but right with `40

I want Mathematica to generate a table, but I am very confused by its behaviour. tab = Table[i, {i, 6.311, 6.312, 0.001}] Now I get the desired result, namely {6....
1 vote
1 answer
155 views

General:munfl error problem

I have the following function, that is the result of The integration between x and some upper limit of a positive function, thus should be positive $f(x,vE) = \frac{e^{-1140.09 x} \left(e^{67945.5 \...
2 votes
0 answers
35 views

Working Precision Slowing Down Numerical Integration Computation

...
0 votes
1 answer
100 views

Is there any alternative for conditional plot that gives a more precise result in a shorter time?

I have the given function $Func$ and want to have a plot of those domains where $-3\leq Func\leq 3$ in precise details. I am using ...
1 vote
0 answers
74 views

How to handle "too small to represent as a normalized machine number" when plotting a figure [duplicate]

I am trying to plot a figure by the following codes: Plot[(27 2^((-2 + a)/(-1 + a)) 5^(a/(-1 + a)) 7^(1/(1 - a)) a^2)/((-1 + a) (4 + 9 a)), {a, 1.001, 3}] ...
2 votes
2 answers
256 views

How to prevent Mathematica from rounding some PDF values to 0?

Dear Mathematica community, I'm having a problem with the PDF function for the hypoexponential distribution. Specifically, Mathematica returns 0 as soon as the value is very small. Below is an example:...
0 votes
1 answer
78 views

How to avoid General::munfl errors?

Let's have a look at a following system of equations: ...
0 votes
1 answer
206 views

Floating point precision and speed [closed]

I am attempting to understand how to speed up the evaluation of numerical expression. Specifically, following the first point of this blog, Mathematica is much quicker dealing with floating-point ...
9 votes
1 answer
318 views

IntegerPart - is this a known bug?

I'm working in Mathematica 13.0 and I type a=0.00001; IntegerPart[a/a] and well, the output is 0. Try with almost any other value of ...
4 votes
2 answers
168 views

Adding numbers with defined precision produces incorrect result

I've tracked a bug in my code down to the problem of adding two numbers together, with the left argument having machine precision, e.g by 3` . The issue is, if ...
4 votes
0 answers
177 views

Is it possible to get the original number from DecimalForm?

Bug introduced in 5.2 or earlier and persisting through 13.1.0 [CASE:4315787] Wrong behavior of NumberForm (DecimalForm outputs ...
1 vote
0 answers
80 views

Issue with some floating-point errors and not others

Not looking for a solution necessarily, but just trying to understand why this issue occurrs. I have a 'Do' loop which iterates some algorithm over values of a parameter 'x' with range {x,0,1,0.1} and ...
3 votes
1 answer
266 views

How to handle very numbers that are "too small to represent as a normalized machine number"?

I will preface this by saying that I am not very familiar with Mathematica whatsoever. That is why I am asking this here even though I have found a few forum posts that might provide the solution to ...
2 votes
2 answers
2k views

Error "is too small to represent as a normalized machine number; precision \ may be lost " for small values in Plot

I'm trying to plot two curves but I'm having issues with the lower end of the range: ...
3 votes
1 answer
150 views

FixedPoint not working, despite quick convergence of sequence [closed]

Trying the computation below, with Mathematica 13.0.0, I am not getting a result returned. FixedPoint[Cos, 0.85] This appears in the 3rd edition of "...
4 votes
1 answer
353 views

Real number equality (==) not working: what's the least-overcomplicated solution?

I'm running a program that evaluates equalities after I substitute all symbols for numbers. The equalities on floats are giving me trouble. My program is reaching a point where something like the ...
1 vote
1 answer
135 views

Exponential fit precision lost

I have a data: ...
0 votes
0 answers
61 views

How to set up precision by default?

I have a table computing many numbers with large precision. Because of this, probably, Mathematica consumes a lot of RAM. Is it possible to restrict the precision in any calculations by default (...
1 vote
2 answers
46 views

`KernelMixtureDistribution` error message about precision

I want to use KernelMixtureDistribution to deal with a large amount of data points. For example, the following codes shows how I use it: ...
0 votes
0 answers
42 views

Why is the `N` function giving me the wrong result when using WolframScript? [duplicate]

I am using wolframscript.exe to learn mathematica and I would expect the following code to return 0.7071: ...
1 vote
0 answers
51 views

plot and limit are not in agreement [closed]

I am plotting the following function $\frac{\sqrt{t \text{$\omega_c $}}-\sqrt{\pi } e^{\frac{1}{t \text{$\omega_c $}}} \text{erfc}\left(\frac{1}{\sqrt{t \text{$\omega_c$}}}\right)}{(t \text{$\omega_c$}...
0 votes
1 answer
42 views

Indeterminant numerical value of summation

I have the following two-fold summation. ...
0 votes
0 answers
64 views

Mathematica accuracy errors when creating data

I created training data for a neural network and below are two errors I got The only code that uses "FindRoot" command is the following ...
1 vote
0 answers
67 views

How does WorkingPrecision in NDSolve handle MachinePrecision?

I'm wondering why the following code NDSolve[{y''[t] + y[t] == 0, y[0] == 1., y'[0] == 0}, y, {t, 0, 10}, WorkingPrecision -> 6] throws the error/warning, that ...
42 votes
2 answers
1k views

Is there a difference between Divide[a,b] and a/b?

In this comment it was asserted that Divide[a,b] and a/b are different, though the documentation indicates that they are the ...
3 votes
2 answers
201 views

Simplify for precision

I have an a set of equations to solve — details irrelevant — the result of which will be converted into PostScript, a 1980s printer-control language the only floating precision of which is single. ...
1 vote
0 answers
43 views

ContourPlot3D with small domain produces glitchy mess

I'm able to plot some graphs over small domains, but not others. For example, this works just fine: ...
18 votes
2 answers
567 views

Rounding problems inside InputField

The community needs to determine if this is behavior is a bug or not. – Mr.Wizard Consider the following InputField ...
0 votes
0 answers
41 views

General::munfl - Precision lost in LinearModelFit

I am new to mathematica so I am confused regarding the loss of precision in LinearModelFit. In building a linear model with uora (1 or 2) and encodeSeverity (1,2 or 3) ...
3 votes
0 answers
265 views

How to deal with too small numbers

When dealing with a code that produces too small numbers (in a complicated way) like 0.33691 4.015757066049965*10^-330 I get the following warning General::munfl: ...
0 votes
0 answers
52 views

Solving a determinant to get non-zero roots in a heat transfer problem

I am trying to solve a mathematical model of a heat transfer problem. As an intermediate step there is a characteristic equation in the form of a determinant, which needs to be solved for variable <...
0 votes
0 answers
94 views

How to change Machine Precision digits to meet the tolerances

I am trying to solve for Tcm and Mag by solving nonlinear equations using FindRoot command using following code: ...
1 vote
0 answers
46 views

Are pixels machine numbers? [closed]

Mathematica allows one to work with the information that is behind a photo. For example, the command ImageData generates a list containing the “pixels” (which will it be a number from $0$ to $1$ if no ...
0 votes
0 answers
72 views

Problem with the Rank of a matrix after a FindRoot

I am solving a boundary problem defined by a set of four-component vectorial functions. Without going into many details, I have two functions on the left and two on the right of an interface. The ...
1 vote
2 answers
104 views

How to increase the value of MinMachineNumber to avoid overflow error?

I have a complicated function called f2[re] ...
0 votes
0 answers
105 views

How to copy and paste numbers with "`" mark and use them in calculations, without using N or setting precision every time

Suppose we have run a calculation and get a number like 2.758952615889003` If we then copy-paste this number and do a calculation like ...

1
2 3 4 5