The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [rounding]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
1answer
130 views

Is NumberForm double rounding numbers?

A number like 0.644696875 is represented internally as 0.6446968749999...: N[FromDigits[RealDigits[0.644696875, 2], 2], $MachinePrecision] (* 0.6446968749999999 *) ...