All Questions
Tagged with rounding conversion
1 question
2
votes
1
answer
295
views
Is NumberForm double rounding numbers?
A number like 0.644696875 is represented internally as 0.6446968749999...:
N[FromDigits[RealDigits[0.644696875, 2], 2], $MachinePrecision]
(* 0.6446968749999999 *)
...
- 8,687