4
votes
2answers
55 views

numerical precision in output file

I want to write the numerical results of a computation to a file which is to be read in Fortran. The data looks like: ...
0
votes
1answer
87 views

Truncate a fractional value to particular number of bits?

If I have a fractional value, how can I truncate (not round) that to a certain number of bits, like 8? For example, for Pi 3.141569265359... the fractional part is 0.141569265359... ...
1
vote
1answer
225 views

Export image data precision

I'm sure there is a very easy way to control this, but I have been searching for an hour now without luck. I plot a function and export it to get a table that I can use in TikZ. ...