The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
1answer
89 views

Truncate a fractional value to particular number of bits?

If I have a fractional value, how can I truncate (not round) that to a certain number of bits, like 8? For example, for Pi 3.141569265359... the fractional part is 0.141569265359... ...
5
votes
1answer
465 views

ReadList can't read from file containing high-precision Reals

I want to read a file which contains seven columns of real numbers. Mathematica seems to have a problem with the high precision I need. My code: ...
2
votes
1answer
108 views

Why the EuclideanDistance of these 2 exact points generates the warning N::meprec?

The two points are: pts = {{1/4 (-1 - Sqrt[5]), Sqrt[5/8 - Sqrt[5]/8]}, {1/4 (-1 - Sqrt[5]), -Sqrt[5/8 - Sqrt[5]/8]}}; EuclideanDistance @@ pts ...
6
votes
0answers
59 views

Is there a way to get BSplineFunction beyond MachinePrecision?

I have been using BSplineFunction (Mathematica 8) to generate a smooth representation of some data, which I might then do some further processing on. As I ...
12
votes
2answers
295 views

Why do NumberForm and Round apparently use different tie-breaking methods?

When rounding numbers (for example, rounding a real number to the nearest integer), the "round to nearest" rule is usually used. For example, 1.4 is rounded down to 1 and 1.6 is rounded up to 2. ...
44
votes
3answers
1k views

When I can assume that all decimal digits returned by Mathematica are provably correct?

How to Control the Precision and Accuracy of Numerical Results Arbitrary-Precision Numbers Mathematica works with exact numbers and with two different types of approximate numbers: ...
1
vote
1answer
132 views

Working precision for each variable

How can I define working precision for each variable individually for example: Maximize[x y< 100, {x, y}] where the working precisions for ...
6
votes
2answers
146 views

Large Number times Tiny Number

A (maybe noob) question: Let a = 1234567891234567889998.5 b = 1234567891234567889999.5 Mathematica (v8) yields for ...
1
vote
1answer
181 views

Output precision

I've solved some equations using FindRoot and then computed some values. Now when I print the output, I only get a certain precision {{0.01, 496.983, 61.3147, ...
0
votes
2answers
305 views

Problem with working precision

I have tried to resolve the problem of the following link How can I solve precision problem I can tell the problem described in that link shortly here, It's no mater how many precision is there after ...
0
votes
0answers
28 views

What is the precision of this number? [duplicate]

In a matrix evaluation, I got the following number. 2.8330574963868513` I understand that the number after ` shows the precision of the output number. But this ...
4
votes
1answer
158 views

Padding plot ticks with zeros on the right

I would like to know how can I make a real-valued plot tick pad with a zero to the right of the decimal point on integer values. This is what I have: ...
3
votes
1answer
214 views

Numerical Error with Large Matrices

I am writing a Finite Element Analysis program in Mathematica. The code involves handling a large matrix with large entries. I get an error when I try to use Mathematica's "LinearSolve" to solve a ...
4
votes
6answers
1k views

Why is this Mandelbrot set's implementation infeasible: takes a massive amount of time to do?

The Mandelbrot set is defined by complex numbers such as $z=z^2+c$ where $z_0=0$ for the initial point and $c\in\mathbb C$. The numbers grow very fast in the iteration. ...
6
votes
2answers
270 views

Cannot Get Numerical Results to Match

I try this numerical summation (in two parts) ...
4
votes
1answer
194 views

How to find derivative of a numerical solution, where precision is ambiguous?

I am trying to take the derivative of a numerical solution. I am concerned that the way I'm doing this may be problematic due to numerical error; I think there must be a better way but I'm not very ...
2
votes
2answers
834 views

Problem with setting working precision in NIntegrate

I want to obtain a good numerical approximation (up to 10 decimal place would be ok for me) to an integral: $$ \int^{\infty}_{0} f(r)r^2dr $$ I am using the function $f(r)$, which is related to the ...
1
vote
1answer
233 views

Export image data precision

I'm sure there is a very easy way to control this, but I have been searching for an hour now without luck. I plot a function and export it to get a table that I can use in TikZ. ...
4
votes
1answer
269 views

ParallelTable and Precision

I'm using ParallelTable[] to calculate a function over a range of my parameters , ($\omega,\ell$). This seems to be working well (in terms of speed increase) except ...
6
votes
3answers
1k views

Strategies to solve an oscillatory integrand only known numerically

I have an integrand that looks like this: the details of computation are complicated but I only know the integrand numerically (I use NDSolve to solve second ...
7
votes
1answer
269 views

Confused by (apparent) inconsistent precision

$$ e^{\pi \sqrt{163}} \approx 262537412640768743.99999999999925 $$ E^(Pi Sqrt[163.0]) N[E^(Pi Sqrt[163.0]), 35] NumberForm[E^(Pi Sqrt[163.]), 35] returns ...