Questions on the statistical functions of Mathematica.

learn more… | top users | synonyms

18
votes
4answers
3k views

Showing the correlation of two variables using a plot

I have a list of $\{x_i,y_i\}$ pairs and I want to show that $x_i$'s and $y_i$'s have positive correlation. The result of ...
0
votes
0answers
25 views

Standard error of slope estimator [migrated]

Can someone please help explain this. I know the answer is a). Or provide a link with more information. The slope estimator, β1, has a smaller standard error, other things equal, if a) there is ...
0
votes
1answer
533 views

PDF of binomial distribution and mixed binomial distribution

I want to plot the PDF of binomial distributed function and a mixed binomial distributed function, therefore I entered for the binomial distribution function the following: ...
0
votes
0answers
38 views

weiner process conditional expected maximum? [on hold]

Suppose we have weiner process over interval t=0 to t=1, with standard deviation 1 over interval and mean 0. If time now is r where r between 0 and 1 and x is current value of process and m is ...
2
votes
0answers
51 views

How to include confidence intervals into ProbabilityScalePlot?

I use ProbabilityScalePlot[data, "Weibull"] to plot measured data and ...
5
votes
1answer
253 views

Estimation of vector autoregressive (VAR) process

To estimate 1-dimensional VAR process (which is AR process) you can easily use functions EstimatedProcess or ...
4
votes
1answer
150 views

Calculate the covariance of a large matrix

I have to compute the covariance of 50 very large integer matrices (2500x2000 elements). However, according to my estimation this will take around 10 days. Do you have any ideas how to speed things ...
3
votes
1answer
52 views

TransformedDistribution with respect to new variable

Given a custom pdf $f_x(x)$, I'm trying to find it's transformation $f_y(y)$ where $$y=x^2$$ and $$f_x(x)=30*x^2 (1 - x)^2, 0<x<1$$ I tried to using the following commands: ...
1
vote
0answers
24 views

Meaning output ANOVA post hoc tests

I am carrying out an ANOVA in Mma, and I wanted to apply a post-hoc test, but I do not understand the output that is given. It says e.g. Model-> Duncan, {4, 5} ...
4
votes
2answers
264 views

Numerical Integration with InverseErfc

I am trying to numerically integrate an equation that involves InverseErfc (embedded in the copula defined). The equation looks like the following: $$ \int_0^T \int_0^\infty \int_0^\infty ...
2
votes
1answer
64 views

Probability evaluation fails with equals condition

The following evaluation fails (the result is just the copy of the input) $$\text{Probability}[0<x\leq a | x-y=t,\{x\ {ExponentialDistribution}[\lambda ],y\ {ExponentialDistribution}[\lambda ...
2
votes
0answers
44 views

k-means clustering using squared correlation in Mathematica

I am trying to cluster data using the squared correlation coefficient since in the case of my data, -1 correlation is equivalent to 1 correlation (polarities do not matter). How can this be done in ...
1
vote
1answer
111 views

Statistics confusion

I have two data sets. When I do a QuantilePlot[data1, data2], I get the graph below. However, ...
3
votes
1answer
44 views

How to use a custom CDF in a Kolmogorov-Smirnov test

How do I use a custom CDF that I defined for a Kolmogorov-Smirnov test. I have one input vector of data whose CDF I claim to have derived but want to check whether it agrees with my closed form ...
22
votes
3answers
596 views

Which Distributions can be Compiled using RandomVariate

Recently, Oleksandr kindly showed a list of Mathematica commands that can be compiled. RandomVariate was part of that list. However, whether this can be compiled depends upon the distribution that is ...
1
vote
1answer
104 views

Modify BinList to give elements indices in list instead of giving the list elements belonging to each bin

How could I use BinList to give elements indices in list instead of giving the list elements belonging to each bin ? Thanks.
4
votes
2answers
74 views

Behavior of Commonest when there is an even split between the elements of the list it is given

How can I alter Commonest so that, when I give it an input of four zeroes and ones such as $\{0,1,1,0\}$, which has an even split in its elements, it returns the ...
1
vote
0answers
90 views

Is this the correct method in using bootstrapping to determine a lower confidence bound?

Quite often in industry, due to cost and schedule constraints, decisions must be made on small sample size data. I have 4 cycles-to-failure values resulting from running samples to failure in a ...
7
votes
3answers
520 views
1
vote
1answer
65 views

Stochastic Approximation and Simulation using Running Median

I have a function $$F(X_{t+1},Y_{t}^{med})= \alpha X_{t+1} + (1-\alpha) Y_{t}^{med},$$ where $$Y_{t}^{med} = Median(Y_1, Y_2,... Y_t).$$ Moreover, $Y_1 = X_1$ and $Y_t = F(X_{t},Y_{t-1}^{med})$ ...
5
votes
3answers
135 views

Creating Correlation Table (and Working) With Missing Data

I am working with data that contains missing values (I have several variables (across the columns) and several observations (across the rows) in an excel spreadsheet). Example of the data structure: ...
4
votes
1answer
94 views

Correlation test issues

When using Correlation[] function I sometimes get the strange warning: ...
5
votes
1answer
152 views

Simulation Sample Paths for Stochastic Approximation Algorithm

Let $X_t$ be IID random variables in $[0,1]$ and CDF $F(\cdot)$. Suppose there exists a variable $Y_t$ given by: $Y_1 = X_1$ and $Y_t = \phi(X_t, \overline{Y}_{t-1}), \forall t >1$, where ...
1
vote
0answers
34 views

Truncated Distribution Parameter Search Produces Singular Jacobian Using FindRoot

I'm trying to find the 2 parameters of a truncated Weibull distribution using version 10 and FindRoot. I would like to truncate the distribution between t =0 and t = 3600 with the probability of ...
7
votes
0answers
126 views

Median of Dataset in Mathematica 10

I'm having trouble calculating the median of a Dataset[] in Mathematica 10. The situation is as follows. Consider a dataset that was defined as follows: ...
6
votes
3answers
140 views

Expected sum of largest 3

I pick 4 numbers from the Uniform Distribution. I need the expected value of the sum of the 3 largest. I am pretty sure that the answer is 9 / 5 which agrees with a simulation. I would like to get ...
3
votes
2answers
268 views

SinglePredictionBands versus MeanPredictionBands from NonlinearModelFit

From my Statistics lectures I know the term confidence and prediction interval, whereas the confidence interval is smaller than the prediction interval. If I plot the mean and single prediction bands ...
1
vote
1answer
110 views

Simulation Beta Distribution

Suppose a function such as: $\phi^{\alpha} (x,y) = \left\{ \begin{array}{l l} \alpha x & \quad \text{if $x < y$}\\ x & \quad \text{if $x = y$}\\ \alpha x + (1 -\alpha) & ...
1
vote
2answers
208 views

build and estimate a time series process

I want to generate an EGARCH process. My problem is that I do not see how to create new processes beyond those available. The process itself is : $$\epsilon(t) = \sigma(t) \eta(t)$$ ...
0
votes
1answer
50 views

Solving minimum length confidence interval problem

I'm trying to find the minimum length of a confidence interval for the variance from a sample iid with normal distribution. I tried ...
0
votes
1answer
52 views

Can I use boolean parameters in LogitModelFit?

For example, to use 1 as True and 0 as False: ...
6
votes
4answers
226 views
2
votes
1answer
72 views

ZTest result not making sense

I'm using version 10. I'm having difficulty with understanding why I'm getting some output from the ZTest function. Here is the code for my specific example. ...
4
votes
1answer
182 views

BoxWhiskerChart - 10-90th percentile instead of min - max

I am trying to draw a custom BoxWhiskerChart with alternative values determining fences. I have data that has a lot of outliers and I have to compare it to another chart that has 10-90th percentile ...
2
votes
0answers
45 views

Why do EstimatedDistribution and DistributionFitTest work this way

I am fitting some time-series data to both a stable distribution and a normal distribution in order to assess the goodness of fit of each. Along the way I encountered the following confusing result. ...
25
votes
3answers
2k views

Histograms with pre-counted data

I've got some large data sets which have been counted but not binned already - essentially, a list of pairs of values (not bins) and counts.* (Or, equivalently, it's been binned into too-small bins.) ...
0
votes
1answer
110 views

Fitting data to a Poisson distribution

I'm trying to fit a Poisson Distribution to data produced in a lab. I've successfully made a Histogram of the data, which looks like: However, when I try to fit the Poisson Distribution using: ...
2
votes
2answers
137 views

Finding Expectation of function of a Log-normal distribution

Say $Y=g(X)$ and $p_X = \frac{e^{-\frac{(\mu -\log (x))^2}{2 \sigma ^2}}}{\sqrt{2 \pi } x \sigma }$ is Log-normal density function: [Wiki] Find E[Y]? Since $E[Y] = \int_0^\infty y f_Y \ dy = ...
0
votes
2answers
127 views

Error function fit of data

I have this experimental data set which I know should follow the Complementary error function. My goal is to find the σ of the associated gaussian distribution. However, I cannot seem to do it in ...
2
votes
2answers
157 views

Measures of association, Concordant and Discordant

I want to calculate concordant and discordant pairs on nx2 tables. ...
14
votes
2answers
325 views

Visualization: elliptical insights into data sets…

I was recently reading the following paper on visualization techniques using ellipses to gain statistical insights. Elliptical visualization for looking at correlations has briefly been touched on ...
0
votes
1answer
95 views

Generating a list of standard normal random variables

Im trying to generate a list of random (standard) independent normal variables. For this, I first generate a random list of, say, 100 real numbers in the range [0, 1000], and then make them standard ...
16
votes
3answers
2k views

Standard errors for maximum likelihood estimates in FindDistributionParameters

I am trying to fit a non-standard PDF to data and FindDistributionParameters works great, and gives me the parameters of the distribution back using maximum ...
1
vote
1answer
98 views

Moment central of a binary image

I am implementing the Hu set of invariant moments detailed here Hu set of invariant moments. I implemented the moment Image like this: ...
1
vote
2answers
167 views

On Parameter Estimation using FindDistributionParameters

I am a novice of Mathematica and have recently started my self-study of maximum likelihood estimation (MLE) using Mathematica. I would like to estimate the parameters associated with a distribution ...
5
votes
1answer
370 views

Is there a free version of the Springer book “Mathematical Statistics with Mathematica”?

Is there a free version of the Springer book: $$\text{Mathematical Statistics with Mathematica}$$ by Rose and Smith ... available on the internet?
1
vote
1answer
109 views

Compute symbolic Expectation of a summation

I am required to computed following Expectations : $E[\displaystyle\sum\limits_{i=1}^N \frac{X_{i}}{N}] = \bar{x}_{0}$ & $E[\displaystyle(\sum\limits_{i=1}^N \frac{X_{i}}{N})^2] = ...
1
vote
2answers
100 views

Assign a Distribution to a group of symbolic variable [closed]

I'm looking to compute this Expectation : "i" represent a individual and h(i) is value. I would like the compute the Expected value of his value times the mean of the groups. Everything is unknown ...
0
votes
0answers
34 views

Chi square: compare two different distribution

I try to compare two file with two different distribution of numbers. So i have random1.dat and random2.dat each one are vectors of more then 1000 rows. I saw from this question Doing a chi-square ...
3
votes
2answers
297 views

KolmogorovSmirnovTest[] On Frequency Data

I have two observed frequency data, let say f1 = {100, 200, 150, 100, 50}; f2 = {110, 195, 160, 105, 40}; and i want to know whether these random samples belong ...