# Efficient maximisation of log-likelihood

I would like to efficiently find the maximum $(\sigma,\lambda)$ for the log-likelihood of the derived distribution below. I only need $\sigma$ and $\lambda$ to one decimal place - so not very precise. I have tried lowering both the AccuracyGoal and PrecisionGoal to as low as 1, or 2, but this doesn't appear to affect the rate at which the solution is obtained.

The below code creates the function, the some test data, then attempts its maximisation:

aDist[σ_, λ_] := TruncatedDistribution[{0, ∞},
MixtureDistribution[{1, 1}, {NormalDistribution[0, σ], ExponentialDistribution[λ]}]];

data = If[# > 0, #, 0] & /@ RandomVariate[aDist[4, 1/3], {20}];

NMaximize[{LogLikelihood[aDist[σ, λ], data], 10 > σ > 0, 1 > λ > 0}, {σ, λ}]


Whilst for 20 data points this method returns a solution in a short time, for my actual dataset I need to find a solution for a dataset of size 1000+. As it currently stands, this would be untenable for the above method.

I have tried some of the different methods available to NMaximize, including "RandomSearch", and "DifferentialEvolution". However, the method I choose does not seem to make the maximisation run faster.

I have also tried FindMaximum where I start the solver close to the actual parameter values, however this calculation appears to hang forever. I have also tried differentiating, then using NSolve, and FindRoot, but again I am not having any success. Finally I tried a variant on the $EM$ algorithm here, where I alternate between maximising over $\sigma$ then $\lambda$, but again this doesn't help.

Does anyone have any ideas here? I know I could use MCMC if I turn the problem into a Bayesian one, but for reasons I won't mention here I don't want to do this.

As an aside, I can see why it is difficult to find a reasonable maximum to this function, since there is a high degree of correlation between the parameters of the distribution. However, I can't help but think there's a solution of which I'm neglecting to think.

• Have you seen FindDistributionParameters[]? Feb 21, 2016 at 1:31
• I had tried it, but must have made a mistake. I have tried it now, and it works much, much better than previous methods. Thank you very much. I will close the question now. Best, Ben Feb 21, 2016 at 1:38
• Why do you use both If[# > 0, #, 0] and TruncatedDistribution Feb 21, 2016 at 9:17
• Further to coolwater's comment, what do you think the If[# > 0, #, 0] is doing in data = If[# > 0, #, 0] & /@ RandomVariate[aDist[4, 1/3], {20}]; Because it is doing absolutely nothing. adist is defined on the positive real line, so your If statement is superfluous - it is doing NOTHING. Feb 21, 2016 at 15:54

As per J.M.'s answer, FindDistributionParameters works really well here. In particular, to get a low precision answer I used:
FindDistributionParameters[data, aDist[σ, λ], WorkingPrecision -> 3]