.

# Point Estimation

Let $X_{1}..X_{n}$ be a random sample from a distribution with cdf $F\left(\left.\cdot\right|\theta\right)$ where $\theta\in\Theta$ is unknown.

A point estimator is any function $\omega\left(X_{1}..X_{n}\right)$.

Notice that a point estimator is a statistic. This does mean that it too is a random variable: For different random samples, we will obtain different point estimators.

We refer to the realized value of an estimator (i.e., the value of the statistic applied to the realized values of a random sample) as an estimate.

Clearly, a good estimator will be close to $\theta$ in some probabilistic sense. Finally, an estimator cannot use the true value of $\theta$ itself.

We consider two methods for point estimation: The method of moments and maximum likelihood.