Next: Some Examples Up: Likelihood Ratio Tests Previous: Background   Contents

## The Likelihood Ratio Test Procedure

The notion of using the magnitude of the ratio of two probability density functions as the basis of a best test or of a uniformly most powerful test can be modified, and made intuitively appealing, to provide a method of constructing a test where either or both of the hypothesis and alternative are composite. The method leads to tests called likelihood ratio tests, and although not necessarily uniformly most powerful, they often have desirable properties. The test involves a comparison of the maximum value the likelihood can take when is allowed to take any value in the parameter space, and the maximum value of the likelihood when is restricted by the hypothesis. Define
 (9.5)

Note that
(i)
may be a vector of parameters;
(ii)
Both numerator and denominator (and hence ) are functions of the sample values , and the right hand side could be written more fully as

Strictly speaking, as defined in (3.5) is a function of random variables and so is itself a random variable with a probability distribution. When is replaced by the observed values in the ratio, we will use for the observed value of , and both will be called the likelihood ratio.

Clearly, by the definition of maximum likelihood estimates, will be obtained by substituting the mle('s) for into . Note that

(i)
since it is a ratio of pdf's;
(ii)
since the set over which L() is maximized is a subset of . This means that .
So the random variable has a probability distribution on [0,1]. If, for a given sample , is close to , then is almost as large as . This means that we can't find an appreciably larger value of the likelihood, L(), by searching for a value of through the entire parameter space supports the proposition that is true. On the other hand, if is small, we note that the observed was unlikely to occur if were true, so the occurrence of it casts doubt on . So a value of near zero implies the unreasonableness of the hypothesis.

Let the random variable have probability density function g(), . To carry out the LR test in a given problem involves finding a value () so that the critical region for a size test is . That is,

 (9.6)

Since the distribution of is generally very complicated, we would appear to have a difficult problem here. But in many cases, a certain function of has a well-known distribution and an equivalent test can be carried out. [See Examples 9.3.3- 9.3.3below.] Cases where this is not so are dealt with in sub-section 9.3.4.

Next: Some Examples Up: Likelihood Ratio Tests Previous: Background   Contents
Bob Murison 2000-10-31