Normal univariate
Suppose where are iid observations from the Normal (also known as Gaussian) distribution with density:
- .
In the parameterization above the parameters and represent the mean and variance population, respectively. This distribution may come alternatively parameterized in terms of and the standard deviation, , or in terms of and the precision , defined as .
Contents
Case 1: Mean and variance unknown
Overall Recommended (OR) prior |
---|
In other parameterizations |
Recommended prior if is of main interest |
Formal endorsements
^{[1]} showed that the Overall Recommended (OR) prior is the reference prior for any ordering of the parameters . This observation led to ^{[2]} to suggest this prior for general use or as these authors describe in "situations where one is simultaneously interested in all the parameters of the model or perhaps in several functions of them."
The OR prior was first proposed by Harold Jeffreys as the prime example of what we now call Jeffreys independence prior and was later recommended by ^{[3]} based on invariance considerations.
A different recommendation arises when the parameter of interest is the standardized normal mean, that is, . In this situation ^{[1]} showed that the prior in the table is the reference prior.
Posterior propriety
The posterior distribution of the OR prior is
where is the inverse gamma distribution. It can be easily seen that this posterior distribution is proper if .
Other properties
Other important properties of the OR prior have to be with invariance arguments and the fact that the normal distribution is location-scale invariant and hence the OR prior equals the right-Haar prior ^{[4]}.
Alternatives
- The Jeffreys prior , but this prior was considered much less appealing starting from the original author ^{[5]}.
- A proper prior that has the OR prior as the limiting case is with ().
Case 2: Mean unknown; variance known
Case 2: Recommended prior |
---|
Formal endorsements
The recommended prior is the constant prior over the real line. ^{[1]} showed that the recommended prior is the reference prior and is also the Jeffreys prior.
Posterior propriety
The posterior distribution associated with the recommended prior is
,
which is always proper.
Other properties
The distribution is location invariant and hence the recommended prior coincides with the right-Haar prior ^{[4]}.
Alternatives
- A proper prior that has the recommended prior as the limiting case is with .
Case 3: Variance unknown; mean known
Case 3: Recommended prior |
---|
In other parameterizations |
Formal endorsements
^{[1]} showed that the recommended prior is the reference prior and is also the Jeffreys prior.
Posterior propriety
The posterior distribution of the recommended prior is
which is always proper.
Other properties
The distribution is scale invariant and hence the recommended prior coincides with the right-Haar prior ^{[4]}.
Alternatives
- A proper prior that has the recommended prior as the limiting case is with .
References
- ↑ ^{1.0} ^{1.1} ^{1.2} ^{1.3} Bernardo, J. and Smith, A. (1994), Bayesian Theory, John Wiley and Sons, London.
- ↑ Berger, J., Bernardo, J., and Sun, D. (2015), Overall objective priors, Bayesian Analysis, 10, 189-221.
- ↑ Barnard, G. A. (1949), Statistical inference, Journal of the Royal Statistical Society, Series B, Methodological 11, 115–149.
- ↑ ^{4.0} ^{4.1} ^{4.2} Berger, J.O. (1985), Statistical Decision Theory and Bayesian Analysis (2nd Ed.), Springer.
- ↑ Jeffreys, H. (1961), Theory of Probability (3rd Ed.), Clarendon Press.