Statistical modelling using product partition models

Abstract

Product partition models (PPMs) allow us to partition a set of objects into k sets. PPMs are a special case of Bayesian Partition models. They use partially exchangeable priors where given a partition ρ of the objects into k sets, the objects in the same set are exchangeable and the objects belonging to distinct sets are independent. PPMs specify prior probabilities for a random partition and update these into posterior distributions of the same form. They provide a convenient way of allowing the data to weight the partitions likely to hold. Posterior estimates of the parameter of interest are obtained by conditioning on the partition and averaging over all generated partitions. Markov chain Monte Carlo (MCMC) techniques are used to generate partitions of the data. PPMs can be applied to many diverse estimation problems and in this paper we outline two areas where they are useful.

Keywords

meta-analysis prediction product partition models

Get full access to this article

View all access options for this article.

References

Barry D and Hartigan JA (1992) Product partition models for change point problems . The Annals of Statistics, 20, 260–79 .

Breiman L , Friedman JH , Olshen R and Stone CJ (1984) Classification and regression trees. Belmont, CA : Wadsworth .

Cochrane Reviewers' Handbook 4.2.5 (2005). Available at http://www.cochrane.org/resources/handbook/

Collaborative Group on Hormonal Factors in Breast Cancer (1996a) Breast cancer and hormonal contraceptives: collaborative reanalysis of individual data on 53 297 women with breast cancer and 100 239 women without breast cancer from 54 epidemiological studies . Lancet, 347, 1713–27 .

Collaborative Group on Hormonal Factors in Breast Cancer (1996b) Breast cancer and hormonal contraceptives: further results . Contraception, 54(suppl), S1–106 .

Consonni G and Veronese P (1995) A Bayesian method for combining results from several binomial experiments . Journal of the American Statistical Association, 90(431), 935–44 .

Crowley EM (1992) Estimation of clustered parameters. PhD Dissertation. Yale University .

Dahl DB (2003) Modal clustering in a univariate class of product partition models. Technical Report 1085, Department of Statistics, University of Wisconsin .

DuMouchel WH and Harris JE (1983) Bayes methods for combining the results of cancer studies in humans and other species (with comment) . Journal of the American Statistical Association, 78, 293–308 .

10.

Evans R and Sedransk J (2001) Combining data from experiments that may be similar . Biometrika, 88(3), 643–56 .

11.

Fahrmeir L and Tutz G (1994) Multivariate statistical modelling based on generalized linear models. New York : Springer-Verlag .

12.

Hartigan JA (1990) Partition models . Communications in Statistics, Part A - Theory and methods, 19, 2745–56 .

13.

Higgins JPT and Whitehead A (1996) Borrowing strength from external trials in a meta-analysis . Statistics in Medicine, 15, 2733–49 .

14.

Jordan CA and Livingstone V (2005) Product partition models and their possible applications . Proceedings of International Workshop on Statistical Modelling Conference, 10–15 July, Sydney, Australia.

15.

Lee PM (1997) Bayesian statisics an introduction. London : Arnold .

16.

Malec D and Sedransk J (1992) Bayesian methodology for combining the results from different experiments when the specifications for pooling are uncertain . Biometrika, 79(3), 593–601 .

17.

Mallick BK and Walker SG (1997) Combining information from several experiments with nonparametric priors . Biometrika, 84(3), 697–706 .

18.

McCullagh P and Yang J (2006) Stochastic classification models . Proceedings of the International Congress of Mathematicians, Madrid, Spain.

19.

National Research Council Committe on Applied and Theoretical Statistics (1992) Combining information, statistical issues and opportunity for research. Washington : National Academy Press .

20.

Quintana FA and Iglesias PL (2003) Bayesian clustering and product partition models . Journal of the Royal Statistical Society, Series B, 65(2), 557–74 .

21.

Smith TC , Speigelhalter DJ and Thomas A (1995) Bayesian approaches to random effects meta-analysis: a comparative study . Statistics in Medicine, 14, 2685–99 .

22.

Sutton AJ , Abrams KR , Jones DR , Sheldon TA and Song F (2000) Methods for meta-analysis in medical research. Wiley: Chicester .

23.

Wermuth N (1976) Exploratory analyses of multidimensional contingency tables . Proceedings of the 9th International Biometrics Conference, 1, 279–95 .