Data Mining

Abstract

Data mining is the science of finding unexpected, valuable, or interesting structures in large data sets. It is an interdisciplinary activity, taking ideas and methods from statistics, machine learning, database technology, and other areas. It poses novel challenges, in part arising from the sheer size of modern data sets. Although there is no doubt that it addresses important questions, there are deep issues to be resolved relating to data quality and the nature of inference. Statisticians have an important role to play in resolving these issues.

Keywords

data mining large data sets machine learning patterns models data quality

Get full access to this article

View all access options for this article.

References

Agrawal, R. , Stolorz, P. , & Piatetsky-Shapiro, G. (Eds.). (1998). Proceedings of the fourth international conference on knowledge discovery and data mining. Menlo Park, CA: AAAI Press.

Chambers, J. M. (1993). Greater or lesser statistics: A choice for future research. Statistics and Computing, 3, 182-184.

Fayyad, U. M. , Piatetsky-Shapiro, G. , Smyth, P. , & Uthurusamy, R. (Eds.). (1996). Advances in knowledge discovery and data mining. Menlo Park, CA: AAAI Press.

Gifi, A. (1990). Nonlinear multivariate analysis. Chichester, UK: Wiley.

Glymour, C. , Madigan, D. , Pregibon, D. , & Smyth, P. (1997). Statistical themes and lessons for data mining. Data Mining and Knowledge Discovery, 1, 11-28.

Hand, D. J. (1998). Data mining: Statistics and more? American Statistician, 52, 112-118.

Hand, D. J. (1999). Statistics and data mining: Intersecting disciplines. SIGKDD Explorations, 1, 16-19.

Hand, D. J. , Blunt, G. , Kelly, M. G. , & Adams, N. M. (2000). Data mining for fun and profit. Statistical Science, 15, 111-126

Hand, D. J. , McConway, K. J. , & Stanghellini, E. (1997). Graphical models of applicants for credit. IMA Journal of Mathematics Applied in Business and Industry, 8, 143-155.

10.

Hand, D. J. , Mannila, H. , & Smyth, P. (in press). Principles of data mining. Cambridge, MA: MIT Press.

11.

Heckerman, D. , Mannila, H. , Pregibon, D. , & Uthurusamy, R. (Eds.). (1997). Proceedings of the third international conference on knowledge discovery and data mining. Menlo Park, CA: AAAI Press.