Statistical Data Mining

Abstract

Statistical data mining is the exploration and analysis of large data set by automatic or semiautomatic means with the purpose of discovering meaningful patterns. The patterns or rules are then used for decision making via a process known as knowledge discovery. Much of exploratory data analysis and influential statistics concerns the same problems. The chief distinction between statistical data mining and the exploratory data analysis resides in the size and dimensionality of the data set involved. Data mining in general deals with much more massive data sets for which highly interactive analysis is not fully feasible. In this talk, I will discuss the scales of data set sizes and the limits of feasibility and attempt to address some research problems in this area.