Presentation is loading. Please wait.

Presentation is loading. Please wait.

Data Mining – Intro.

Similar presentations

Presentation on theme: "Data Mining – Intro."— Presentation transcript:

1 Data Mining – Intro

2 Course Overview Spatial Databases
Temporal and Spatio-Temporal Databases Multimedia Databases Data Mining

3 Data Mining Overview Data Mining
Data warehouses and OLAP (On Line Analytical Processing.) Association Rules Mining Clustering: Hierarchical and Partitional approaches Classification: Decision Trees and Bayesian classifiers Sequential Patterns Mining Advanced topics: outlier detection, web mining

4 What is Data Mining? Data Mining is:
(1) The efficient discovery of previously unknown, valid, potentially useful, understandable patterns in large datasets (2) The analysis of (often large) observational data sets to find unsuspected relationships and to summarize the data in novel ways that are both understandable and useful to the data owner

5 What is Data Mining? Very little functionality in database systems to support mining applications Beyond SQL Querying: SQL (OLAP) Query: - How many widgets did we sell in the 1st Qtr of 1999 in California vs New York? Data Mining Queries: - Which sales region had anomalous sales in the 1st Qtr of 1999 - How do the buyers of widgets in California and New York differ? - What else do the buyers of widgets in Cal buy along with widgets

6 Overview of terms Data: a set of facts (items) D, usually stored in a database Pattern: an expression E in a language L, that describes a subset of facts Attribute: a field in an item i in D. Interestingness: a function ID,L that maps an expression E in L into a measure space M

7 Overview of terms The Data Mining Task:
For a given dataset D, language of facts L, interestingness function ID,L and threshold c, find the expression E such that ID,L(E) > c efficiently.

8 Examples of Large Datasets
Government: IRS, … Large corporations WALMART: 20M transactions per day MOBIL: 100 TB geological databases AT&T 300 M calls per day Scientific NASA, EOS project: 50 GB per hour Environmental datasets

9 Examples of Data mining Applications
1. Fraud detection: credit cards, phone cards 2. Marketing: customer targeting 3. Data Warehousing: Walmart 4. Astronomy 5. Molecular biology

10 How Data Mining is used 1. Identify the problem
2. Use data mining techniques to transform the data into information 3. Act on the information 4. Measure the results

11 The Data Mining Process
1. Understand the domain 2. Create a dataset: Select the interesting attributes Data cleaning and preprocessing 3. Choose the data mining task and the specific algorithm 4. Interpret the results, and possibly return to 2

12 Data Mining Tasks 1. Classification: learning a function that maps an item into one of a set of predefined classes 2. Regression: learning a function that maps an item to a real value 3. Clustering: identify a set of groups of similar items

13 Data Mining Tasks 4. Dependencies and associations:
identify significant dependencies between data attributes 5. Summarization: find a compact description of the dataset or a subset of the dataset

14 Data Mining Methods 1. Decision Tree Classifiers:
Used for modeling, classification 2. Association Rules: Used to find associations between sets of attributes 3. Sequential patterns: Used to find temporal associations in time series 4. Hierarchical clustering: used to group customers, web users, etc

15 Are All the “Discovered” Patterns Interesting?
Interestingness measures: A pattern is interesting if it is easily understood by humans, valid on new or test data with some degree of certainty, potentially useful, novel, or validates some hypothesis that a user seeks to confirm Objective vs. subjective interestingness measures: Objective: based on statistics and structures of patterns, e.g., support, confidence, etc. Subjective: based on user’s belief in the data, e.g., unexpectedness, novelty, actionability, etc. A data mining system/query may generate thousands of patterns, not all of them are interesting. Suggested approach: Human-centered, query-based, focused mining

16 Can We Find All and Only Interesting Patterns?
Find all the interesting patterns: Completeness Can a data mining system find all the interesting patterns? Association vs. classification vs. clustering Search for only interesting patterns: Optimization Can a data mining system find only the interesting patterns? Approaches First general all the patterns and then filter out the uninteresting ones. Generate only the interesting patterns—mining query optimization

17 Data Mining: Classification Schemes
General functionality Descriptive data mining Predictive data mining Different views, different classifications Kinds of databases to be mined Kinds of knowledge to be discovered Kinds of techniques utilized Kinds of applications adapted

18 A Multi-Dimensional View of Data Mining Classification
Databases to be mined Relational, transactional, object-oriented, object-relational, active, spatial, time-series, text, multi-media, heterogeneous, legacy, WWW, etc. Knowledge to be mined Characterization, discrimination, association, classification, clustering, trend, deviation and outlier analysis, etc. Multiple/integrated functions and mining at multiple levels Techniques utilized Database-oriented, data warehouse (OLAP), machine learning, statistics, visualization, neural network, etc. Applications adapted Retail, telecommunication, banking, fraud analysis, DNA mining, stock market analysis, Web mining, Weblog analysis, etc.

19 Other issues Numerical or quantitative attributes (real values) vs categorical attributes: ordinal (education) vs nominal (male or female) Classification is used for categorical attributes, Regression for numerical Overfitting (statistics vs data mining)

20 Major Issues in Data Mining (1)
Mining methodology and user interaction Mining different kinds of knowledge in databases Interactive mining of knowledge at multiple levels of abstraction Incorporation of background knowledge Data mining query languages and ad-hoc data mining Expression and visualization of data mining results Handling noise and incomplete data Pattern evaluation: the interestingness problem

21 Major Issues in Data Mining (2)
Performance and scalability Efficiency and scalability of data mining algorithms Parallel, distributed and incremental mining methods Issues relating to the diversity of data types Handling relational and complex types of data Mining information from heterogeneous databases and global information systems (WWW)

Download ppt "Data Mining – Intro."

Similar presentations

Ads by Google