Presentation is loading. Please wait.

Presentation is loading. Please wait.

Data warehouse example

Similar presentations


Presentation on theme: "Data warehouse example"— Presentation transcript:

1 Data warehouse example
User Warehouse Data Warehouse DBMS A DBMS B DBMS C Database Database Database Data warehouse example

2 Data mining versus data warehousing
User Data Mining Tools Warehouse Data Warehouse Manager DBMS C DBMS A DBMS B Database Database Database Data mining versus data warehousing

3 Database systems, data warehousing, and mining
Miner Warehouse Data for Mining Database Data for Mining Data Warehouse Data for Warehousing Database Management Systems Database systems, data warehousing, and mining

4 Integrated Data Warehouse and Data Miner
User Warehouse Warehouse Miner: Integrated Data Warehouse and Data Miner DBMS B DBMS C DBMS A Database Database Database Integrated data warehousing and data mining

5 Data mining versus data warehousing
User Data Mining Tools Warehouse Data Warehouse Manager DBMS A DBMS B DBMS C Database Database Database Data mining versus data warehousing

6 Database systems, data warehousing, and mining
Miner Warehouse Data For Mining Database Data For Mining Data Warehouse Data for Warehousing Database Management Systems Database systems, data warehousing, and mining

7 Integrated Data Warehouse And Data Miner Warehouse
User Warehouse Miner, Integrated Data Warehouse And Data Miner Warehouse DBMS A DBMS B DBMS C Database Database Database Integrated data warehousing and data mining

8 Statistical packages operating on databases
Reasoning Warehouse Data For Mining Data Warehouse Database Data For Mining Data for Warehousing Database Management Systems Statistical packages operating on databases

9 Loose integration between a DBMS and a data miner
Data Mining Tool Database Database Management System Loose integration between a DBMS and a data miner

10 Tight integration between a DBMS and a data miner
Database Management System+ Data Mining Tool Database Tight integration between a DBMS and a data miner

11 Mining object databases
Relational Database Relation Extractor Object Database Data Miner Patterns Mining object databases

12 Mining an audit database
Tools Audit Database Mining an audit database

13 Database and visualization
Tool Data To Visualize Request Data Database Management Systems Database and visualization

14 Functions of a mining DBMS
Query Processor Transaction Processor Metadata Manager Storage Manager Mining DBMS Integrity Manager Security Manager Data Miner Functions of a mining DBMS

15 Data mining as part of query processing
Query Data Processor Miner Metadata Manager Storage Manager Mining DBMS Integrity Manager Security Manager Data mining as part of query processing

16 Decision support technologies
Warehousing Data Management Machine Learning Mining Human Computer Interaction Knowledge Management Statistics Decision support technologies

17 Decision support and multimedia data mining
Results from Mining Decision Support System Data Miner Warehouse Data For Mining Database Data For Mining Data Warehouse Data for Warehousing Database Management System Decision support and multimedia data mining

18 Machine learning and data mining
Warehouse Data For Mining Data Warehouse Database Data For Mining Data for Warehousing Database Management Systems Machine learning and data mining

19 Pyramid for multimedia mining
Decision Support Multimedia Data Miner Multimedia Data Warehouse Multimedia Database System Multimedia Communication, Network, Operating System Pyramid for multimedia mining

20 Revisiting the data mining architecture
Database System B Database System A Middleware Data Warehouse Multimedia Data Miner Revisiting the data mining architecture

21 Distributed, Heterogenous, and Legacy Databases
Relational and Object Databases Multimedia Databases Distributed, Heterogenous, and Legacy Databases Techniques Warehouse Machine Learning Statistical Reasoning Security Metadata Visualization Parallel Processing Integration: Middleware, Web Support Three-dimensional view

22 Client-server-based data mining
Database System Client 1 Client 2 Network Server Warehouse Server Data Miner Client-server-based data mining

23 Data mining through an ORB
Server Database System Client Object Object Object Request Broker Server Data Miner Object Server Data Warehouse Object Data mining through an ORB

24 Book Object References Introduction Set of Sections Data model for text

25 Functional Architecture for a text processing system
Query Processor Browser/ Editor Metadata Manager Update Processor Security/ Integrity Manager Functional Architecture for a text processing system

26 Converting unstructured data to structured data for mining
Data Mining Tool Structured Data Unstructured Data Converting unstructured data to structured data for mining

27 Operation of data mining techniques
Determine Data Sets Develop Training Examples Build Models Classify New Data based on the Models and Examples Identify Patterns Operation of data mining techniques

28 Augmenting an information retrieval system
Data Mining Tool Information Retrieval System Data Source Augmenting an information retrieval system

29 Mining directly on unstructured data
Data Mining Tool Unstructured Data Mining directly on unstructured data

30 TrueText Mining System
Extracting Structured Data from Text Text Retrieval with Simple Mining Intelligent Text Retrieval Text Understanding System Text Retrieval System Taxonomy for text mining

31 Image Object Right Part of Image Left Part of Image Center Part of Image Data model for an image

32 Functional architecture for an image processing system
Query Processor Browser/ Editor Metadata Manager Security/ Integrity Manager Update Processor Functional architecture for an image processing system

33 Unusual Pattern IMAGE MINING

34 True Image Mining System
Extracting Structured Data from Images Image Retrieval with Simple Mining Intelligent Image Retrieval Image Understanding System Image Retrieval System Taxonomy for image mining

35 Video Object Future Attractions Advertisements Main Film Data model for video

36 Functional architecture for a video processing system
Query Processor Browser/ Editor Metadata Manager Security/ Integrity Manager Update Processor Functional architecture for a video processing system

37 Mining text extracted from video
Video Frames Summary Reports Patterns and Results Text Miner Mining text extracted from video

38 Video Scripts/Patterns
As Metadata Video Database Video Mining Video Information Retrieval Patterns and Trends Direct video mining

39 True Text Mining System
Extracting Structured Data from Text Text Retrieval with Simple Mining Intelligent Text Retrieval Schema Text Understanding System Text Retrieval System Taxonomy for video mining

40 Audio Object Questions Speech Applause Data model for audio

41 Functional architecture for an audio processing system
Query Processor Browser/ Editor Metadata Manager Security/ Integrity Manager Update Processor Functional architecture for an audio processing system

42 Mining text extracted from audio
Audio Frames Speech Transcription: Text Data Patterns And Results Text Miner Mining text extracted from audio

43 Audio Scripts/Patterns
as Metadata Audio/Speech Processing System Audio Mining Audio Database Patterns and Trends Direct audio mining

44 True Audio Mining System
Extracting Structured Data from Audio Audio Retrieval with Simple Mining Intelligent Audio Retrieval Audio Understanding System Audio Retrieval System Taxonomy for audio mining

45 Integration and then mining
Multimedia Data Miner Integrated View of Multimedia Database DMP DMP DMP Text DBMS Video DBMS Audio DBMS Text Database Video Database Audio Database Integration and then mining

46 Integrating the results of various data miners
DMP DMP DMP Video Miner Audio Miner Text Miner Video DBMS Audio DBMS Text DBMS Text Database Video Database Audio Database Integrating the results of various data miners

47 Data mining through the Web
Mining Tool C Mining Tool D Internet Access Module for C Internet Access Module for D INTERNET Internet Access Module for A Internet Access Module for B DBMS Vendor B DBMS Vendor A Database A Database B Data mining through the Web

48 Different definitions of data mining
Pattern Discovery Knowledge Discovery Knowledge Mining Data Mining Data Dredging Data Archeology The process of discovering meaningful new correlations, Patterns, and trends by sifting through large amounts of stored data, using pattern recognition technologies and Statistical and mathematical techniques. Different definitions of data mining

49 Data Mining Techniques Approaches to Data Mining Outcomes Of Data Mining How Data Mining is carried out Aspects of data mining

50 Mining Distributed, Heterogeneous, and Legacy Databases Web Mining Multimedia Mining Data Mining Trends Metadata Mining Security and Privacy Data mining trends

51 Data quality and data mining
Database Patterns and Trends Data Miner To Detect Patterns Data Miner To Improve Quality Database Data quality and data mining

52 Interactive data mining
Visualization Tool Data Mining Tool DBMS Interactive data mining

53 Data Mining Algorithms Parallelized Data Mining Algorithms Parallel Processing Techniques Parallel data mining

54 Training Examples Analyzing Data Producing Results Data mining functions

55 Three-tier architecture for data miner
Thin Client Middle Tier: Data Mining Components Server DBMS Three-tier architecture for data miner

56 Encapsulating data mining modules as objects
Data Miner Data Source Integrator Object Object Object Request Broker Results Pruner Object Report Generator Object Encapsulating data mining modules as objects

57 Some data mining application areas
Inland Revenue Service: Analyze Tax Returns Retail/ Wholesale: Marketing And Sales Medical: Diagnosis Data Mining Education: Student Promotion Financial: Economic Analysis Intelligence: Foreign Affairs Analysis Some data mining application areas

58 Data, data and more data Relational Databases Files Multimedia Databases Paper Humans World Wide Web What we do with the data? Mine, mine, and mine Until we get useful information. Why data mining?

59 Mine The Data Clean/ Modify Data Sources Integrate Data Sources Examine Results/ Prune Results Report Final Results Data Sources Steps of mining data

60 Real-World Knowledge Knowledge Base Knowledge-Based System and/or Human Analyst for Pruning Results Results from Data Miner Pruned Results Pruning the results

61 Some data mining challenges
Inadequate Tools Bad Quality Data Data Mining Challenges Incomplete and Incorrect Data Inadequate Training Some data mining challenges

62 Example user interface for mining
Application Generator SQL Query Generator Report Generator Select Approaches Select Outcomes Select Techniques Example user interface for mining

63 Data mining tasks, techniques, and methodologies
Data Mining Methodologies(Approaches): Top-Down Bottom-Up(Supervised or Unsupervised) Hybrid Data Mining Techniques(Algorithms): Neural Networks Inductive Logic Programming Decision Trees, Nearest Neighbour Data Mining Tasks (Outcomes): Classification, Clustering, Association, Deviation Detection Data mining tasks, techniques, and methodologies

64 Determine Initial Set of Expected Outcomes Carry Out Data Mining Techniques Extract Patterns Determine New Outcomes from the Patterns Observed Data mining outcomes

65 Some data mining approaches
Top-Down: Start with hypothesis and validate hypothesis,Hypothesis may be formed, initially from bottom-up approach or from some real-world knowledge, If hypothesis is not satisfied, then revise hypothesis Data Mining Approaches/ Methodologies Bottom-up: Analyze the data and extract patterns,Directed/ Supervised: You have some idea what you are looking for, Undirected/Unsupervised, You have no idea what you are looking for Some data mining approaches

66 Data mining technologies
Decision Support Database Management and Warehousing Statistics Data Mining Machine Learning Parallel Processing Visualization Data mining technologies


Download ppt "Data warehouse example"

Similar presentations


Ads by Google