Presentation on theme: "Enterprise systems infrastructure and architecture DT211 4"— Presentation transcript:
1 Enterprise systems infrastructure and architecture DT211 4 Data MiningEnterprise systems infrastructure and architecture DT211 4
2 Note for next year Data mining in Laudon and laudon and Kopec paper gives a few more good ideas
3 Data MiningThe process of extracting valid, previously unknown, comprehensible, and actionable information from large databases and using it to make crucial business decisions.Involves the analysis of data and the use of software techniques for finding hidden and unexpected patterns and relationships in sets of data.
4 Data Mining Data mining tools uses ,e.g. AI techniques, to help: predict future trends: ,Segment datasets“Product” associationallowing businesses to make proactive, knowledge-driven decisions.
5 Data mining: A.I. techniques. The most commonly used techniques A.I. techniques in data mining are:Decision trees: Tree-shaped structures that represent sets of decisions. These decisions generate rules for the classification of a dataset.Nearest neighbour method: A technique that classifies each record in a dataset based on a combination of the classes of the k record(s) most similar to it in a historical dataset. Sometimes called the k-nearest neighbour technique; a clustering techniqueRule induction: The extraction of useful if-then rules from data based on statistical significance.Artificial neural networks: Predictive models that learn through training and resemble biological neural networks in structure.
6 How Data Mining WorksFor example, say that you are the director of marketing for a insurance company and you'd like to acquire some new customersYou could just randomly go out and mail coupons to the general population. However you would not achieve the required result.Alternatively As the marketing director you have access to a lot of information about all of your customers: their age, sex, income range and credit card insurance.
7 How Data Mining WorksCustomersProspectsGeneral information (e.g. demographic data)KnownProprietary information (e.g. customer transactions)TargetThe goal in prospecting is to make some decisions about the information in the lower right hand quadrant based on the model that we build going from Customer General Information to Customer Proprietary Information.
8 An Algorithm for Building Decision Trees Consider the following using decision trees. The following is decision tree algorithm:1. Let T be the set of training instances. 2. Choose an attribute that best differentiates the instances in T. 3. Create a tree node whose value is the chosen attribute. -Create child links from this node where each link represents a unique value for the chosen attribute. -Use the child link values to further subdivide the instances into subclasses. 4. For each subclass created in step 3: If the instances in the subclass satisfy predefined criteria or if the set of remaining attribute choices for this path is null, specify the classification for new instances following this decision path. -If the subclass does not satisfy the criteria and there is at least one attribute to further subdivide the path of the tree, let T be the current set of subclass instances and return to step 2.
11 Customers who earn between 50 K to 60 K have a life insurance policy. How Data Mining WorksFor instance, a simple model for aInsurance company might be:Customers who earn between 50 K to 60 K have a life insurance policy.This model could then be applied to the general population to target those for the life insurance promotion.The tree can be more complex e.g. See figure opposite
12 Data Mining Operations Data mining operations include:Predictive modelling: decision trees, regression analysis…Database segmentation: clustering techniquesLink analysis: decision trees, association rules
13 Predictive ModelingApplications of predictive modelling include direct marketing and use techniques like decision trees.uses observations to form a model of the important characteristics of some phenomenon: e.g. those traits associated with those who will buy propertySimple decision tree example
14 Database Segmentation Aim is to partition a database into an unknown number of segments, or clusters, of similar records.Uses clustering techniques in order to group dataApplications of database segmentation include credit card fraud….
16 Link AnalysisAims to establish links between records, or sets of records, in a database; one such example would be association discovery….Applications include product affinity analysis.Finds items that imply the presence of other items in the same event.
17 Link Analysis - Associations Discovery Affinities between items are represented by association discovery.e.g. ‘When a customer rents property for more than 2 years and is more than 25 years old, in 40% of cases, the customer will buy a property. This association happens in 35% of all customers who rent properties’.
18 Examples of Applications of Data Mining Retail / MarketingPredicting response to mailing campaignsMarket basket analysisBanking:Detecting patterns of fraudulent credit card use.InsuranceClaims analysisMedicineIdentifying successful medical therapies for different illnesses
19 Data mining in conclusion Two critical factors for success with data mining are:a large, well-integrated data warehouse anda well-defined understanding of the business process within which data mining is to be applied (e.g. customer prospecting, retention, campaign management etc.).
20 Sample types questions Discuss, using suitable examples how data mining can contribute to companies making a proactive knowledge driven decisions which could help with formulation of a companies strategy.