We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byJoselyn Linson
Modified over 2 years ago
Inaport Training Fuzzy Matching
© Copyright 2010 InaPlex Inc Matching Process of deciding which record or set of records in the target table(s) should be updated Alternatively, decide if record already exists and take appropriate action
© Copyright 2010 InaPlex Inc Matching Techniques Inaport supports different ways to match Standard build expressions on source and target Fuzzy Refine Standard to allow for poor data SQL Use SQL SELECT instead of expressions
© Copyright 2010 InaPlex Inc Fuzzy Matching Standard Matching can use any combination of fields can use expressions BUT Ultimately is restricted to exact match “InaPlex” <> “Innerplex Ltd”
© Copyright 2007 InaPlex Limited Fuzzy Matching Fuzzy matching compares source and target, and gives a similarity score Score measures how “close” two strings are Score = 1 : Perfect match Score = 0 : No match “InaPlex” and “inaplx” : 98% “InaPlex” and “innerplex” : 87% “InaPlex” and “ibm” : 49% See Tools – Fuzzy Match Demo
© Copyright 2010 InaPlex Inc How it Works As with Standard matching, Fuzzy match Can use any field or combination of fields Reads the match fields Builds an in memory index for each table The target match expression is applied to the field data read from the table
© Copyright 2010 InaPlex Inc How it Works Set scoring levels Score > Upper good match – accept immediately Lower < Score < Upper Possible match – user review Score < lower Not a match – reject No match < Lower < Possible < Upper < Good No match < 85% < Possible < 95% < Good
© Copyright 2010 InaPlex Inc How it Works When a source record comes in: Source expression applied to build match value Source match value scored against every value in target index “Best” matches used – you set boundaries No match < Possible match < Good match No 0.85 Possible 0.95 Good
© Copyright 2010 InaPlex Inc How it Works User Review Shows the source record and possible matches in target User can select one or more records as match Options Review “good” and “possible” matches –For testing purposes Review just “possible” matches –If there are no possibles, good and no match accepted automatically No review –Good and no match accepted automatically –Possible treated as bad
© Copyright 2010 InaPlex Inc How it Works Customise User Review May need to see more than the target table to decide on match Can also display associated tables E.g. Address, Contact Can also select which fields from associated tables to display
© Copyright 2007 InaPlex Limited Example – Operation Tab Select Fuzzy Match from Match Type
© Copyright 2010 InaPlex Inc Example – Match Tab Specify the base match criteria Source and target match expressions Boundary scores for no, possible, good matches Cluster Match covered later
© Copyright 2010 InaPlex Inc Example – Match Tab Set up the User Review Can choose No review – use in batch mode Only possible matches – accept good matches Good + possible – review all matches
© Copyright 2007 InaPlex Limited Example – User Review Shows possible matches at run time Source record Possible matching target records, with score If configured, child records of selected target record Allows selection of desired matches
© Copyright 2010 InaPlex Inc Clustering Fuzzy Matching is powerful, flexible BUT Every source record must be scored against EVERY target match, then highest scores selected 100,000 records in target => 100,000 scores per source record Solution is CLUSTERING
© Copyright 2010 InaPlex Inc Clustering Specify an expression to sort target records into clusters Then an equivalent expression for source to sort it into one cluster Finally scoring only done against members of the selected cluster 100,000 target divided into 20 clusters 5,000 records per cluster => 5,000 scores per source record
© Copyright 2010 InaPlex Inc Clustering Cluster expression should: Sort target into roughly equal groups Guard against allocating source to wrong cluster Examples First letter of company name Zip/Post code Phone area code
© Copyright 2010 InaPlex Inc Clustering Alpha Corp Zulu Corp Beta Corp Source record scored against every record in target No clustering established
© Copyright 2007 InaPlex Limited Clustering Set up clustering based on first letter of company name
© Copyright 2010 InaPlex Inc Clustering Alpha Corp Zulu Corp Beta Corp Source record only scored against records in “b” cluster Beta Corp Brown Corp Cluster on first letter
© Copyright 2010 InaPlex Inc Clustering Important Note Because source records will only be scored against one cluster, if clustering is poorly done can lead to missed matches “naplex” would look in “n” cluster, not “I” Cluster expression does NOT have to use same fields as match E.g. Match on name, cluster on ZIP code
© Copyright 2010 InaPlex Inc Summary Fuzzy matching provides powerful new tool for handling complex, dirty data Need to Use carefully, especially clustering Allow of overhead of user review
© Copyright 2010 InaPlex Inc THANK YOU www.inaplex.com www.inaplex.com/cs/forums
Inaport Training Standard Matching. © Copyright 2010 InaPlex Inc Matching Process of deciding which record or set of records in the target table(s) should.
Inaport Training Introduction to Matching. Matching The purpose of Inaport is to: Extract data from a source Transform that data Load into a target Loading.
1 Duplicate Analyzer Exercises. 2 Installation and Initial Configuration: Exercises Exercises 1.Install Duplicate Analyzer on your local PC. 2.Configure.
DAY 20: ACCESS CHAPTERS 5, 6, 7 Larry Reaves October 28,
Fuzzy Duplicates Analysis with ACL Prepared by: Kevin Legere Date: April 3 rd, 2013.
3 / 12 CHAPTER Databases MIS105 Week-10/ Lec02 Irfan Ahmed Ilyas.
Copyright I/O International, 2013 Visit us at: A Feature Within from Sales Rep User Friendly Maintenance – with Zip Code.
Translation Memory System (TMS)1 Translation Memory Systems Presentation by1 Melina Takanen & Julianna Ekert CAT Prof. Thorsten Trippel University.
Organisation Of Data (1) Database Theory
Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall 1 1. Chapter 2: Relational Databases and Multi-Table Queries Exploring Microsoft Office.
Database Queries. Queries Queries are questions used to retrieve information from a database. Contain criteria to specify the records and fields to be.
SESSION 3.1 This section covers using the query window in design view to create a query and sorting & filtering data while in a datasheet view. Microsoft.
FireRMS NEMSIS (Part 2) Presented by Laura Small FireRMS Quality Assurance.
CS&E 1111 AcQueries Writing Simple Queries in Access Displaying on specific data fields Filtering data using criteria Objectives: Learn how to use the.
1 Chapter 4 Selection Structures C++ for Engineers and Scientists Third Edition.
NSF DUE ; Wen M. Andrews J. Sargeant Reynolds Community College Richmond, Virginia.
1 Chapter 4: Selection Structures. In this chapter, you will learn about: – Selection criteria – The if-else statement – Nested if statements – The switch.
Utility Service Database Design a database to keep track of service calls for a utility company: Customers call to report problems Call center manages.
HKOI Programming HKOI Training Team (Intermediate) Alan, Tam Siu Lung Unu, Tse Chi Yung.
Ultimate Bundle Overview Products Benefits Technical Requirements Licensing Pricing Valid until 01-Sep-2010.
Examining data using Microsoft Access Queries Using Criteria and Calculations SESSION 3.2 This section covers specifying an exact match condition in a.
Microsoft Office 2013 ®® Access Tutorial 3 Maintaining and Querying a Database.
Company Confidential 1 © 2005 Nokia DBUpgradeTool_ ppt / / JMa A Database Upgrade Tool Nokia Networks Jukka Maaranen.
© Hanson Research Corporation Deduping contacts in Sage CRM 24 th Day of November 2010.
Education Process Management. REPRODUCTION OR QUOTATION, IN WHOLE OR IN PART, IS STRICTLY PROHIBITED. Copyright ® 2006 Computer Information Concepts, Inc.
1 Lab Session-III CSIT-120 Fall 2000 Revising Previous session Data input and output While loop Exercise Limits and Bounds Session III-B (starts on slide.
INSERT BOOK COVER 1Copyright © 2011 Pearson Education, Inc. Publishing as Prentice Hall. Exploring Microsoft Office Access 2010 by Robert Grauer, Keith.
Microsoft Access 2010 Chapter 7 Using SQL. Change the font or font size for SQL queries Create SQL queries Include fields in SQL queries Include simple.
Copyright © 2008 Pearson Prentice Hall. All rights reserved.1 1 Committed to Shaping the Next Generation of IT Experts. Chapter 2: Relational Databases.
1 of 30 G/L Journal Authorisation / DA00594-w1 Last updated: G/L Journal Authorisation.
CSCI 6962: Server-side Design and Programming Validation Tools in Java Server Faces.
Microsoft ® Access ® 2010 Training Create Queries for a New Database If a yellow security bar appears at the top of the screen in PowerPoint, click Enable.
Copyright © 2010 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Starting Out with Programming Logic & Design Second Edition by Tony Gaddis.
Lesson 17 Mail Merge. Overview Create a main document. Create a data source. Insert merge fields into a main document. Perform a mail merge. Use data.
WHAT IS A DATABASE? A DATABASE IS A COLLECTION OF DATA RELATED TO A PARTICULAR TOPIC OR PURPOSE OR TO PUT IT SIMPLY A GENERAL PURPOSE CONTAINER FOR STORING.
Queries Help Topics Using the Access 2007, you can press the F1 to pop up the help windows, where you can search the following topics to help to generate.
Classifications and CASCOT Ritva Ellison Institute for Employment Research University of Warwick.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 10 Database Performance Tuning and Query Optimization.
20 Copyright © 2008, Oracle. All rights reserved. Cache Management.
Concepts of Database Management Seventh Edition Chapter 2 The Relational Model 1: Introduction, QBE, and Relational Algebra.
Microsoft Office 2013: In Practice Chapter 2 Using Design View, Data Validation, and Relationships Copyright © 2014 by The McGraw-Hill Companies, Inc.
© 2008 FedEx. All rights reserved. FedEx Ship Manager ® at fedex.com Shipping Administration Presentation for administrators.
Lesson 2. To help ensure accurate data, rules that check entries against specified values can be applied to a field. A validation rule is applied to.
Access Chapter 3-Obtaining Answers to Your Data Questions.
Database Systems Microsoft Access Practical #3 Queries Nos 215.
Single Linked Lists Objectives In this lesson, you will learn to: *Define single linked list *Identify the following types of linked lists: Single linked.
Lab 6: Geocoding You have received a dBase file that contains the address list of over 500 homes in your neighborhood that have had reports of lead poisoning.
McGraw-Hill Technology Education © 2004 by the McGraw-Hill Companies, Inc. All rights reserved. Office Access 2003 Lab 3 Analyzing Data and Creating Reports.
Copyright 2007, Paradigm Publishing Inc. ACCESS 2007 Chapter 4 BACKNEXTEND 4-1 LINKS TO OBJECTIVES Query Design Query Criteria Modify a Query Using OR.
The Project AH Computing. Functional Requirements What the product must do! Examples attractive welcome screen all options available as clickable.
© 2017 SlidePlayer.com Inc. All rights reserved.