November 10 th, 2011 C LEANSING D ATA IN SSIS D AVID F AIBISH, S ENIOR P ROGRAM M ANAGER SQL S ERVER D ATA Q UALITY S ERVICES Microsoft SQL Server 2012.

Slides:



Advertisements
Similar presentations
Data Quality Services + Whats new in SSIS in SQL Server 2012 James Beresford
Advertisements

WSV405. IPv6 Ready Logo Program
1er Simposio Latinoamericano Data Quality Fundamentals Miguel Angel Granados Troncoso.
SIM201. Announcing… copyright chappellseminars.com some hosts comply; RST = closed no = response open some hosts comply; RST = closed no = response.
WSV304 Manual Deployment High cost Fully Automated Low cost.
OSP303. demo Status Bar Notification.
Richard Hundhausen People Process Tools Process Tools People.
November 10 th, 2011 DQS MATCHING G ADI P ELEG, S ENIOR P ROGRAM M ANAGER SQL S ERVER D ATA Q UALITY S ERVICES Microsoft SQL Server 2012.
Self Assessment COS202 a-Expense.
SIM Separate solution install paths can be taken, stand alone and SCOM integrated. Both require core AVIcode web apps and DB’s.
DBI331. Cube Measure Group Measure Partition Cube Dimension Dimension Attribute Relationship Hierarchy Level Cube Attribute Cube Hierarchy Measure.
DBI207 3 Data QualityIssueSample Data Problem Standard Are data elements consistently defined and understood ? Gender code = M, F, U in one system and.
OSP206. Experience Office as it was meant to be… without the complexity of setting up servers.
OSP203. Customer’s Need …is a continuous process of managing the life of an application through governance, development and maintenance.
DBI405. Agenda Reporting Services Scale Out Architecture Report Catalog Best Practices Scale Out Deployment Best Practices Performance Optimization.
SIM346. General information about the software application.
DEV207. SSDT Database Services Database Services Analysis Services Reporting Services Integration Services.
DEV314. Entity Data Model demo Entity Data Model.
OSP202. Business Need Business Creates Application DeploySupport The SharePoint Application Lifecycle Business Self-Service.
DEV202 Before I get started... …is too expensive. …is too complex. …requires a server.
WCL309. Demo.
SIM329. Certificate Enrollment Without CEP/CES Certificate Authority Active Directory Client Workstations LDAP RPC/DCOM.
November 10 th, 2011 DQS BOOTCAMP D AVID F AIBISH, S ENIOR P ROGRAM M ANAGER SQL S ERVER D ATA Q UALITY S ERVICES Microsoft SQL Server 2012.
EXL319. *Baseline for 80,000 user pool with 8 FEs and 1 BE Lync Server 2010 Capacity Calculator released.
WPH203 Content Choice Discoverability demo.
SIM314 Introduction Transport Layer Summary Network Layer.
SIM335 Demo 6 7 NetApp Confidential - Internal Use Only.
demo.
Introduction Bad Admin Summary 33 Non-Technical Issues Admin Even Worse! 44.
SQL S ERVER D ATA Q UALITY S ERVICES Marc Jellinek Principal Consultant – Neudesic
EXL318. “The voice diagnostics feature is very popular. In general, having that kind of feedback shows that quality is better overall. I think feedback.
INTRODUCTION TO DATA QUALITY SERVICES Presentation by Tim Mitchell (Artis Consulting)
Margin Content Padding Border.
DBI329. video.
DBI326. PhraseGoal “Data Mining”Inform actionable decisions “Machine Learning”Determine best performing algorithm.
WCL308. (While you’re sitting there, sign up for the GPanswers.com Tip of the Week … (Scan a tag.. Fill out the little form…) and enter to win a copy.
DPR302.
2.
WCL304.

DPR306. Process and tools Individuals and interactions over Following a plan Responding to change over Source: Comprehensive.
DPR305. Controller Model View Client Business Objects Server Business Objects Data.
OSP402 Required Slide Track PMs will supply the content for this slide, which will be inserted during the final scrub.
Advanced ETL: Embedding Integration Services Ashvini Sharma Development Lead DAT411 Microsoft Corporation Sergei Ivanov Technical Lead DAT411 Microsoft.
DEV211. The simplest way to create business applications for the desktop and the cloud.
DBI325. Monitoring Analytics Support will extend to Analysis Services in the Denali release.
SIM401. A. Datum Account Forest Trey Research Resource Forest Federation Trust Microsoft (Users) E-Company Store (Resource) Contoso(Users)Contoso(Users)Fabrikam(Resource)Fabrikam(Resource)
DPR301 demo Executable Requirements.
Data transport Cloud Backend Data transport Cloud Backend Cloud Provider Backend Virtualization Sidechannels You Clients Logons Who’s responsibility.
WPH303 announcement demo.
VIR326. Dell Compellent always puts the right data in the right place at the right time at the right cost. That’s Fluid Data.
DEV351.
DEV332. Required Slide Speakers, please list the Breakout Sessions, Interactive Discussions, Labs, Demo Stations and Certification Exam that.
SIM Native Monitoring packsOps Mgr SP1Ops Mgr R2Ops Mgr 2012 Ops Mgr 2012 Feature PacksN/AOps Mgr 2012 Product.
Introducing Data Quality Services and its role in an Enterprise Information Management (EIM) Process James Beresford Group Manager, Avanade DBI217.
DEV321. demo Rule: Any slide about UX must be charcoal gray or black.
#TEDEV342 A A B B I currently deploy via FTP directly to my host. My deployment is manual because I need to set permissions on the target server.
DEV203. Coded workflows Declarative workflows Web part hook-up Professional developerBusiness Analyst/Process Designer List definitions Event receivers.
Learn more: Download SCM: Join the TechNet Wiki community:
OSP-302. DescriptionUri All lists on a site.../_vti_bin/ListData.svc All Items in a named list.../_vti_bin/ListData.svc/MyList 2nd Item in the list.../_vti_bin/ListData.svc/MyList(2)
DEV348. demo Valid HTML5 Syntax demo.
WSV303. I live here... DC DNS DHCP WDS Clients DC DNS WDS/DHCP DC/DNS.
DEV354. Describe your data Create screens for common tasks Author business logic Customize screen layouts Define custom queries Create custom Silverlight.
WCL301. demo Basic Custom XML-file.

Demo YOURNAMESPACE /v2/mgmt/service /v2/mgmt/web /v2/wsfederation /v2/wstrust / v2/FederationMetadata/ /FederationMetadata.xml /v2/metadata/IdentityProviders.js.
DEV355 Jack Swigert demo my wife demo.
DBI407. Oracle 10g CDF SSAS Cube Builder NAS SSAS Query Servers HW NLB Partition 1 Partition 2 Partition N Partition 1 Partition.
DEV353. Required Slide Speakers, please list the Breakout Sessions, Interactive Discussions, Labs, Demo Stations and Certification.
COS307. demo Required Slide Track PMs will supply the content for this slide, which will be inserted during the final scrub. Website:
Presentation transcript:

November 10 th, 2011 C LEANSING D ATA IN SSIS D AVID F AIBISH, S ENIOR P ROGRAM M ANAGER SQL S ERVER D ATA Q UALITY S ERVICES Microsoft SQL Server 2012

Agenda The Business Case DQS Component Overview Configuring the DQS Component Demo Tips and Best Practices

The Business Case  Data Quality is required as part of an on-going batch processing  The DQS SSIS component leverages DQS knowledge into batch processing

DQS Component Overview Reference Data Definition Values/Rules New Suggestions Correct & Corrected Invalid Source + Mapping DQS Cleansing Component SSIS Package Destination Reference Data Services DQS Server Design Run Activity Monitoring Interactive Cleansing Project

Configuring the DQS Component Perform output Advanced settings, including cleansing info columns Configure the DQS server and KB Map required columns to domains

Tips and Best Practices Use KBs you trust! Use Conditional Split for improved control and automation Use DQS Client for reviewing SSIS results Use SSIS Cleansing Info outputs for further processing: analytics, integration, etc.

The Story We continue with Quality Airport and the flights information source. Now, we are going to cleanse the data by using SSIS. The Story We continue with Quality Airport and the flights information source. Now, we are going to cleanse the data by using SSIS. Exercise Description In this exercise you will : Configure the DQS Cleansing component Cleanse the flights information by the component Monitor the SSIS project and review the results in the DQS client Exercise Description In this exercise you will : Configure the DQS Cleansing component Cleanse the flights information by the component Monitor the SSIS project and review the results in the DQS client

Resources Sessions On-Demand & CommunityMicrosoft Certification & Training Resources Resources for IT ProfessionalsResources for Developers Connect. Share. Discuss.

DQS Blog Tips, tricks and guidance on best practices for using DQS – courtesy of the DQS team DQS Blog Tips, tricks and guidance on best practices for using DQS – courtesy of the DQS team DQS Movies A set of getting started movies for an easy introduction to DQS DQS Movies A set of getting started movies for an easy introduction to DQS DQS Forum Come participate in DQS related discussions in our DQS forum on MSDN DQS Forum Come participate in DQS related discussions in our DQS forum on MSDN Available Here blogs.msdn.com/b/dqs Available Here