Presentation is loading. Please wait.

Presentation is loading. Please wait.

DATA SCIENCE MIS0855 | Spring 2016 Data Cleansing David Schuff

Published byKenneth Fox Modified over 8 years ago

Similar presentations

Presentation on theme: "DATA SCIENCE MIS0855 | Spring 2016 Data Cleansing David Schuff"— Presentation transcript:

1 DATA SCIENCE MIS0855 | Spring 2016 Data Cleansing David Schuff David.Schuff@temple.edu http://community.mis.temple.edu/dschuff

2 Discuss (5 minutes) Have you fallen victim to any of Taber’s “stupid data corruption tricks?” From the readings, what are the best tips for cleaning data?

3 Cleaning Data Consider this Excel spreadsheet of sales in Pennsylvania, New Jersey, and Delaware for the years 2009 through 2013. Identify two problems with this data set.

4 And the problems show up during analysis… How do you find the “errors” and fix them?

5 The problem of outliers Do you correct this by… Removing the data point? Using the average of the other data points? Guessing at the right value? And is this an error or just an anomaly?

Download ppt "DATA SCIENCE MIS0855 | Spring 2016 Data Cleansing David Schuff"

Similar presentations

StarBuilder Payroll/GL/AP Importing Session - 203

StarBuilder Payroll/GL/AP Importing Session - 203
Social Studies 7 Map of the Colonies Power Point Game Created by Mrs. Bordas and Tim Norton Start Game.

Social Studies 7 Map of the Colonies Power Point Game Created by Mrs. Bordas and Tim Norton Start Game.
Cambodia Schools Project Or What I Did for Spring Break David Harris Spring 2002.

Cambodia Schools Project Or What I Did for Spring Break David Harris Spring 2002.
Stupid Columnsort Tricks Geeta Chaudhry Tom Cormen Dartmouth College Department of Computer Science.

Stupid Columnsort Tricks Geeta Chaudhry Tom Cormen Dartmouth College Department of Computer Science.
1 Evolution of the Scotts Turf Builder Line University Recommendations for Growing Lawns: 3 to 5 lbs N 1 lb P 2 O 5 2 lbs K 2 O per year Apply ~ 1 lb N/application.

1 Evolution of the Scotts Turf Builder Line University Recommendations for Growing Lawns: 3 to 5 lbs N 1 lb P 2 O 5 2 lbs K 2 O per year Apply ~ 1 lb N/application.
Essential Excel Tools, Tips & Tricks Nicole Soer Loras College.

Essential Excel Tools, Tips & Tricks Nicole Soer Loras College.
CIS101 Introduction to Computing Week 04 Spring 2004.

CIS101 Introduction to Computing Week 04 Spring 2004.
Excel Project One CIS101. What is Excel? Spreadsheet program with four parts Worksheets – where you enter, calculate, manipulate, and analyze data Charts.

Excel Project One CIS101. What is Excel? Spreadsheet program with four parts Worksheets – where you enter, calculate, manipulate, and analyze data Charts.
Students in a Grade 7 class measured their pulse rates. Here are their results in beats per minute. 97, 69, 83, 66, 78, 8, 55, 82, 47, 52, 67, 76, 84,

Students in a Grade 7 class measured their pulse rates. Here are their results in beats per minute. 97, 69, 83, 66, 78, 8, 55, 82, 47, 52, 67, 76, 84,
MIS2502: Data Analytics MySQL and SQL Workbench David Schuff

MIS2502: Data Analytics MySQL and SQL Workbench David Schuff
Unit 5 – Evidence. Maximum Formula The maximum formula is to find out the maximum, and out of the whole spreadsheet the maximum altogether was 120, which.

Unit 5 – Evidence. Maximum Formula The maximum formula is to find out the maximum, and out of the whole spreadsheet the maximum altogether was 120, which.
Computer Science: A Structured Programming Approach Using C1 3-7 Sample Programs This section contains several programs that you should study for programming.

Computer Science: A Structured Programming Approach Using C1 3-7 Sample Programs This section contains several programs that you should study for programming.
Practical Problems n By n Dr. Julia Arnold n Math 04 n Intermediate Algebra Click on icon for sound.

Practical Problems n By n Dr. Julia Arnold n Math 04 n Intermediate Algebra Click on icon for sound.
Introduction to linear regression living with the lab © 2011 David Hall and the LWTL faculty team The Living with the Lab label, the Louisiana Tech Logo,

Introduction to linear regression living with the lab © 2011 David Hall and the LWTL faculty team The Living with the Lab label, the Louisiana Tech Logo,
Redevelopment of NOC Into a Relational Database Kieran Holmes John Prince.

Redevelopment of NOC Into a Relational Database Kieran Holmes John Prince.
Education Bachelor of Science, December 2009 (Anticipated) Major: Psychology Honors, Awards, Activities Psychology Club, Historian BASIC Gospel Choir,

Education Bachelor of Science, December 2009 (Anticipated) Major: Psychology Honors, Awards, Activities Psychology Club, Historian BASIC Gospel Choir,
Editing and Revision. Revision Revision is the process of improving your piece of writing through: > the addition or removal of chunks of text > the rearrangement.

Editing and Revision. Revision Revision is the process of improving your piece of writing through: > the addition or removal of chunks of text > the rearrangement.
MOS - Spreadsheets CTE – IT Performance Task Spring, 2014.

MOS - Spreadsheets CTE – IT Performance Task Spring, 2014.
Data Cleansing Rule Based Strategy.

Data Cleansing Rule Based Strategy.
Science Fair Project Push Don’t Pollute Physical Science Michael Abert and David Ritter.

Science Fair Project Push Don’t Pollute Physical Science Michael Abert and David Ritter.

Similar presentations

Ads by Google