Census Data Visualization Gallery As Data For the Digital Government Strategy Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger March 28,

Background Received about Data Visualization: Images That Tell a Story Webinar: – visualizations visualizations Referenced Data Visualization of the Week: – I Started to Build a Census Data Visualization Gallery as Data (Accessible to All) For the Digital Government Strategy: – I Heard the Webinar and Was Further Motivated to Respond to Their Invitation to Provide Comments: – visualizations visualizations 2

The 7 Habits of Highly Effective People Habit 2: Begin With The End In Mind Habit 2 is based on imagination--the ability to envision in your mind what you cannot at present see with your eyes. It is based on the principle that all things are created twice. There is a mental (first) creation, and a physical (second) creation. The physical creation follows the mental, just as a building follows a blueprint. If you don't make a conscious effort to visualize who you are and what you want in life, then you empower other people and circumstances to shape you and your life by default. It's about connecting again with your own uniqueness and then defining the personal, moral, and ethical guidelines within which you can most happily express and fulfill yourself. Begin with the End in Mind means to begin each day, task, or project with a clear vision of your desired direction and destination, and then continue by flexing your proactive muscles to make things happen. My Note: My End In Mind Is The Census Data Visualization Gallery As Data For the Digital Government Strategy. 3 Source:

Census Data Visualization Gallery 4 My Note: Added Census Flows Mapper Since I Started That I Will Do Next Separately. I Found the Great Migrations Says Not Authorized to Access.

Census Data Visualization: Knowledge Base 5 My Note: Well-Defined URL To Each Piece and Mashup of Related Pieces.

Census Data Visualization: Spreadsheet 6 My Note: Makes Web Linked Data and Identifies Boundary Files Needed.

Booming Cities Decade to Decade 7 My Comment: Visualization, Story, and Metadata Are Together, But not the Data Table. See Next Slide That Does That With Interactivity Between Them and Makes Data Accessible to All!

Booming Cities: Spotfire 8 Story and Metadata Visualization Data My Note: See Data Sorted and Linked to Visualization!

Data Visualization Gallery Population Bracketology Migration Between California & Other States U.S. Territory and Statehood Status Spoken Languages Other than English Center of Population, Population Change by Decade Without A High School Education A Decade of State Population Change State-to-State Migration Population Under Age 5 by Congressional District Components of Metro Area Change Blooming States Largest Urbanized Areas Coastline County Population I-90 Population Density Profile, 2010 Keeping Pace with New York Population Shift to the West and South I-10 Population Density Profile, 2010 Booming Cities, (Previous Example) I-5 Population Density Profile, 2010 Islands of High Income The Great Migration, 1910 to 1970 Following the Frontier Line, 1790 to 1890 Changing Ranks of States State Populations: 1890, 1950, and 2010 Before and After 1940 Physical to Political Geography Differential City Growth Patterns I-95 Population Density Profile Increasing Urbanization Gaining and Losing Shares Top 20 Cities 9

Population Bracketology 10 My Comment: Why Not Show Data Sorted and Linked To Visualization? See Next Slide.

Population Ranking: Spotfire 11 Story and Metadata My Note: See Data Sorted and Linked to Visualization! Visualization Data My Story

Net Migration Between California and Other States 12 My Comment: Why Not Just Show the Data and A Summary? See Next Slide.

Net Migration Between California and Other States: Spotfire 13 Data Summary Data Table My Story Story and Metadata My Note: Data Sorted in Rank Order

U.S. Territory and Statehood Status by Decade 14 My Comment: Why Not Show Data Sorted and Linked To Visualization? See Next Slide.

Statehood Status: Spotfire 15 My Story Story and Metadata Data Visualization My Note: See Data Sorted and Linked to Visualization!

Spoken Languages Other than English 16 My Comment: Why Not A Simple Bar Chart To Tell The Story? See Next Slide.

Spoken Languages: Spotfire 17 My Note: See Visualization Labeled and Linked to Filtered and Sorted Data! Data Visualization My Story Story and Metadata

Center of Population, My Comment: The Territorial Expansion Boundaries Were Not Provided. This is Not Providing Access to All the Data!

Center of Population: Spotfire 19 My Note: See Visualization Labeled and Linked to Data! Data Visualization My Story Story and Metadata

Population Change by Decade 20 My Comment: Small-multiples of County-level Maps are Difficult to See So a Few Maps with Say the Top 10 Population Changes and the Ability to Sort the Data is More Useful. Also Note the Large Number of Counties with No Data (Empty). See Next Slide.

Population Change by Decade: Spotfire 21 My Story Story and Metadata Data Visualizations My Note: See Visualization Labeled and Linked to Sorted Data! My Note: This Data Set Had to Be Augmented with County Names to Work with the Shape File.

Without A High School Education 22 My Comment: These Comparisons Require Lots of Eye Movement. See Next Slide.

Without A High School Education: Spotfire 23 My Note: See Visualization Labeled and Linked to Sorted Data! My Story: This Trellis Chart Shows the Variation For Each of the Four Categories (Male and Female and Native and Foreign born) Across each Region by Race or Hispanic Origin and the Columns Can be Sorted in the Table Below to See Their Rank Order. Data Visualization My Story Story and Metadata

A Decade of State Population Change 24 My Comment: These Comparisons Require Lots of Eye Movement and An Extra Click to See the Details for Each State. See Next Slide.

A Decade of State Population Change: Spotfire 25 Data Visualization Filter Visualization My Comment: See Visualization Linked to Map and To Sorted Data Table.

State-to-State Migrations 26 My Comment: This Is Difficult To Understand and The Data Needs Summarization. See Next Slide.

State-to-State Migrations: Spotfire 27 My Story Story and Metadata Visualization Data Filter My Note: Use Filters and Sorting To See Links Between Visualization and Data.

Population by Congressional District 28 My Comment: I Would Use a Congressional District Map and a Statistical Distribution Function to Show These Data. The Data Set Was Augmented For That. See Next Slide.

Population by Congressional District: Spotfire 29 My Story Story and Metadata Visualization Data My Note: Use Filters and Sorting To See Links Between Visualization and Data. Filter

Components of Metro Area Change 30 My Comment: I Would Use a State Map and a Statistical Distribution Function to Show These Data. The Data Set Was Augmented For That. See Next Slide.

Components of Metro Area Change: Spotfire 31 Data Visualization Scatter Plot With Straight Line Fit VisualizationMy Story Story and Metadata My Note: See Links Between Visualization and Data.

Blooming States 32 My Comment: I Would Use a Trellis Chart To Show These Data. The – in the Data Set Were Eliminated For Spotfire. See Next Slide.

Blooming States: Spotfire 33 My Story Story and Metadata Data Visualization My Note: See Links Between Visualization and Data.

Largest Urbanized Areas 34 My Note: This Data Set Needed To Be Separated Into Two Data Sets, Latitude and Longitude Added and Visualized In a Different Way. See Next Slide.

Largest Urbanized Areas: Spotfire 35 My Story Story and Metadata Scatter Plots With Lines Visualization Data My Note: See Links Between Visualization and Data.

Coastline County Population 36 My Comment: This Map Shows Overplotting and Not the Data, Which Had To Be Calculated By Spotfire and Displayed. See Next Slide.

Coastline County Population: Spotfire 37 My Story Story and Metadata Visualizations Visualization Data My Note: See Links Between Visualization and Data. Summary Data Filters My Note: Each shape maps to more than one value in the column used to color it. My Note: Data Calculated by Summary Table

I-90 Population Density Profile 38 My Comment: It Is Helpful to See All Four of These Major Highway Population Density Profiles in the Same Place and Scale. See Slide 65.

I-90 Population Density Profile: Spotfire 39 My Story Story and Metadata Screen Capture Data Visualization My Note: Number of Bins Corresponds to Resolution of the Data.

Keeping Pace With New York 40 My Comment: These Data Needed To Be Reformatted and Visualized Separately. See Next Slide.

Keeping Pace With New York: Spotfire 41 My Story Story and Metadata Visualizations Data My Comment: Adjacent Small Multiple Data Sets and Visualizations Make Comparisons Easier.

Population Shift 42 My Comment: Like To See All the Data in a Trellis Grid as a Times Series For Every Grid Square. See Next Slide.

Population Shift: Spotfire 43 My Story Story and Metadata Trellis Grid Bar Chart Data My Note: Compare Above and Below the 100W Longitude. My Note: See Links Between Visualization and Data.

I-10 Population Density Profile 44 My Comment: It Is Helpful to See All Four of These Major Highway Population Density Profiles in the Same Place and Scale. See Slide 65.

I-10 Population Density Profile: Spotfire 45 My Story Story and Metadata Data Visualization Screen Capture My Note: Number of Bins Corresponds to Resolution of the Data.

I-5 Population Density Profile 46 My Comment: It Is Helpful to See All Four of These Major Highway Population Density Profiles in the Same Place and Scale. See Slide 65.

I-5 Population Density Profile: Spotfire 47 My Story Story and Metadata Visualization Image Data My Note: See Links Between Visualization and Sorted Data. My Note: Bins Not Available in Vertical Display of Data.

Islands of High Income 48 My Comment: One Map With Three Ranges of Income Would Be Useful. See Next Slide.

Islands of High Income: Spotfire 49 My Story Story and MetadataData Visualization My Note: See Links Between Visualization and Sorted Data.

The Great Migration 50 My Comment: Unauthorized to Access. See Next Slide.

The Great Migration 51

Following the Frontier Line 52 My Comment: The Data Was Not Accessible So Only The Text and Images Could Be Integrated. See Next Slide.

Following the Frontier Line: Spotfire 53 My Story Story and Metadata Text as Data My Note: See the Text as Data That Goes With the Images.

Changing Ranks of States 54 My Comment: This is One of the “Rough Graphics” That Should Have Been Discarded. See Next Slide.

Changing Ranks of States: Spotfire 55 My Story Story and Metadata Visualization Data Filters Data Visualization My Note: See Links Between Visualization and Sorted Data.

Cartograms of State Populations 56 My Comment: This is Another One of the “Rough Graphics” That Should Have Been Discarded. See Next Slide.

Cartograms of State Populations: Spotfire 57 My Story Story and Metadata Visualization Data Filters My Note: See Links Between Visualization and Data.

Before and After My Comment: The County Data Is Plotted As Colored Dots. It Could Also Be Plotted As Colored Areas With Statistical Measures. See Next Slide.

Before and After 1940: Spotfire 59 Visualization DataStatistical Summary My Story Story and Metadata My Note: See Visualization Labeled and Linked to Sorted Data! My Note: See Changes in US Summary Statistics.

From Physical to Political Geography 60 My Comment: This Word Cloud Is Possibly Misleading and Should Be Expressed in Numbers of Terms in Each of the Four Categories by Year. See Next Slide.

From Physical to Political Geography: Spotfire 61 My Story Story and Metadata Data Visualization

Differential City Growth Patterns 62 My Comment: Even with the Zoom-In Slider, These are Difficult to See and Compare. See Next Slide.

Differential City Growth Patterns: Spotfire 63 Data My Story Story and Metadata Visualization Filters Trend in Population Trend in Density

I-95 Population Density Profile 64 My Comment: It Is Helpful to See All Four of These Major Highway Population Density Profiles in the Same Place and Scale. See Next Slide.

I-95 Population Density Profile: Spotfire 65 My Story Story and Metadata Visualizations Data

Increasing Urbanization 66 My Comment: The Geo-Referencing Data and Boundaries Were Not Provided. The Time Series Does Not Shown the Correct Value For See Next Slide.

Increasing Urbanization: Spotfire 67 My Story Story and Metadata Data Filters Data Visualization My Note: These Are Not Real Data.

Gaining and Losing Shares 68 My Comment: These Data Could All Be Displayed At Once Instead of Using a Slider. See Next Slide.

Gaining and Losing Shares: Spotfire 69 My Story Story and Metadata Data Visualization My Note: See Visualization Linked to Data.

Top 20 Cities 70 My Comment: Latitude and Longitude of Cities Are Not Provided. I Had to Find a Source and Add Them. Size of Names Obscures Locations. See Next Slides.

TIGER Shapefiles: Census Bureau 71 My Comment: Looked for Longitude and Latitude of Cities Here.

List of United States Cities: Wikipedia 72 My Comment: Found Longitude and Latitude of Cities Here.

Albany NY Latitude and Longitude 73 Web Link My Comment: Found Longitude and Latitude of Cities Here.

Top 20 Cities: Spotfire 74 Story and Notes My Story Visualization Data My Note: See Visualization Labeled and Linked to Sorted Data!

Conclusions and Recommendations The Census Data Visualization Gallery Was Used As An Example of the Digital Government Strategy – All Content = Big Data. Spotfire Was Used to Make the Census Visualizations Statistical and Interactive. – Spotfire Was Originally Co-developed by Professor Ben Schneiderman, University of Maryland, Who Developed the Treemap, Who Was a Consultant to the Census Bureau. I Responded to Their Invitation to Provide Comments. – Specifically, the Concept to “Keep focus on good visual ideas not cutting edge interactivity” Should Be to Focus on Both and To Make the Data More Accessible and Complete. See Next Slide. The Census Flow Mapper-Beta is Next. – See

Conclusions and Recommendations: Spotfire 76