W3C eGovernment Community: Data Science Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government.

Slides:



Advertisements
Similar presentations
Semantic Search for NSF Decision Making Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Advertisements

OMB Data Visualization Tool Requirements Analysis: Information Builders Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Data Science for Business: Semantic Verses Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Federal SOA for E-Government The Top Ten Things You Need to Know for YouTube October 15, 2011 DRAFT 1
OMB Data Visualization Tool Requirements Analysis: Oracle Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Data Act at US Department of Treasury Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
OMB Data Visualization Tool Requirements Analysis: Birst Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Dynamic Case Management for Military and Intelligence Departments Can Improve Their Enterprise Architecture Programs Dr. Brand Niemann Director and Senior.
1 Services and Cloud Computing Work Groups: Status Update Brand Niemann US EPA January 8, 2010.
DoDAF 3.0: A Web 2.0 and SOA Mashup!
Title: Build EPA Apps in the Cloud Dr. Brand Niemann Former US EPA Senior Enterprise Architect and Data Scientist Current Binary Group Senior Enterprise.
Presentation to Data.gov PMO Semantic Web/Linked Data Team Dr. Brand Niemann Director and Senior Data Scientist Semantic Community July 27,
Build Air Force OneSource in the Cloud for the Data.Gov and Open Government Vocabulary Teams UDEF Deployment Workshop Planning Meeting at the Open Group.
Build the Binary Group in the Cloud Brand Niemann Senior Enterprise Architect Binary Group August 5, Updated August 8,
OMB Data Visualization Tool Requirements Analysis: Logi Analytics Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
OMB Data Visualization Tool Requirements Analysis: Microsoft Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Big Data and Social Media & Web Analytics Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Big Data Innovation: Semantic Analytics 14 th SOA for eGovernment Conference Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
NIST Scientific Data for Data Science United Nations Open Data / Open Government Conference, April 26-28, Abu Dhabi
Data Science for RDA Climate Change Data Challenge and Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Semantic Data Discovery: Proof of Concept for DHS
Linked Data Visualizations for Eurostat Linked Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Cloud: SOA, Semantics, & Data Science Welcome and Overview Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
3 Round Stones: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
1 Semantic Cloud Computing & Open Linked Data Pattern Brand Niemann Invited Expert to the NCIOC SCOPE and Services WGs September 22, 2009.
Big Data Conference: Analytics and Applications for Federal Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Data Science for USGS Minerals Big Data Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data.
1 Gov 2.0 for EPA: Pollution Prevention and Toxics In Support of the June 9-13, 2008 National Dialogue on How to Enhance Access to Environmental Information:
Imagine Everything is Before You: Past, Present, and Future Paper and Demonstration for the 2014 Family History Technology BYU Dr. Brand Niemann.
Information Sharing Begins With Me Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
GIS Data Science for Collaboration Across Communities: GIScience 2.0 and Beyond Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.
Using Data Science as Evidence in Public Policy With Big Data and Elections Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
EPA Indicators of Our Health and Environment Updated and Improved Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
XBRL Seminar: The New Data Reference Model
Big Data Symposium: Analytics and Applications for Federal Big Data - FEMA Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
Data Science for Agency Initiatives 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for International Data Week 2016: Concept Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science.
U.S. Department of the Interior U.S. Geological Survey CDI Webinar Sept. 5, 2012 Kevin T. Gallagher and Linda C. Gundersen September 5, 2012 CDI Science.
Data Science for DataBay DataBay "Reclaim the Bay" Innovation Challenge: August 1-3, 2014, Smithsonian Environmental Research Center, 647 Contees Wharf.
Data Science ESIP Publication Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for USGS Minerals Big Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
Data Science for DTIC Data Ecosystem Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
The 2012 EuroStat Regional Yearbook for Semantic Interoperability Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Why Doesn't EPA Have a Self- Contained Statistical Unit?: A Tribute to Doug Engelbart Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.
Data Science for USDA Big Data
Open DATA METI: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Data Science for Migration Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Health Datapalooza IV: Child and Adolescent Health Data App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
SmartGrid and Spotfire Cloud Computing - Similarities in Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Research on US Federal Government Handling of Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Binary Group Knows What It Knows Because of It’s Information Attitude Brand Niemann Senior Enterprise Architect and Data Scientist August 26,
1 A Target Data Architecture for the US EPA: Implementing DRM 3.0 and Data.gov Brand Niemann Senior Enterprise Architect, US EPA April 21, 2009 PARS 2009.
Data Science for the NOAA Chief Data Officer Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Harnessing Data to Address Diabetes in the US Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL.
Data Science for HealthCare.gov Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Department of Commerce App Challenge: Big Data Dashboards Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.
Data Science for DoI BSEE Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for DoI BSEE.
Data Science for Joint Doctrine Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Joint.
NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Cross Information Sharing and Integration for the Intelligence Community: 13 th SOA for eGovernment Conference Dr. Brand Niemann Director and Senior Enterprise.
1 Tutorial for the EAWG: Solution Architecture for 2010 Brand Niemann Senior Enterprise Architect U.S. EPA January 28, 2010.
NIEM 3.0 Data Analytics App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger.
1 Improved Access to EPA and Interagency Information: Before and After with Web 2.0 – Part 7 EPA Jam on Improved Access to Environmental Information, June.
Data Science for NIST Big Data Framework Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for Global Ebola Response Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
Driving Innovation with Open Data Chris Musialek in place for Jeanne Holm Data.gov February 9, 2012.
Data Science for the National Big Data R&D Initiative Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
About The Federal Data Architecture Subcommittee (DAS) 2008
Spotfire 5 Users Guide Dashboard
Title: Build EPA Apps in the Cloud
Presentation transcript:

W3C eGovernment Community: Data Science Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger August 23,

Agenda 11-11:15: W3C eGovernment conversion from Working Group to Community (Jeanne Holm) 11:15-11:45: Project Open Data approach to open source policy and technology and co- development with citizens (Gray Brooks) 11:45-12:00: Open Data Stack Exchange available: (Joe Hourcle) 12:00-12:25: Opportunities for data science (Brand Niemann) 12:25-12:30: Adjourn 2

The Changing Landscape of Federal Information Technology Dominic Sale, new OMB Chief of Data Analytics & Reporting, said the new Digital Government Strategy is "treating all content as data." So big data = all your content. Doing work for OMB and Agency senior managers on Data Visualization and Analysis Tools and Analytic Data Sets. “Data Science precedes the use of SOA, Cloud, and Semantic Technologies.” “It is not just where you put your data (cloud), but how you put it there.” “Successful SOA depends on the data, which in turn requires success in dealing with data’s semantics, which in turn requires data science to get the data ecosystem organized to deal with the semantics of data integration.” 3

Cloud: SOA, Semantics, & Data Science: September th Today: Thank You to the Speakers, Participants, Sponsors, Organizers, and Springfield! – Past: 14 SOA for eGov Conferences and 5 Semantic Interoperability MITRE! – Present: Collaboration with Data Community DC with Over 4,000 Members (Harlan Harris, President)! – Future: New Data Transparency Collation Community of Practice Today (AJ Budhraja, DoJ CTO, Federal SOA CoP Co-Chair) – Now: Highlights For Today and Tomorrow. – science-conference/ science-conference/ 4

Opportunities for Data Science Previous W3C eGov: – Open Government Data for Japan (and the US and Europe): Digital Government Strategy: – “Treating all content as data." So big data = all your content: OMB Data Analytics & Reporting: – Visualizations Tools Requirements Analysis: – Analytic Data Sets: White House Project Open Data: – Wiki and GitHub versus MindTouch and Spotfire 5

Discussion Several month ago when the Open Data Policy was announced, I did an An Open Data Policy Result story showing how it could be implemented using their new content with an Open Government Data Data Science Team as follows: – Steven VanRoekel - Federal CIO - Directs the Digital Government Strategy – Jeanne Holm - Data.gov Evangelist - Evangelizes the Availability of the Data – Gannon Dick - Data Preparation - Prepares the Data for Analysis – Brand Niemann - Data Scientist - Provides the Data (Catalog and Results) in a Data Platform See: 6

Discussion Then Information Week Government asked: Is this effort by education a good example of what agencies should be doing? And noteworthy in itself? – Status of the Department of Education's Inventory of Its Data Collections. GAO R, June 28. See: I find this except on page 7 very important to answering your questions: Officials from all three offices said they anticipate using the inventory to identify any areas of overlap and inconsistent data definitions among the various data collections across program offices. Officials from two offices said their staff would also use the inventory to avoid duplication before undertaking any new collections. Is this effort by education a good example of what agencies should be doing?: Yes, inventory data assets for a purpose like data quality assurance, integration across multiple data sets, and avoiding collection duplication. And noteworthy in itself?: Yes, if they do something more to demonstrate real value to the public like showing actual examples of using this to create new results with their data and other agencies. In essence they have created a data ecosystem, now they should use it themselves. – e_Department_of_Education.E s_Inventory_of_Its_Data_Collections e_Department_of_Education.E s_Inventory_of_Its_Data_Collections 7

Discussion Then Information Week Government asked: Could I get your take on the new Next.Data.gov site and comments?: – "But in many respects, the new site is also likely to disappoint die-hard data users as being not much more than a shiny new showroom attached to the same old government data warehouse, a warehouse still in need of operating improvements and accessible data.“ look/ look/ My Comment: It does disappoint and using the following click trail as an example: – Start at: – pick a Community like Safety: – pick Resources: – pick the National Map: – then Click here to go to The National Map Viewer – and Download Platform!: – and you finally get to the data and its display Bottom line: This is yet another new interface to the old Data.gov interface that eventually takes you (if you are lucky enough to find it) to where the actual data has been for years! – look/ # look/ # My current efforts for OMB are just starting: – 8

Discussion Recently, I did a story for Information Week on the Open Data Policy Implementation: It Takes a Data Science Team. Essentially, OMB has established a new Web Site called Open Data Git Hub, to do this instead of the OMB MAX, which is very similar to the way I use MindTouch and Spotfire.Open Data Git HubOMB MAXMindTouchSpotfire Now I am going to do the same thing with their new content and some actual data that I found in it. I reformatted the new content to be compliant with their Digital Government Strategy requirements and the functionality provided by the new GitHub so all of this is done in one place with content analytics.Digital Government Strategy This Open Data Policy Implementation took only several hours to build and provides more functionality than the Open Data Git Hub: – See: 9

Discussion Today, I finished a story for Information Week on Hacking a Hacker of Open Government Data: – I really admire Josh's pioneering data science work for open government data. I decided to "hack" his content using MindTouch and Spotfire to accomplish the following goals: – Digital Government Strategy compliant. Digital Government Strategy – "Treating all content as data" (1) so big data = all your content (2). – Graphs of Graphs and Not Charts of a Graphs (3) Sources: – (1) Dominic Sale, new OMB Chief of Data Analytics & Reporting. – (2) Brand Niemann. – (3) For example, what Spotfire does with adjacent dynamically linked visualizations. See Graph Databases and the Semantic Web.Graph Databases and the Semantic Web I followed his four steps: – Step 1 Get the Data Step 1 Get the Data – Step 2 Scrub the Data Step 2 Scrub the Data – Step 3 Build Something Step 3 Build Something – Step 4 Distribute Step 4 Distribute Josh Tauberer was and is a pioneering data scientist of Open Government Data who believes in "creative use of technology to innovate our civic lives, especially our participation in government", so I did the same with his book content and four steps to build on his work and present that to the new W3C eGovernment Community for Data Science. – See: 10