Presentation is loading. Please wait.

Presentation is loading. Please wait.

Data Science and Semantic Insights for DoD Joint Doctrine Meetup Dr. Brand Niemann Founder and Co-Organizer Federal Big Data Working Group Meetup Director.

Similar presentations


Presentation on theme: "Data Science and Semantic Insights for DoD Joint Doctrine Meetup Dr. Brand Niemann Founder and Co-Organizer Federal Big Data Working Group Meetup Director."— Presentation transcript:

1 Data Science and Semantic Insights for DoD Joint Doctrine Meetup Dr. Brand Niemann Founder and Co-Organizer Federal Big Data Working Group Meetup Director and Senior Data Scientist/Data Journalist Semantic Community Federal Big Data Working Group Meetup Data Science Data Science for Joint Doctrine December 7, 2015 1

2 Agenda 6:30 p.m. Welcome and Introduction (New Tutorial and Mentoring) Slides Data Science for Joint DoctrineData Science for Joint Doctrine 6:45 p.m. Brief Member Introductions 7:00 p.m. Chuck Rehberg, CTO and and Dave Decker, Semantic Insights, Steve Hambry, VP Product Development, Securboration, and Barry Smith, Distinguished Professor, and Director, National Center for Ontological Research, SUNY BuffaloSemantic InsightsSecurborationBarry Smith 8:30 p.m. Open Discussion 8:45 p.m. Networking 9:00 p.m. Depart 2

3 Overview Introduction Information Meeting on Joint Doctrine Ontology Publication Matrix Graphic Converted the Legend and Publication Matrix so it could be a table interface to the documents and the top level of a three level hierarchy for discovery and ontology buildingLegendPublication Matrix Peter Morosoff Expertise I received invaluable subject matter assistance and guidance from Peter Morosoff who provided the following suggestions: Task: Integrate Joint Doctrine with the following: Army doctrine is at: http://armypubs.army.mil/doctrine/ and Air Force doctrine is at: https://doctrine.af.mil/ (Please note: This has not been done yet.)http://armypubs.army.mil/doctrine/https://doctrine.af.mil/ Frequency of Terms If I do a search for both the words artillery and field artillery in the 38 PDF files for the JD JP3-0 to JP3-68 series I get the following results: http://semanticommunity.info/Data_Science/Data_Science_for_Joint_Doctrine#Frequency_of_Terms. JP3- 09 has the mosthttp://semanticommunity.info/Data_Science/Data_Science_for_Joint_Doctrine#Frequency_of_Terms Some Conclusions Now I realize that these documents are limited in what they provide based on subsequent conversations with Peter Morosoff who says: JPs are reservoirs of ideas and are not directives. So Barry Smith and other ontologists are working on an ontology of those ideas and not an ontology of directives. So the question is: Does this have any practical value to the warfighter in the field of battle? Activity-based Information Presentation at the Defense Strategies Institute Professional Educational Forum: Harnessing the Power of Big Data for The Intelligence Community, November 17-18, 2015 3

4 Peter Morosoff I am sending the attached to you because the article presents the intelligence community as being in need of your big-data approach and methods. Revolutionizing Military Intelligence Analysis By Chandler P. Atwood Defense Strategies Institute Professional Educational Forum Harnessing the Power of Big Data for The Intelligence Community November 17-18, 2015 Mary M. Gates Learning Center, Alexandria, VA National Priorities for Big Data 4 PDFPDF and WordWord

5 Summary The White House Office of Science and Technology Policy (OSTP) and the National Science Foundation (NSF) convened a National Data Science Organizers Workshop, November 5-6,2015, to discuss: 1. Data Science for the Nation: National Priorities, Impacts of Big Data Science on National Priorities, and Using Meetups to Explore National Challenges, 2. Exposing Data; 3. Coordination and Support of Data Science Meetups; and 4: The National Priority Challenge. The results of this workshop will be summarized along with highlights from the Federal Big Data Working Group Meetup, for which the presenter is the Founder and Co- Organizer. Examples of what the Federal Big Data Working Group Meetup has done from 2014- present to provide big data science tutorials and Massive Open Online Courses (MOOCs), curated government datasets, and citizen science and crowdsourcing in support of the White House Open Science and Innovation: Of the People, By the People, For the People, as part of the President's 2013 Second Open Government National Action Plan. 5

6 6 http://www.nationalprioritychallenge.org/

7 Agenda Day 1: November 5, 2015: 12:00pm – 1:00pm Lunch with the Big Data Regional Innovation Hubs Leaders (limited seating) 2:00pm – 2:30pm Opening Keynote: What are the National Priorities? by Thomas Kalil 2:30pm – 3:30pm Session 1: Leadership Panel on Data Science Innovation and Collaboration 3:30pm – 5:00pm Grassroots Data Science Across the Nation with Lightning Talks 5:00pm – 5:15pm Support of grassroots data science, crowd sourcing, and challenges 6:00pm – 8:00pm PUBLIC: Data Drinks: National Data Community Happy Hour! Day 2: November 6, 2015: 8:00am – 10:00am Session 2: Exposing Data 10:30am – 11:30am Session 3: Coordination and Support of Data Science Meetups 12:30pm – 1:30pm Lunch Keynote: Data Science in the Government by D.J. Patil 1:30pm – 5:30pm Session 4: The National Priority Challenge 5:45pm – 6:00pm Closing Remarks 7 http://www.nationalprioritychallenge.org/schedule/

8 Speakers Thomas Kalil, Deputy Director for Policy for the White House Office of Science and Technology Policy and Senior Advisor for Science, Technology and Innovation for the National Economic Council Opening Keynote: What are the National Priorities? by Thomas Kalil Chaitan Baru, Senior Advisor for Data Science, National Science Foundation Session 3: Coordination and Support of Data Science Meetups Dr. D.J. Patil, U.S. Chief Data Scientist and Deputy Chief Technology Officer at the White House Office of Science and Technology Policy Lunch Keynote: Data Science in the Government by D.J. Patil 8 http://www.nationalprioritychallenge.org/speakers/

9 Purpose and Organizers National Data Science Organizers is a network of individuals who promote data science professionalism in their communities across the nation Applications of data science to address major economic or societal challenges Questions that meetups could explore The Obama Administration has already launched a series of initiatives related to Big Data and open data About The Organizers Institutional Support National Science Foundation University of Chicago Data Science for Social Good Steering Committee: Representatives from: District Data Labs, DC2, Big Data Utah, NSF, Boston Predictive Analytics, SF Data Mining, NIH/NLM/NCBI, University of Chicago, etc. 9 http://www.nationalprioritychallenge.org/purpose/ http://www.nationalprioritychallenge.org/about-the-organizers/

10 Key Points Data science for the nation: Impacts of big data science on National priorities Data science for tackling the challenges of big data Developing people, processes, and products for the Federal Government Online Data Science Collaboration and Competition Kaggle DevPost (Formerly Challenge Post) 10

11 Because I am a Data Scientist and Data Journalist Who we are? What we do? Where we do it? When we do it? Why we do it? How we do it? Specific example: Data Science for the Map of Federal Crowdsourcing and Citizen Science Projects for the NDSO Challenge 11 Poynter: A Global Leader in Journalism: 6 questions that can help journalists find a focus, tell better stories6 questions that can help journalists find a focus, tell better stories

12 Who we are?: Definitions Federal: Supports the Federal Big Data Initiative, but not endorsed by the Federal Government or its Agencies; Big Data: Supports the Federal Digital Government Strategy which is "treating all content as data", so big data = all your content; Working Group: Data Science Teams composed of Federal Government and Non-Federal Government experts producing big data products; and Meetup: The world's largest network of local groups to revitalize local community and help people around the world self-organize like MOOCs (Massive Open On-line Courses) now endorsed by the White House 12 http://www.meetup.com/Federal-Big-Data-Working-Group/ http://semanticommunity.info/Data_Science/Federal_Big_Data_Working_Group_Meetup#Meetups

13 What we do?: October 19 th Meetup This Meetup was organized for: Robin Thottungal, Chief Data Scientist @ EPA, and Division Director, EAD, OIAA, OEI, Robin Thottungal Greg Godbout, Chief Technology Officer, Environmental Protection Agency, and former Executive Director and Co-Founder of 18F, and Greg Godbout Jay Benforado, Director, National Center for Environmental Innovation at EPA, and Co-Chair, Federal Community of Practice for Crowdsourcing and Citizen ScienceFederal Community of Practice for Crowdsourcing and Citizen Science for the National Data Science Organizers Workshop on November 5-6, 2015, as an example of:National Data Science Organizers Workshop data science for curated data sets, user-centric digital services focused on the interaction between government and the people and businesses it serves, and a Federal Community of Practice on Crowdsourcing and Citizen Science of Big Data that meets bi-monthly to share lessons learned and develop best practices for designing, implementing, and evaluating crowdsourcing and citizen science initiatives. 13 See Recording and Agenda: https://www.cubbyusercontent.com/pl/Instant+Meeting+2015-10-19.webm/_64a119c67b2b4103a43c2e43e356ab35https://www.cubbyusercontent.com/pl/Instant+Meeting+2015-10-19.webm/_64a119c67b2b4103a43c2e43e356ab35 http://www.meetup.com/Federal-Big-Data-Working-Group/events/223605766/

14 Where we do it?: Locations Xcelerate Solutions 8405 Greensboro Dr., Suite 930, McLean 22102, VA National Science Foundation 4201 Wilson Blvd, Arlington, VA Eastern Foundry 2011 Crystal Drive, 4th Floor, Arlington 22202, VA Marriott Wardman Park 2600 Woodley Road NW, 20008, Washington, DC Conferences, Workshops, etc. 14

15 When we do it?: Meetup Calendar Schedule September 28 th, Climate Change & Genomic Data - Data Science Meetup of Meetups October 5th, Data Science for EPA & USGS Fracturing & Fracking Data (Dr. Sophia Liu, USGS and USGS Staff). See July 13 th Meetup: Data Science for USGS Minerals Big DataData Science for USGS Minerals Big Data October 19th, Sensing Our Air: The Quest for Big Data About Our Air Quality (EPA’s New Chief Data Scientist, Robin A Thottungal, Invited)Robin A Thottungal November 2 nd, Data Science for Random Forests: TIBCO Enterprise Runtime for R. See June 1 st Meetup: Data Science for Homeless Data: QlikView. Tableau, & Spotfire BakeoffData Science for Homeless Data: QlikView. Tableau, & Spotfire Bakeoff November 5-6 th, OSTP/NSF Data Science Meetup of Meetups, Ballston, VA November 16 th, Data Science for the DataAct Datathon December 7 th, Data Science for DoD Joint Doctrine January 4 th, 2016, Data Science for Semantics: MarkLogic and Cray Graph Appliance Update February 1st, 2016, Data Science for Census American Community Survey 15

16 Why we do it?: Use Federal Big Data Examples and Technology Federal Big Data Examples: White House Climate Change and Precision Medicine NIH Genomic EPA Air Quality USGS Water Quality Department of Commerce Census Treasury DataAct DoD Joint Doctrine Major Big Data Technologies: TIBCO Enterprise Runtime for R (TERR) MarkLogic Semantics Cray Graph Appliance 16

17 How we do it?: Like the NIH Data Commons FAIR Principles: Findable Accessible Interoperable Reusable Cloud: Data Software Results Federal Science Policy: OSTP Public Access to Scientific Data Memo (February 2013) New Program: Big-Data-to- Knowledge (2013) New Position: Associate Director of Data Science (2014) Digital Enterprise (2015): Data Commons Metadata Open APIs Digital Objects Containers A NIH – Semantic Medline Data Science Data Publication Commons 17

18 How we do it?: OSTP/NSF National Data Science Organizers Workshop Week of November 2 nd : NSF Data Science/Big Data Principal Investigators (About 300) NSF Data Hubs (4) Organizers of Largest Data Science/Big Data Meetups (About 65) Pipeline for Return on Investment: PIs put their data, tools and research results in the Data Hubs Data Hubs provide those data, tools, and research results to the world, but especially to the Data Science/Big Data Meetups Data Science/Big Data Meetups collaborate with PIs and Data Hubs to increase usage and feedback 18

19 How we do it?: We Already Do This! Semantic Community: Provides a Community Sandbox that is like a GitHub, Data Hub, Data Commons, etc. Metadata (MindTouch) Open APIs (MIndTouch) Digital Objects (MindTouch) Containers (Spotfire) Organize the Federal Big Data Working Group Meetup Support Agencies and Programs in Crowdsourcing Their Data Sets Mentor Data Scientists (Tutorials and MOOCs) and Entrepreneurs (Eastern Foundry) Federal Big Data Working Group Meetup: Federal: Supports the Federal Big Data Initiative, but not endorsed by the Federal Government or its Agencies; Big Data: Supports the Federal Digital Government Strategy which is "treating all content as data", so big data = all your content; Working Group: Data Science Teams composed of Federal Government and Non- Federal Government experts producing big data products; and Meetup: The world's largest network of local groups to revitalize local community and help people around the world self- organize like MOOCs (Massive Open On-line Classes) now embraced by the White House. 19

20 How we do it?: Data Mining - Science - Questions - Publication Process Data Mining Process: Business Understanding Data Understanding Data Preparation Modeling Evaluation Deployment Data Science Process: Data Preparation Data Ecosystem Data Story Data Science Questions: How was the data collected? Where is the data stored? What are the data results? and Why should we believe the data results? Data Science Data Publication: Knowledge Base Spreadsheet Index Web & PDF Tables to Spreadsheet Data Browser Dynamically Linked Adjacent Visualizations 20

21 How we do it?: Collaboration for Data Science Win-Wins USDA Open Government Data Training, Innovation Competition, and Online Course in Data-Driven Farming: http://semanticommunity.info/Data_Science/Big_Data_Science_for_Precision _Farming_Business#Story http://semanticommunity.info/Data_Science/Big_Data_Science_for_Precision _Farming_Business#Story Many Curated Government Data Sets and Data Science Products: http://semanticommunity.info Pick an Agency and/or a Data Set and Look for a Meetup on That: http://www.meetup.com/Federal-Big-Data-Working-Group/ Mentor Startups Partnership with Eastern Foundry: http://www.meetup.com/Federal-Big-Data-Working- Group/events/223140032/ http://www.meetup.com/Federal-Big-Data-Working- Group/events/223140032/ 21

22 Specific Example: Data Science for the Map of Federal Crowdsourcing and Citizen Science Projects for the NDSO Challenge The National Data Science Organizers (NSDO) are looking for a set of meta- design categories for each challenge model so teams can find, gather, and share data. The Federal Crowdsourcing and Citizen Science Toolkit provides both a set of meta-design categories and agency partners to help teams find, gather, and share data. The Map of Federal Crowdsourcing and Citizen Science Projects has been converted to a data set of 102 projects that can be used by the NDSO teams for the upcoming OSTP/NSF NSDO Workshop, November 5-6, 2015, and for going forward for the rest of 2015-2016. This work also demonstrates a simple data science project for a hackathon challenge that shows how this map was created in Excel and visualized in Spotfire.

23 https://crowdsourcing-toolkit.sites.usa.gov/

24

25 https://ccsinventory.wilsoncenter.org/

26 https://ccsinventory.wilsoncenter.org/#projectId/101

27 https://ccsinventory.wilsoncenter.org/add.html

28 CCSInventory.xlsx

29 Spotfire Imports Boundary Files Spotfire Geocodes Data

30 NOAA has the most projects: 26 Web Player

31 https://www.wilsoncenter.org/person/anne-bowser

32 http://wilsoncommonslab.org/inventory/

33 https://www.wilsoncenter.org/article/ppsr-core-metadata-standards Goal: International network of citizen science data

34 34 https://inventory.cartodb.com/sessions/create

35 35 https://inventory.cartodb.com/dashboard/

36 36 https://inventory.cartodb.com/tables/database_federal_citizen_science/map

37 37 https://inventory.cartodb.com/tables/database_federal_citizen_science

38 38 https://inventory.cartodb.com/viz/a03a58b6-2488-11e5-8f29-0e4fddd5de28/table

39 39 https://inventory.cartodb.com/dashboard/datasets

40 Agenda 6:30 p.m. Welcome and Introduction (New Tutorial and Mentoring) Slides Data Science for Joint DoctrineData Science for Joint Doctrine 6:45 p.m. Brief Member Introductions 7:00 p.m. Chuck Rehberg, CTO and and Dave Decker, Semantic Insights, Steve Hambry, VP Product Development, Securboration, and Barry Smith, Distinguished Professor, and Director, National Center for Ontological Research, SUNY BuffaloSemantic InsightsSecurborationBarry Smith 8:30 p.m. Open Discussion 8:45 p.m. Networking 9:00 p.m. Depart 40


Download ppt "Data Science and Semantic Insights for DoD Joint Doctrine Meetup Dr. Brand Niemann Founder and Co-Organizer Federal Big Data Working Group Meetup Director."

Similar presentations


Ads by Google