NCOIC Geospatial Interoperability Task Team Presentation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.

Slides:



Advertisements
Similar presentations
Life Science Services and Solutions
Advertisements

Building an Operational Enterprise Architecture and Service Oriented Architecture Best Practices Presented by: Ajay Budhraja Copyright 2006 Ajay Budhraja,
New technologies and disaster information resources Part 2. The right information, at the right time, the right way.
Virtual SharePoint Summit 2010 hosted by Rackspace Overcoming Collaboration Challenges with SharePoint Chris Samson Leslie Sistla Virtual SharePoint Summit.
A Java Architecture for the Internet of Things Noel Poore, Architect Pete St. Pierre, Product Manager Java Platform Group, Internet of Things September.
The FI-WARE Project – Base Platform for Future Service Infrastructures OCTOBER 2011 Presentation at proposers day.
Dynamic Case Management for Military and Intelligence Departments Can Improve Their Enterprise Architecture Programs Dr. Brand Niemann Director and Senior.
© 2006 IBM Corporation IBM Software Group Relevance of Service Orientated Architecture to an Academic Infrastructure Gareth Greenwood, e-learning Evangelist,
SOA with Progress Philipp Walther Consultant. © 2007 Progress Software Corporation2 Agenda  SOA  Enterprise Service Bus (ESB)  The Progress SOA Portfolio.
Chapter Two Information Technologies: Concepts and Management.
Build Systems of Systems in the Cloud: Tutorial Brand Niemann Director and Senior Data Scientist Semantic Community November 9,
Thee-Framework for Education & Research The e-Framework for Education & Research an Overview TEN Competence, Jan 2007 Bill Olivier,
Cloud computing Tahani aljehani.
David Besemer, CTO On Demand Data Integration with Data Virtualization.
OMB Data Visualization Tool Requirements Analysis: Microsoft Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
CLOUD COMPUTING. A general term for anything that involves delivering hosted services over the Internet. And Cloud is referred to the hardware and software.
Big Data and Social Media & Web Analytics Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Getting Smarter with Information An Information Agenda Approach
Clouds on IT horizon Faculty of Maritime Studies University of Rijeka Sanja Mohorovičić INFuture 2009, Zagreb, 5 November 2009.
“ Does Cloud Computing Offer a Viable Option for the Control of Statistical Data: How Safe Are Clouds” Federal Committee for Statistical Methodology (FCSM)
Effectively Explaining the Cloud to Your Colleagues.
3 Cloud Computing.
1 Semantic Cloud Computing & Open Linked Data Pattern Brand Niemann Invited Expert to the NCIOC SCOPE and Services WGs September 22, 2009.
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
Information Sharing Begins With Me Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
What is Enterprise Architecture?
EXPECTATIONS OF TURKISH ENVIRONMENTAL SECTOR FROM INSPIRE Ministry of Environment and Forestry June, 2010 Özlem ESENGİN Ahmet ÇİVİ Tuncay DEMİR.
CIS 375—Web App Dev II Microsoft’s.NET. 2 Introduction to.NET Steve Ballmer (January 2000): Steve Ballmer "Delivering an Internet-based platform of Next.
Big Data Symposium: Analytics and Applications for Federal Big Data - FEMA Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
Esri UC 2015 | Technical Workshop | Land Records Maps and Apps for State and Local Governments Chris Buscaglia Scott Oppmann.
Presentation Outline (hidden slide) Technical Level: 100 Intended Audience: TDMs, ITPros, ITDMs, BI specialists Objectives (what do you want the audience.
material assembled from the web pages at
Cloud Computing & Amazon Web Services – EC2 Arpita Patel Software Engineer.
NCOIC Geospatial Interoperability Task Team Presentation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.
Data Science for DTIC Data Ecosystem Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
The 2012 EuroStat Regional Yearbook for Semantic Interoperability Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Cloud Use Cases, Required Standards, and Roadmaps Excerpts From Cloud Computing Use Cases White Paper
Delivering business value through Context Driven Content Management Karsten Fogh Ho-Lanng, CTO.
Open DATA METI: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
NCOIC-NGA Demonstration of Demonstrations Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
2009 Federal IT Summit Cloud Computing Breakout October 28, 2009.
1 Geospatial and Business Intelligence Jean-Sébastien Turcotte Executive VP San Francisco - April 2007 Streamlining web mapping applications.
Department of Commerce App Challenge: Big Data Dashboards Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.
Catawba County Board of Commissioners Retreat June 11, 2007 It is a great time to be an innovator 2007 Technology Strategic Plan *
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Cross Information Sharing and Integration for the Intelligence Community: 13 th SOA for eGovernment Conference Dr. Brand Niemann Director and Senior Enterprise.
NIEM 3.0 Data Analytics App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger.
Enterprise Cloud Computing
DOCUMENT #:GSC15-PLEN-82r2 FOR:Presentation SOURCE:ATIS AGENDA ITEM: PLEN 6.14 CONTACT(S): Andrew White ATIS’
Digital Libraries1 David Rashty. Digital Libraries2 “A library is an arsenal of liberty” Anonymous.
Government and Industry IT: one vision, one community Vice Chairs April Meeting Agenda Welcome and Introductions GAPs welcome meeting with ACT Board (John.
3/12/2013Computer Engg, IIT(BHU)1 CLOUD COMPUTING-1.
CISC 849 : Applications in Fintech Namami Shukla Dept of Computer & Information Sciences University of Delaware A Cloud Computing Methodology Study of.
Information Systems in Organizations 5.2 Cloud Computing.
Welcome!. State of the company Community Today’s new currency DataFlex, VRW & DAI An invitation The year ahead.
Service Oriented Architecture Enabling the Agile and Flexible Business of the 21 st Century.
Leadership Guide for Strategic Information Management Leadership Guide for Strategic Information Management for State DOTs NCHRP Project Information.
Cloud Computing 3. TECHNOLOGY GUIDE 3: Cloud Computing 2 Copyright John Wiley & Sons Canada.
WMO WIS strategy – Life cycle data management WIS strategy – Life cycle data management Matteo Dell’Acqua.
Lecture 6: Cloud Computing
Data Platform and Analytics Foundational Training
Brand Niemann, US EPA and
Chapter 18 MobileApp Design
Introduction to Cloud Computing
Yellowfin: An Azure-Compatible Business Intelligence Platform That Connects People with Their Data for Better Decision Making MICROSOFT AZURE APP BUILDER.
WIS Strategy – WIS 2.0 Submitted by: Matteo Dell’Acqua(CBS) (Doc 5b)
Cloud Consulting Services and Solutions
Presentation transcript:

NCOIC Geospatial Interoperability Task Team Presentation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community AOL Government Blogger March 9 and 12, It is not just where you put your data (cloud), but how you put it there!

Recent Activities SCOPE: – NCOIC-NGA Demo Director Long’s Questions and Answers - Five Apps That Address Those Questions and Answers – Done Several! – Federation of SOAs (and ESBs) First Meeting of the NCOIC Federated SOA WG and Gen D'hollander's Activity Proposal Possible SCOPE Workshop with NATO C3 to Understand Requirements for Federation of SOAs Apps: – NATO Disaster Relief Use Cases Knowledgebase Case Management – RSOE Emergency and Disaster Information Service, Budapest, Hungary Knowledgebase Case Management 2 Credit to Roger Bernhardt (Boeing): For making me aware of the great RSOE EDIS resource. RSOE EDIS is a Federated SOA (of Web Services, RSS Feeds, etc.)!

Roger Bernhardt (Boeing) I believe that I would like to consider the use of Case Management to perform the OIA. A high level case would be created for the disaster plan. The actual adaptations of the plan to the disaster as it’s scope and scale are revealed would populate sub-cases, allowing a Response Manager to “game” the response as needed as things evolve, allowing them to see where decisions might go awry as things like transportation system constraints bring themselves to bear on the situation. – Sound good! A question becomes, will your offering make available the tools needed to do this or am I obliged to subcontract to achieve this? Implementation can be done by you in the form of requested capabilities, maybe? – Yes and Yes. I talked with Supriya today and he sounds on board with the loose coalition where he would work the medical data primarily, medical services and impact assessment in that order of priority. – I would like to see his medical data. I wonder if we should identify a Wiki or Sharepoint section for collaboration on the NCOIC site. Is that possible? – I would ask Tim Thomas. I have my own Wiki that I use. 3

GEOINT VISIONARY: Strengthening Analysis and Making Content More Accessible Selected Excerpts: – Q: In your recent remarks to the GEOINT 2011 Symposium, you addressed what had happened in the year since you outlined your vision of “Putting the Power of GEOINT in your hands.” How would you sum up your conclusions on what you have seen so far? A: Taken together, the strategic initiatives will ensure our content is discoverable and accessible through an open IT environment, allowing GEOINT users—inside and outside of NGA—to operate in a self-, assisted- and full-service environment and enabling analysts to do deeper and richer analysis. – Q: Your address devoted a considerable amount of time to demonstrating some of the new mobile apps being developed by NGA. How would you characterize progress in that area? A: This is an area that has a great deal of growth potential. We’ve had great initial success with our application in support of the homeland security/domestic disaster support mission, sometimes building them on the fly in response to our analysts observing operations in the field. In addition, in support of our safety of navigation mission, we are delivering a mobile device-enabled set of air navigation aids, helping to streamline our processes, get updated information to the user faster and reduce paper product generation. 4

GEOINT VISIONARY: Strengthening Analysis and Making Content More Accessible Selected Excerpts: – Q: Your 2010 vision also included a call for deepening analytic expertise. What do you see as the key accomplishments and challenges in that area? A: Building and deepening analytic expertise is a top priority. A key goal of the vision is to provide an analytic environment where analysts spend their time doing analysis and not waste their time looking for data, or building spreadsheets, or signing onto multiple systems. – Q: What do you see as NGA’s greatest challenges? NGA’s traditional order-entry processes and supply chain model are outdated, and we are working to adapt our role from a legacy producer of product to a broader role as a GEOINT service and application provider that enables end-users to configure GEOINT according to the needs of specific users, particularly in the expanding mission areas of homeland security and disaster relief. – Q: What do you see as the agency’s most significant steps in the past year in using commercial imagery, and where do you see that going in the future? These new products provide the U.S. government and our coalition partners a high quality current image foundation built to Open Geospatial Consortium standards and available via web services. 5

Federation of SOAs (and ESBs) First Meeting of the NCOIC Federated SOA WG and Gen D'hollander's Activity Proposal – See next slide. Possible SCOPE Workshop with NATO C3 to Understand Requirements for Federation of SOAs – Discussed at SCOPE Meeting this week. 13 th SOA for Government Conference, April 3 rd – See My Blog and Earlier Best Practice by Arun Majumdar (Cutter Consortium/VivoMind Intelligence) 6

Key Points (from Gen. D’hollander’s Letter) Future NATO operations will require all coalition partners to have plug and play interoperable C4ISR Capabilities. NATO and the Nations are realizing the NNEC Vision by implementing their C4ISR Capabilities with a Service Oriented Architecture (SOA) approach. At the centre of the architectural framework are the Core Enterprise Services (CES). These are commonly available in Enterprise Service Bus (ESB) offerings by Industry. There is no common definition in Industry of what services an ESB provides. There is no common agreement in Industry on what interoperability standards an ESB should support. There is no common agreement in Industry of what architectural patterns a Federated ESB implementation should support. 7 Source: Martin Schmidt Slides and Paper for NCOIC Plenary EC/AC, March 1st, 2012.

13 th SOA for Government Conference, April 3 rd Federal SOA CoP Using All These Options: – Replace all the Proprietary ESB’s with an Open Source One (e.g., Progressive Software at the FAA) – Use an Open Source ESB to Federate All the Proprietary ESBs or Open Source ESBs (MITRE SOA Lab) – Develop Shared Services (SOA) (Federal CIO Council) – Use a Systems of Systems Approach to Federate Content with a WOA Platform & Case Management (Current Pilot) – Free the Data and Use “Cloud Layers” (Current Pilot) – Use Ontology for Federation and Integration of Systems (Past Best Practice and Next Pilot) 8

Key Goals of Federal Shared Service Plan (Looks Like SOA) Standardization: “Shared service providers must leverage consistent standards that streamline functions across the Federal Government. This enables communication, data sharing and function use across all agencies. It eliminates the use of decentralized and inconsistent resources to create new, unique solutions throughout agencies in response to a single set of Federal requirements. Visibility: “A government-wide shared services catalog helps agencies discover the wide array of available services. This enhances the potential for service integration as some agencies will develop shared services for those functions not already being provided. Reusability: “Shared services harness a way to support duplicated agency functions throughout the mission areas. This reduces the potential for development and maintenance costs by using repeatable services.” Platform independence: “Agencies no longer need to worry about integrating with their current platforms in- house. Shared services providers ensure a stable infrastructure and can manage systems changes and updates within a controlled environment.” Extensibility: “The basic shared services of a provider can be used as building blocks for other services that consumer agencies need. Services can be scaled up or down, based on demand.” Location transparency: “Users of shared services access the services from anywhere within the shared service network. This increases availability and end user access to strengthen SLAs between the provider and the services consumer.” Reliability: “Services provided are robust and stable with service continuity capabilities to minimize critical system outages to levels established by SLAs.” My Note: Shared services could be replaced with SOA in every one of those 7 points – while the word shared may be more appealing from the political and cost savings point of view, the reality from our experience is that initially good architecture and more investment are need to make it work and the new plan does not really provide for that and leaves the impression that it is easy to do if someone would just do it, but it takes real work like we have been doing over the past 6 years or so. So our agenda for the 13th conference features the real practitioners. 9

Use a Systems of Systems Approach to Federate Content with a WOA Platform & Case Management 10

Use a Systems of Systems Approach to Federate Content with a WOA Platform & Case Management 11 S Semantic Index of Linked Data (e.g. Excel) Dynamic Case Management (e.g. Be Informed) Data Science Library (e.g. Spotfire) Data Science Products (e.g. Spotfire) Our Mantra is: Data Science Precedes the Use of SOA, Cloud, and Semantic Technologies! Our Mission is like Googles: Organize the world’s information and make it universally accessible and useful. Our Method is like Be Informed 4: Architectural Diagrams and Questions and Answers are not enough, you need Dynamic Case Management! Our Purpose: To "ground" the NCOIC-NGA Pilot in the NCOIC Deliverables by building a database of those deliverables that is displayed and used in a Dashboard.

“Cloud Layers” Software-as-a-Service (SWaaS): – NIST: The consumer is free of any worries and hassles related to the service. Example: Salesforce Platform-as-a-Service (PaaS): – NIST: Develops, tests, deploys and manages applications hosted in a cloud environment. Example: Azure Infrastructure-as-a-Service (IaaS): – NIST: Virtual computers, cloud storage, network infrastructure components such as firewalls and configuration services. Example: Amazon Security-as-a-Service (SCaaS): – Gus Hunt, CIA CTO, March 6, Example: SonicWall Data-as-a-Service (DaaS): – Gus Hunt, CIA CTO, March 6, Example: Cloudera 12 Sources: andhttp://

Ontology for Federation and Integration of Systems Cory Casanave: What are the special capabilities ontologies have to offer for federation and integration that are not served by more traditional federation and integrations approaches such as ETL, SOA, Event Systems, etc? Eric Little: They often work in conjunction. I currently have a client in the medical device industry, for whom we have built a very large semantic integration system which runs in a private cloud computing system at their facility. In short it is not like one should ever conceive of having an ontology do all of those things. The semantics provide the common vocabulary and set of integrated models, the logics/reasoner run over them in the form of queries, rules, autoclassifications, etc., the cloud provides the hardware, provisioning and computational horsepower to perform functions over large data graphs, the SOA layers provide means to move information to other technologies within the cloud, etc. Kate Goodier: I also find that in applying ontology and semantics to solving federation issues, the solution always involves a combined approach. My Note: See complete discussion at URL below. 13

How Would I Build a New App? Goal: NATO Disaster Relief Use Cases Activities: – Use Previous NATO Disaster Response Knowledgebase – Build Knowledgebase of NATO Disaster Response Operations – Federate the Distributed Knowledgebases for Analytics and Semantics 14

Use Previous NATO Disaster Response Knowledgebase 15 Web Player The NGIA and NATO have questions about responding to new disasters, so they consult their knowledgbases of unstructured, structured, and complex data that have been provisioned, integrated, and visualized in this app. The question is how have we responded to previous disasters?

Build Knowledgebase of NATO Disaster Response Operations 16 Note: This WOA Platform Supports the New Sitemap and Schema Protocols.

Knowledgebase Indices in a Spreadsheet 17 Note: Only 7 maps See next slide.

15.8. Helping Ukraine cope with flooding 18 Question: What kind of maps would NGA provide for this disaster?

Some Next Steps Options: – Semantic Insights Research Assistant (SIRA): Convert all the PDF files to text for use Web Browser search and in SIRA to build simple reports and actual ontologies. Use all the PDF files as attachments for the SIRA Corpus to build simple reports and actual ontologies. – Spreadsheet: Knowledgebase indices directly to a spreadsheet DONE Add additional columns for multiple documents and location (country and city) DONE Show facets for Top Secret, Secret, and Confidential – Basemaps: Boundary (Shape), Image (Google), and NATO (Various Sub-country) DONE – Analytics: Copy Europe Life Expectancy Tab and Replace Data Set with NATO Disaster Relief Operations Data Set. DONE – Case Management: Use Be Informed’s Four Metamodels* (Case Management, Products and Decisions, Interaction, and Registration*) Federate Across NGA, NCOIC, DoD, VA, FAA, etc. Metamodels 19 *

NATO Disaster Response Operations Dashboard 20 Web Player

Design Principles of Federal Shared Services Strategy Benefits: – Standardization Uses Sitemap and Schema Protocols and a Web Oriented Architecture – Visibility Puts GEOINT in hands of users – Reusability Reuses content provides reusable content – Platform Independence Exports standard data formats – Extensibility Amazon Cloud is elastic – Location Transparency Amazon Cloud with SLAs – Reliability Amazon Cloud with SLAs Components: – 1 Requirements Director Long’s statements – 2 Workflow Steps for Building An App – 3 Data Exchange Federate with WOA and Dynamic Case Management – 4 Applications More functionality and data exchange than current systems – 5 Hosting Amazon Cloud’s SLAs – 6 Security and Privacy Amazon Cloud’s SLAs 21 Goal: Built Shared Services App That Meets or Exceeds These Benefits and Components

How Would I Build a New App? Goal: RSOE Emergency and Disaster Information Service, Budapest, Hungary Activities: – Inventory Assets* – Build Knowledgebases of Global Disaster Response Operations – Federate the Distributed Knowledgebases for Analytics and Semantics 22 * Note: Waiting to see if actual data sets are available.

RSOE Emergency and Disaster Information Service, Budapest, Hungary The Hungarian National Association of Radio Distress-Signalling and Infocommunications (RSOE) operates Emergency and Disaster Information Service (EDIS) within the frame of its own website which has the objective to monitor and document all the events on the Earth which may cause disaster or emergency. Our service is using the speed and the data spectrum of the internet to gather information. We are monitoring and processing several foreign organisation's data to get quick and certified information. The EDIS website operated together by the General-Directorate of National Disaster Management (OKF) and RSOE, in co-operation with the Crisis Management Centre of the Ministry of Foreign Affairs, provides useful information regarding emergency situations and their prevention. Extraordinary events happening in Hungary, Europe and other areas of the World are being monitored in 24 hours per day. All events processed by RSOE EDIS are displayed near real time - for the sake of international compatibility - according to the CAP protocol on a secure website ( To ensure clear transparency all events are categorized separately in the RSS, XML, CAP directory (e.g. earthquake, fire, flood, landslide, nuclear event, tornado, vulcano). RSOE EDIS also contributes in dissemination of the CAP protocol in Hungary. Beside the official information, with the help of special programs nearly internet press publications will be monitored and the publication containing predefined keywords will be processed. However, these "news" cannot be considered as official and reliable information, but many times we have learnt critical information from the internet press. We are screening the incoming information and storing in a central database sorted by category. Prepared Citizens – Prepared Communities 23

RSOE Emergency and Disaster Information Service, Budapest, Hungary 24

RSOE Emergency and Disaster Information Service, Budapest, Hungary Current Emergencies Short Time Events Long Time or Rolling Event(s) Mass Death of Animals Tsunami Information Earthquake (s) Volcano Activity Report (Last 30 days) Active Tropical Storm System (s) Supervolcanoes Monitoring System Earth Approaching Object (objects that are Known in the next 30 days) 25

Current Emergencies and Short Time Events 26 Links: See Next Slides

Earthquake: Valle Orsara, Italy 27

Earthquake: Valle Orsara, Italy 28

Epidemic Hazard: State of Maryland 29

Long Time or Rolling Event(s), Mass Death of Animals, and Tsunami Information 30

Earthquake (s) 31

Volcano Activity Report (Last 30 days) 32

Active Tropical Storm System (s) and Supervolcanoes Monitoring System 33

Earth Approaching Object (objects that are Known in the next 30 days) 34

Excerpts from OntoApp Intro Session K March 8, 2011 NCOIC Outbrief on Plenary and Update on New Activities by Carl Schwab, NCOIC Executive Director, March 9 th : – Mobile Apps needed ASAP was a recurring theme. Rob Kruse, FacetApp is offering training on developing Semantic Enterprise Apps, at a special price for NCOIC members. For details contact Rob at 35

Solution Strategy 36

OntoApp App Platform 37

Build Semantic Enterprise Apps Faster 38

Inference Engine Landscape 39

Deliver Powerful Apps Faster 40

OntoApp Intro Session K 41 What does the green mean?

OntoApp Intro Session K 42

Acord 43

Acord 44

Acord 45

Acord 46

OntoApp Intro Session K 47

SURF Incubator 48