Surveillance, Events and the Semantic Web From E-Gov to Connected Governance: the Role of Cloud Computing, Web 2.0 and Web 3.0 Semantic Technologies Washington, D.C., February 17, 2009 Dr. Nancy Grady

Energy | Environment | National Security | Health | Critical Infrastructure 2 Overview Surveillance Event models Emerging Web technologies Putting it all together

Energy | Environment | National Security | Health | Critical Infrastructure 3 Surveillance The process of active data-gathering with appropriate analysis and interpretation in order to achieve – Early warning of threats – Early warning of events – Results of analysis – Overall situational awareness Communication to stakeholders of – Events – Investigations – Conclusions

Energy | Environment | National Security | Health | Critical Infrastructure 4 Surveillance Mining for actionable intelligence Traditional surveillance – Look for anomalous activity in sensor data – Fuse primary or secondary data sources – Federated datasets New surveillance for “events” – Harvest Web-based information – Exchange event data with other agencies

Energy | Environment | National Security | Health | Critical Infrastructure 5 Conceptual Architecture 5 National Biosurveillance Integration System /6/2015 Wiki Collection Preparation and Modeling EvaluationDeployment Analysis Collaboration Workflow Extract, Transform, Load (ETL) Analysis Users Situational Awareness Reports, Notes, Products, Papers,... Web Service, RSS, SFTP, , Browser,... PDF,.doc,.xls..html Extraction Categorization Natural Language Processing Natural Language Processing Geospatial Analysis Geospatial Analysis Semantic Query Integration Structured, Unstructured, and Metadata Semantically Integrated Information Open Source Data Feeds

Energy | Environment | National Security | Health | Critical Infrastructure 6 Overview Surveillance Event models Emerging Web technologies Putting it all together

Energy | Environment | National Security | Health | Critical Infrastructure 7 Events Are the Output of Surveillance Who What Where When How How many Why

Energy | Environment | National Security | Health | Critical Infrastructure 8 Exchanging Events Situational awareness is communicating significant events Easier to collaborate around events than primary/secondary data – Privacy – Bandwidth – “Local” expertise on data – Existing surveillance systems tuned to data Open source (or intelligence) will be about events

Energy | Environment | National Security | Health | Critical Infrastructure 9 Event Representation Prose Spreadsheets Relational database Relationship database (ontology) Semantic Web

Energy | Environment | National Security | Health | Critical Infrastructure 10 Event - Spreadsheet Model Subspecies Subdistrict Number Destroyed Country Report Date Location Age District Onset Latitude Longitude Number Of Deaths Number Of Cases Species Gender Case Human Avian Human/ Avian Legend:

Energy | Environment | National Security | Health | Critical Infrastructure 11 Relationship (Ontological) Model Event Human Time Span Region Value Virus Winter Avian Flu Case151 Person151 object Dogubeyazit Village occursAt Dogubeyazit Turkey Northern Hemisphere SpatialPartOf Jan 05, 2006 dateReported Female 14 Has Gender Has Age Death D151 Jan 05, 2006 occursOn Hospitalization H151 object Jan 01, 2006 occursOn H5N1 Influenza Disease diseaseType SpatialPartOf Death Human Host type Legend:

Energy | Environment | National Security | Health | Critical Infrastructure 12 Comparisons Prose is difficult to track and query Spreadsheets are easy but limited Relational databases are more familiar to developers and easier to aggregate Ontologies are easier for queries using context and offer better scalability to many datasets Semantic Web better for interoperability and flexibility, not as good for contextual queries, good for tagging within prose

Energy | Environment | National Security | Health | Critical Infrastructure 13 Maturing an Event Model Source descriptions – Veracity Analytical pedigree – Preparation and analytical techniques Community standards – Codes and representations Spatial extent descriptions

Energy | Environment | National Security | Health | Critical Infrastructure 14 Overview Surveillance Event models Emerging Web technologies Putting it all together

Energy | Environment | National Security | Health | Critical Infrastructure 15 Web (1.0, 2.0, 3.0) Content 1) Brochureware 2) Social networking 3) Semantic Web … data. Search 1) PageRank prioritization 2) Influencers 3) Semantic searches Software 1) HTML* and CSS**, XML*** 2) Wikis, blogs, tag clouds 3) Services for data exchange Hardware 1) Servers 2) Server farms 3) Cloud computing *HTML = Extensible HyperText Markup Language **CSS = Cascading Style Sheets ***XML = eXtended Markup Language

Energy | Environment | National Security | Health | Critical Infrastructure 16 Cloud Computing Benefits Economies of scale to fit surveillance scope Handles surge capacity for breaking news or deep dives Opens up large-scale enterprise services to small projects that could not afford their own enterprise scale resources Opens new low-risk experiment and prototype areas Allows IT to integrate faster and be more responsive Cost reductions Redundancy

Energy | Environment | National Security | Health | Critical Infrastructure 17 Mobile Platforms Smart phones Consumer readers Business readers

Energy | Environment | National Security | Health | Critical Infrastructure 18 Overview Surveillance Event models Emerging Web technologies Putting it all together

Energy | Environment | National Security | Health | Critical Infrastructure 19 Information Needs Understanding what external information exists (about your organization and mission) Aggregating, integrating and analyzing all external information that directly impacts an internal project Identifying, aggregating and integrating documents as part of a large-scale document management system

Energy | Environment | National Security | Health | Critical Infrastructure 20 Analyst Needs to Harvest Open Source Information Search engines are not enough Filter and triage information for analysts Integrate internal and external data Collaborative environment for knowledge workers Store analysis and vetted results Tracking of events Situational awareness reporting Dissemination to a mobile workforce

Energy | Environment | National Security | Health | Critical Infrastructure 21 All Source Analytic Framework (ASAF) Correspondence: