Mashing Up Linked Open Government Data Li Ding Tetherless World Constellation Rensselaer Polytechnic Institute Nov 8, 2010

2 LOGD Application UI TWC LOGD data.gov.uk dbpedia W W W SPARQL Query SPARQL Results Format Data JSONXMLCSV Visualize DataQuery DataIntegrate Data LOGD Consumption Workflow

3 Query Data: SPARQL-based Data Mashup LOGD data dump file 1LOGD data dump file 2 SPARQL Endpoint RDF Dataset 1 obj RDF Dataset 2 obj same value load SELECT ?x ?y WHERE { graph { ?x ?obj } graph { ?y ?obj } } query

4 Format Data google.visualization.Query.setResponse({version:0.6,status:'ok',reqId:0,table:{cols:[{id:'g',label:'g',type:'string'},{id:'number_of_triples',label:'nu mber_of_triples',type:'number'}],rows:[ {c:[{v:' {c:[{v:' {c:[{v:' …. gov.tw.rpi.edu/vocab/Dataset_ ….. g Number of_triples SPARQL/XML JSON (Google Viz) HTML Table

5 Data-gov Site LOD Cache TWC Site LOGD Data Triple Store LOGD site Synchronize Query Load Query Integrate & Visualize Data

6 Types of Mashups Aspects –Data Mashup –Visualization Mashup –Application Mashup Subject –Temporal Mashup –Spatial Mashup –Entity Mashup –… Other topics –Social mashup –Provenance –Search

7 US and UK Foreign AID FY2007: Integrating data from two countries AIDMajor aids from USMajor aids from UK BrazilUS >UKDevelopment AssistanceGov & civil society, Economic IndiaUK > USChild Survival and HealthHealth, Economic Created by James Michaelis, RPI, Data Sources: [Spatial Mashup] Data.gov (USAID) + Data.gov.uk (DFID)

8 Gov Data for Pop Science: Integrating different sources for discovery Created by Sarah Magidson, U. Chicago. [Spatial Mashup] Data.gov (Population) + NIH (Tobacco Tax, Smoking rate) Gov data provides knowledge for poplation science study

9 XHTML+RDFa ARC2 Data-gov Semantic Search HTML RDFa Web Search Results RDF Annotation Consume LOGD data in Semantic Search

10 Adding Social Factor to Mashups RDF Publish* Enhance* User Raw Data consume* feedback Import socially contributed data, e.g. DBpedia Let users contribute –links –feedbacks Other Social Web Apps Import/export

11 Social Mashup - US Wildland Fire: Linking to Wikipedia (socially contributed) Wildland fire (NIFC) Budget on wildfire DOI and USDA (OMB) Category:Wildfires In The United States Created by Li Ding, RPI, [Temporal Mashup] Data.gov (statistics+ budget) + Wikipedia (famous fires)

12 Social Mashup - White House Visitor Search: Linking social network data using semantic wiki POTUS dbpedia:Barack_Obama Created by Dominic DiFranzo, Evan Patton, RPI, [Person Mashup] Data.gov (statistics) + Wikipedia (personal profiles) The White House Semantic Wiki Wikipedia NYTimes

13 Social Mashup: USPS Spending and News government data + User Feedbacks Created by Sarah Magidson, [Temporal Mashup] Data.gov (budget) + USPS + User Contributed News

14 Using Web Tools Information networks can be integrated via the Semantic Wiki and visualized a number of different ways: social networks, human- language technology, workflows, …

(a) white house visitor search (e) [Health] Tobacco Prevalence and Correlated Factors (h) [Yahoo! Pipes] World Earthquake Map (b) US-UK Foreign Aid Comparison (c) Agency Budget and NYTimes (d) Wildland fire and DBpedia (f) [Policy] About Supreme Court Justices (k) [RSS] data.gov updates (i) [IBM ManyEyes] white house visitor network (g) [Financial] Stock price and Twitter events (j) [RDFa] semantic search (d) Wildland fire and DBpedia More Mashups

16 Resources Online Tutorials –Mashing up LOGD data with SPARQLMashing up LOGD data with SPARQL –Retrieving SPARQL ResultsRetrieving SPARQL Results –Building LOGD VisualizationsBuilding LOGD Visualizations Standards and Tools –SPARQL Endpoint –SparqlProxy Visualization APIs –Google Visualization API –MIT SIMILE Exhibit Language (name it): Javascript, PHP, Python,…