An Open Source GIS Architecture Connected and Linked Data

Slides:



Advertisements
Similar presentations
CH-4 Ontologies, Querying and Data Integration. Introduction to RDF(S) RDF stands for Resource Description Framework. RDF is a standard for describing.
Advertisements

University of Illinois Visualizing Text Loretta Auvil UIUC February 25, 2011.
1 1 File Systems and Databases. 1 1 Introducing the Database 4Major Database Concepts u Data and information l Data - Raw facts l Information - Processed.
Visibility Information Exchange Web System. Source Data Import Source Data Validation Database Rules Program Logic Storage RetrievalPresentation AnalysisInterpretation.
Building and Analyzing Social Networks Web Data and Semantics in Social Network Applications Dr. Bhavani Thuraisingham February 15, 2013.
GI Systems and Science January 30, Points to Cover  Recap of what we covered so far  A concept of database Database Management System (DBMS) 
NOSQL Graph Database and Neo4j Presented by: Zuping Li Xiaoxiao Jiang Peter Neubauer on May 12, 2010.
Enterprise Architecture for Delivering Spatial and Tabular Data and Associated Documents to Managers and Field Personnel Bill Slocumb GIS Professional.
ArcGIS Geodatabase Miles Logsdon Spatial Information Technologies, UW Garry Trudeau - Doonesbury.
©Ian Sommerville 2006Software Engineering, 8th edition. Chapter 8 Slide 1 System models.
Chapter 9 DATA WAREHOUSING Transparencies © Pearson Education Limited 1995, 2005.
Geographic Information Systems
DATA WAREHOUSING.
DASHBOARDS Dashboard provides the managers with exactly the information they need in the correct format at the correct time. BI systems are the foundation.
RIZWAN REHMAN, CCS, DU. Advantages of ORDBMSs  The main advantages of extending the relational data model come from reuse and sharing.  Reuse comes.
1 Semantic Data Management Xavier Lopez, Ph.D., Director, Spatial & Semantic Technologies.
IBM User Technology March 2004 | Dynamic Navigation in DITA © 2004 IBM Corporation Dynamic Navigation in DITA Erik Hennum and Robert Anderson.
NSF DUE ; Laura Johnson Cherie Aukland.
Internet GIS. A vast network connecting computers throughout the world Computers on the Internet are physically connected Computers on the Internet use.
A Study in NoSQL & Distributed Database Systems John Hawkins.
Database Management System Lecture 2 Introduction to Database management.
1 Web Database Processing. Web Database Applications Static Report Publishing a report is prepared from a database application and exported to HTML DB.
2 1 Chapter 2 Data Model Database Systems: Design, Implementation, and Management, Sixth Edition, Rob and Coronel.
Michalis Vafopoulos NTUA, GFOSS & The transformers GREEN CITY HACKATHON.
GRITS Working with AVM Data Astronomy Visualization Metadata June 11th, 2010 Casey Rosenthal
Chapter 4 System Models A description of the various models that can be used to specify software systems.
System models Abstract descriptions of systems whose requirements are being analysed Abstract descriptions of systems whose requirements are being analysed.
1 SWAD Europe Storage and Retrieval Workshop Dave Beckett.
Database Design - Lecture 2
Client – Server Architecture. Client Server Architecture A network architecture in which each computer or process on the network is either a client or.
Daniel J. Abadi · Adam Marcus · Samuel R. Madden ·Kate Hollenbach Presenter: Vishnu Prathish Date: Oct 1 st 2013 CS 848 – Information Integration on the.
Chapter 7 System models.
System models l Abstract descriptions of systems whose requirements are being analysed.
Semantic Web Technologies Research Topics and Projects discussion Brief Readings Discussion Research Presentations.
Grid Computing & Semantic Web. Grid Computing Proposed with the idea of electric power grid; Aims at integrating large-scale (global scale) computing.
Forms and Subforms 5.02 Understand database queries, forms, and reports used in business.
Nhóm thực hiện: nhóm 1 Nguyễn Ngọc Trường Trần Minh Khang Bùi Quốc Huy Nguyễn Ngọc Linh Nguyễn Thành Phương Trần.
Introduction to the Semantic Web and Linked Data
Intro to GIS | Summer 2012 Attribute Tables – Part 1.
Scalable Hybrid Keyword Search on Distributed Database Jungkee Kim Florida State University Community Grids Laboratory, Indiana University Workshop on.
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
Project-Haystack: A community-driven solution to make device data easy to use Making data self-describing so applications just work Wednesday July 22,
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
IoT Meets Big Data Standardization Considerations
A Portrait of the Semantic Web in Action Jeff Heflin and James Hendler IEEE Intelligent Systems December 6, 2010 Hyewon Lim.
Client – Server Architecture A Basic Introduction 1.
NoSQL: Graph Databases. Databases Why NoSQL Databases?
 To explain why the context of a system should be modelled as part of the RE process  To describe behavioural modelling, data modelling and object modelling.
Technology Drill Down: Windows Azure Platform Eric Nelson | ISV Application Architect | Microsoft UK |
Database Overview What is a database? What types of databases are there? How are databases more powerful than spreadsheets?
The ECOST Web-based platform for data providers and for data users.
Graph Database - Neo4j ISQS3358, Spring Graph Database A graph database is a database that uses graph structures for semantic queries with nodes,
Data Models. 2 The Importance of Data Models Data models –Relatively simple representations, usually graphical, of complex real-world data structures.
1 © 2013 Cengage Learning. All Rights Reserved. This edition is intended for use outside of the U.S. only, with content that may be different from the.
XML and Distributed Applications By Quddus Chong Presentation for CS551 – Fall 2001.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
Added Value to XForms by Web Services Supporting XML Protocols Elina Vartiainen Timo-Pekka Viljamaa T Research Seminar on Digital Media Autumn.
Engineering, 7th edition. Chapter 8 Slide 1 System models.
Neo4j: GRAPH DATABASE 27 March, 2017
Every Good Graph Starts With
Geographic Information Systems
Analyzing and Securing Social Networks
Logical Data Warehousing and Tableau 10
5.02 Understand database queries, forms, and reports used in business.
Jena HBase: A Distributed, Scalable, Efficient RDF Triple Store
Daniel Alvarez BMW Research, New Technologies, Innovations
Jena HBase: A Distributed, Scalable, Efficient RDF Triple Store
Storing and Processing Sensor Networks Data in Public Clouds
Demo for Partners and Customers
Mulesoft Anypoint Connector for AS/400 and Web Transaction Framework
Presentation transcript:

An Open Source GIS Architecture Connected and Linked Data for Connected and Linked Data Jerry Hayes Frank Hardisty (Advisor)

Connected Data in GIS Today Many use cases in GIS Creates logical model to represent topology. Storage of logical model is not optimal. Problem: Relational database abstraction impedes performance and scalability.

Linked Data in GIS Today Links described by semantic relationships. Semantics enable data discovery. Early stages of adoption in GIS. Problem: Vast potential of the Semantic Web is unrealized in GIS!

How GIS Stores Connected Data Uses relational database tables Having trouble “visualizing” the network ? … so do machines! Abstraction introduces unnecessary overhead. Bad for large datasets!

Graph Databases for Connected Data Stores connected data in its native format. Much easier to visualize network … machines are happier too! Removes unnecessary overhead. Good for large datasets!

Database Performance Comparisons Performance comparisons are difficult. … how “connected is the connected data? Preprocessing data helps mitigate issues. … ESRI’s preprocessed logical network model. In general … i) RDBMS are optimized for aggregation queries ii) Graph databases are optimized for traversing.

Graph Database Characteristics Two basic properties define graph databases. Native Graph Processing Native Graph Storage

Linked Data … the Next Frontier Connects data to data on the Web Uses Resource Descriptive Framework (RDF). Creating quality linked data is challenging! Only useful in sufficient quality and quantity.

Accessing Linked Data Many RDF datasets are now available LinkedGeoData for GIS applications. Data quality, availability and stability concerns. Tools are available for accessing RDF models.

Open Source System Architecture Server side is stateless. PostGIS used for .. Storing physical model. Data visualization. Neo4j used for … Storing logical model Graph traversals Implemented in the IBM Cloud

Servlet Architecture Provides RESTful API. Enables spatial analytics Enables “data” discovery. Integrates physical and logical model processing. Implemented in the IBM Cloud