We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byAshley Powers
Modified over 3 years ago
1 © 2008 OpenLink Software, All rights reserved. Virtuoso Product Family Orri Erling - Program Manager, Virtuoso
2 © 2008 OpenLink Software, All rights reserved. Virtuoso Product Categories Virtual Database Engine Native Data Management (multi-model covering: SQL, RDF, XML, and Free Text) Native Data Management Discussion Platform Mail Proxy Services Client Connectivity Kit Virtuoso Universal Server 2
3 © 2008 OpenLink Software, All rights reserved. Virtual Database Engine External ODBC or JDBC accessible SQL Data Sources External XML based Data Sources External SOAP or RESTful Web Services External RDF Data (e.g. Oracle) Custom Data Sources via Server Extensions API 3 RDF, XML, SQL Conceptual Views over:
4 © 2008 OpenLink Software, All rights reserved. Virtual Database Engine Contd. SQL Queries over Remote SQL, RDF, XML, and Web Services based Data Sources SPARQL Queries over Remote SQL, RDF, XML, and Web Services based Data Sources XQuery/XPath Queries over Remote RDF, SQL, and XML based Data Sources Web Services based access to Remote RDF, SQL, XML, and other Web Services based Data Sources 4
5 © 2008 OpenLink Software, All rights reserved. Virtual Database Engine Contd. Distributed Query Optimization Locality Sensitive Query Cost Optimization (Collocated Joins, Pass-Through Queries, and Array Parameters) Deductively Abstracts SQL Dialect Differences (via ODBC and JDBC metadata call exploitation) Message Latency Factored into Cost Model Hash Joins Used When Appropriate, Replacing Multiple Remote Lookups with Single Sequential Read 2-Phase Commit for Distributed Transactions MS DTC for Windows Tuxedo on Unix 5
6 © 2008 OpenLink Software, All rights reserved. Virtual Database Engine Contd. ATTACH TABLE Statement incorporates Remote Table, Indexes and Statistics into Local Virtuoso Schema Allows Incorporation of SQL Functions and Stored Procedures from Remote Relational Database Engines Support for Remote XML, Full Text Indexing for Oracle, Microsoft SQL Server 6
7 © 2008 OpenLink Software, All rights reserved. Native Data Management – Relational (RDBMS) Native SQL 92/2K Engine Rich Procedure Language (PSM-95 based) Database Engine Optimized for SMP Performance Native Full Text Indexing 7
8 © 2008 OpenLink Software, All rights reserved. RDBMS Features - Transactions Full ACID Properties Checkpoint + Roll Forward Log, Optional Archiving of Logs Uncommitted/Read Committed/Repeatable/Serializable Isolations Non-blocking Read Committed Shows Latest Committed Versions of Uncommitted Updated Rows Can Work as XA/MS DTC Resource Manager 8
9 © 2008 OpenLink Software, All rights reserved. RDBMS Features - SQL Full SQL 92 with many 2K Features SQLX, XPATH, XSLT, Xquery SQL 2K Objects, Implementation in SQL/Java/.net Transparent Mixing of Local and Remote Tables 9
10 © 2008 OpenLink Software, All rights reserved. RDBMS Features – Query Optimization Cost Based Optimization On The Fly Sampling of Table/Column/Literal Key Cardinalities Fixed Statistics for Deterministic Query Plans Loop/Hash/Merge Join SQL Options for Explicitly Specifying Query Plan 10
11 © 2008 OpenLink Software, All rights reserved. RDBMS Features - Storage Engine Rows Stored At Leaves of Primary Key Index Tree Non PK Indexes Refer to Row By Value of PK Bitmap Index Full Text Index Striping Across Disks, No Separate Files Per Table/Key Incremental Online backup 11
12 © 2008 OpenLink Software, All rights reserved. RDBMS Features - Run Time Hosting User Defined Type via Java or.NET Objects Hosted in Process User Defined Types Persisted in LOB Columns Java/.NET Methods Called Transparently From SQL C based Plugin Mechanism for adding SQL Functions 12
13 © 2008 OpenLink Software, All rights reserved. RDBMS Features - Security SQL Role Based Security, Column/Table/View/Procedure Level Row Level Security With Policy Functions A Policy Function Can Add Extra Conditions to Queries/Updates Depending on User, Time, Other Considerations 13
14 © 2008 OpenLink Software, All rights reserved. Data Center Features - Clustering Combine Multiple Servers for Massive Scale and Parallelism All Servers Show the Same SQL/RDF Data and Application Logic, A SQL or Web Client Can Connect to Any for the Same Service Data Partitioning Specifiable Index by Index Optional Replicated Storage of Partitions for More Load Balancing, Fault Tolerance Shared Nothing Architecture, Works With Commodity Hardware and Networks 14
15 © 2008 OpenLink Software, All rights reserved. Data Center Features - Query Penalization Latency: One Message Round Trip is 20 Single Row Random Lookups Virtuoso Divides Queries into Collocated Fragments, Ships All Filtering, Aggregation, Joining to Where the Data Is. Sends Arrays of Hundreds of Operations at a Time, Whenever Possible 15
16 © 2008 OpenLink Software, All rights reserved. Data Center Features - Transactions Full ACID Properties Two Phase Commit with Single Phase Optimization Detection of Distributed Deadlocks Without Timing Out Each Cluster Node Keeps Own Transaction Log No External Monitor, Virtuoso Handles Distributed Recovery Cycle By Itself Transactions/Logging Can BE Disabled for Bulk Load etc. 16
17 © 2008 OpenLink Software, All rights reserved. Data Center Features - Parallel SQL Transparent Map-Reduce Style Execution of Specified Partitioned SQL Functions/Procedures PL Extensions for Async Remote Execution of SQL Code, With and Without Transactional Semantics 17
18 © 2008 OpenLink Software, All rights reserved. Data Center Features - Futures Dynamic Deployment, Adding and Removing Cluster Nodes Without Interruption of Service Keeping Data in Small, Self-Contained, Easily Relocatable Mini-Partitions 18
19 © 2008 OpenLink Software, All rights reserved. SQL Client Connectivity - Data Access Drivers Cross Platform ODBC 3.0 Drivers JDBC 2.0 Drivers OLE-DB Provider ADO.NET Provider XMLA Provider 19
20 © 2008 OpenLink Software, All rights reserved. Native Data Management - XML Native XML Data Type SQLX + Oracle Compatible XML Functions in SQL Document Centric Persistence of XML with Special Support in Text Index XSLT XQuery XML Views – XML Mapping Schema based Views of SQL Data Sources 20
21 © 2008 OpenLink Software, All rights reserved. Native RDF Data Management Native RDF Quad Storage (Physical Quads) SQL Enhanced With RDF IRI and Typed/Language Tagged Data Bitmap Indices and Key Compression for Compact Storage Selectable Index Scheme, Optionally Allows Queries Against Union of All Graphs Optional Full Text Index of Literals Reuses SQL Cost Model and Execution Engine With RDF Tailored Statistics 21
22 © 2008 OpenLink Software, All rights reserved. RDF Data Services – Client Connectivity SPARQL Protocol Jena Storage Provider Sesame Storage Provider Redland Storage Provider Linq2Rdf Storage Provider SPASQL SPARQL execution within SQL Processor Plethora of Built-In Functions, Stored Procedures, Web Services 22
23 © 2008 OpenLink Software, All rights reserved. RDF Data Services – SPARQL Full SPARQL, Language and Protocol Support Jena Compatible SPARUL for Create Graph, Insert, Update, and Delete Extensions for Aggregates & Grouping Nested Queries, SQL-Like Existence and Value Subqueries Expressions in Result Sets Path Expressions for Compact Notation, Also in Expressions Full Text & XPath Magic Predicate Extensions 23
24 © 2008 OpenLink Software, All rights reserved. RDF Data Services – Inference 24 Backward Chaining Inference Support, No Materialization of Entailed Triples needed for: Subclass and Subproperty Hierarchies OWL sameAs for Instances, Classes and Properties OWL equivalentClass and equivalentProperty Inference Enabled at Query or Individual Triple Pattern Level
25 © 2008 OpenLink Software, All rights reserved. Linked Data Services - RDF-ization Middleware Declarative RDF Views (or Covers) over SQL Data In-Built RDF Middleware (Sponger) for RDF-ization of Harvested Web Content (bulk ingest or on the fly) Extended SPARQL Against Mapped and Stored RDF RDF-ization Cartridges for 30+ non RDF data sources Used by SPARQL Processor Used by in-built Content Crawler Cache Invalidation based on HTTP Caching Rules Configurable URI dereferencing via pragmas for node selection and path traversal 25
26 © 2008 OpenLink Software, All rights reserved. Linked Data Services - Deployment URL Rewrite Rules combined with SPARQL for flexible association of URIs and RDF Data Sets Proxy (or wrapper) URIs construction for materializing Linked Data on the fly from existing Web information resources REST or SOAP based Web Services that expose functionality to Web Clients such as OpenLink Data Explorer, Marbles, Zitgist Data Explorer, DISCO, Tabulator etc. 26
27 © 2008 OpenLink Software, All rights reserved. RDF Data Services – RDF Views over SQL Data Sources SPARQL Data Definition Statements for RDB Mapping Declare Correspondences Between Graph/Triple Patterns and SQL Objects Specify Mapping Between URI's and Keys, Supporting All Data Types, Multipart Keys Not Restricted to Table per Class and Column per Property Use Arbitrary Joins, SQL Functions and Search Conditions Automatically Generate Basic Class per Table, Property per Column Mapping of Given SQL Schema 27
28 © 2008 OpenLink Software, All rights reserved. RDF Data Services - RDF Views Contd. Evaluate Arbitrary SPARQL Against an RDF View In One Query, Some Graphs May Come from Views, Others From Stored RDF RDF Views Generate a Single SQL Statement, The IRI Generation and IRI Parsing is Only in Selection and Constant Expressions SQL Has Full Optimization Possibilities and the Generated SQL Does not Depend on Virtuoso Specifics Hence, RDF Views Are Efficient for Querying Remote, non-Virtuoso SQL Data 28
29 © 2008 OpenLink Software, All rights reserved. RDF Data Services - Clustering Cluster-Optimized RDF Loader and SPARUL RDF-Aware Data Partitioning Automatic Statistics Sampling Across Cluster for Best Query Plan 29
30 © 2008 OpenLink Software, All rights reserved. RDF Benchmarks TPC H With SPARQL Extensions and RDF Views LUBM Berlin SPARQL Benchmark with Triples and with RDF Views 30 Bundled With:
31 © 2008 OpenLink Software, All rights reserved. Web Services Platform – HTTP Services HTTP/1.1 and HTTPS Server for Static and Dynamic Content Dynamic Web Pages in PHP, Virtuoso SQL Procedures, ASP.net, Others SOAP and Rest Web Services in Virtuoso PL, Java,.NET DAV 31
32 © 2008 OpenLink Software, All rights reserved. Web Services Platform - WebDAV Documents Stored in Virtuoso Database ACL Based plus Unix Style Security, SQL User Accounts and Roles Own Documents and Collections Automatic RDF Metadata Extraction Optional Full Text Indexing and Versioning Dynamic Collections for Alternate Views of Directory Hierarchy 32
33 © 2008 OpenLink Software, All rights reserved. Web Services Platform – SOAP & REST SOAP 1.1/1.2 End Points Exposing SQL Procedures in All SOAP Styles Automatic WSDL Generation SQL Extensions for Declaring Full XML Schema Signatures for End Points Exposing Java and.net via SOAP Dynamic Web Pages and XML Functions for REST Services XMLA for SQL Access over SOAP 33
34 © 2008 OpenLink Software, All rights reserved. Web Services Platform - Dynamic Server Pages Configure a Virtual Directory as Executable Publish Dynamic Web Pages in PHP, Virtuoso PL, Ruby, PERL, ASP.net Without Using External Web Server 34
35 © 2008 OpenLink Software, All rights reserved. Administration Services Web Interface for Setup of Web End Points, SQL, XML, RDF Functions SQL Functions for Full Programmatic Admin Access Simple Tuning, Only Specify File Layout and Amount of Threads and Memory to Use 35
36 © 2008 OpenLink Software, All rights reserved. Virtuoso RDF Applications Dbpedia BIO2RDF Neurocommons Zitgist, Pingthesemanticweb, Musicbrainz ZitgistPingthesemanticwebMusicbrainz 36
37 © 2008 OpenLink Software, All rights reserved. Product Open Source and Closed Source Versions, Closed Source AddsVirtual Database and Clustering All Code, Applications, Samples, Docs in Single Download Minimal Installation Consists of Single Executable + Config File Web Admin Interface and Bundled ODS Collaborative Apps Suite Available for All Linux, Unix, Windows, 32 and 64 bit Available Preinstalled on Amazon EC2, With Optional Preloaded Dbpedia, BIO2RDF, Other RDF Data Sets 37
Michael Povolotsky CMSC491s/691s. What is Virtuoso? Virtuoso, known as Virtuoso Universal Server, is a multi-protocol RDBMS Includes an object-relational.
18 Copyright © 2005, Oracle. All rights reserved. Distributing Modular Applications: Introduction to Web Services.
1 © 2012 OpenLink Software, All rights reserved. Virtuoso - Column Store, Adaptive Techniques for RDF Orri Erling Program Manager, Virtuoso Openlink Software.
Efficient RDF Storage and Retrieval in Jena2 Written by: Kevin Wilkinson, Craig Sayers, Harumi Kuno, Dave Reynolds Presented by: Umer Fareed 파리드.
DATABASE SYSTEM CONCEPTS AND ARCHITECTURE CHAPTER 2 1.
11 1 Chapter 11 Database Performance Tuning and Query Optimization Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
13 Copyright © 2005, Oracle. All rights reserved. Monitoring and Improving Performance.
1 File Systems Chapter Files 6.2 Directories 6.3 File system implementation 6.4 Example file systems.
1 Chapter 9: The Client/Server Database Environment Modern Database Management 7 th Edition Jeffrey A. Hoffer, Mary B. Prescott, Fred R. McFadden.
Faculty of Information Technology 31242/32549 Advanced Internet Programming Advanced Java Programming Web services Intro.
1 Chapter 12 File Management Patricia Roy Manatee Community College, Venice, FL ©2008, Prentice Hall Operating Systems: Internals and Design Principles,
1 Database Systems: Design, Implementation, and Management CHAPTER 10 Distributed Database Management System.
IS 4420 Database Fundamentals Chapter 10: The Internet Database Environment Leon Chen.
1 Senn, Information Technology, 3 rd Edition © 2004 Pearson Prentice Hall James A. Senns Information Technology, 3 rd Edition Chapter 7 Enterprise Databases.
Connecting to Databases. relational databases tables and relations accessed using SQL database -specific functionality –transaction processing commit.
19 Copyright © 2005, Oracle. All rights reserved. Distributing Modular Applications: Developing Web Services.
1 tRelational/DPS Overview. 2 ADABAS Data Transfer: business needs and issues tRelational & DPS Overview Summary Questions? Demo Agenda.
Copyright © 2003 Pearson Education, Inc. Slide 8-1 Created by Cheryl M. Hughes, Harvard University Extension School Cambridge, MA The Web Wizards Guide.
C2: Introduction to OpenEdge ® Integration Technologies Chris James Senior Consultant.
Threads, SMP, and Microkernels Chapter 4 1. Process Resource ownership - process includes a virtual address space to hold the process image Scheduling/execution-
©Ian Sommerville 2000 Software Engineering, 6th edition. Chapter 11Slide 1 Chapter 11 Distributed Systems Architectures.
© 2008 Cisco Systems, Inc. All rights reserved.Cisco ConfidentialPresentation_ID 1 Chapter 1: Introduction to Scaling Networks Scaling Networks.
Getting Started with Oracle and.NET Alex Keh Principal Product Manager Server Technologies.
1. XP 2 * The Web is a collection of files that reside on computers, called Web servers. * Web servers are connected to each other through the Internet.
Executional Architecture Lecture Conceptual vs execution Conceptual Architecture Execution Architecture Component Connector Domain-level responsibilities.
© 2009 OpenLink Software, All rights reserved. Mapping Relational Databases to RDF with OpenLink Virtuoso Orri Erling - Program Manager, Virtuoso.
XP New Perspectives on Browser and Basics Tutorial 1 1 Browser and Basics Tutorial 1.
10 Systems Analysis and Design in a Changing World, Fifth Edition.
Macromedia Dreamweaver MX 2004 – Design Professional Dreamweaver GETTING STARTED WITH.
1 Copyright © 2013 Elsevier Inc. All rights reserved. Chapter 3 CPUs.
Chapter 11 Creating Framed Layouts Principles of Web Design, 4 th Edition.
1 Presented by: Ken Williams and Wade Scheffner American Digital Corporation May 21, 2013 UniData to SQL Virtualization & Disaster Recovery.
PSSA Preparation. Question 1(no calculator) D Question 2 (no calculator)
© 2002 page 1 Data Mining Tools For ZLE Copying and Use Restrictions: Material under this presentation is the Intellectual Property of HP Corporation and.
9 Copyright © 2005, Oracle. All rights reserved. Modularizing JavaServer Pages Development with Tags.
B.Sc. Multimedia ComputingMedia Technologies Database Technologies.
Databases Foundations of Computer Science Cengage Learning.
Troubleshooting Startup Problems Lesson 6. Objectives 2.
4 Copyright © 2005, Oracle. All rights reserved. Creating the Web Tier: Servlets.
10 Chapter 10: The Traditional Approach to Design Systems Analysis and Design in a Changing World, 3 rd Edition.
Copyright © 2007 Ramez Elmasri and Shamkant B. Navathe Slide
Rajashree Deka Tetherless World Constellation Rensselaer Polytechnic Institute.
Auto-scaling Axis2 Web Services on Amazon EC2 By Afkham Azeez.
3-1 4 Oracle Data Integrator First Project – Simple Transformations: One source, one target.
Tom Hamilton – Americas Channel Database CSE Oracle Architecture 1.
© 2008 FedEx. All rights reserved. FedEx Ship Manager ® at fedex.com Shipping Administration Presentation for administrators.
Mike Jackson EPCC OGSA-DAI Architecture + Extensibility OGSA-DAI Tutorial GGF17, Tokyo.
Installing Windows XP Professional Using Attended Installation Slide 1 of 30Session 8 Ver. 1.0 CompTIA A+ Certification: A Comprehensive Approach for all.
© 2017 SlidePlayer.com Inc. All rights reserved.