1 Data Architecture Strawman - Grimshaw Important points Everything is a service (object) >All have a name (EPR) and an interface (type) One or more base.

Slides:



Advertisements
Similar presentations
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
Advertisements

DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
Pentaho Open Source BI Goldwin. Pentaho Overview Pentaho is the commercial open source software for Business Pentaho is the commercial open source software.
1 Integration Made Easy Agile Integration: Connecting Salesforce With Your Enterprise.
1 Enabling OpenVMS for Data & Application Integration 30, 2005 *John Apps – HP Strategic Planning and Architecture *Mark Peterson.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Network Publishing. Node 2.0 and Publishing Node 1.1 Focused on Basic Data Submissions Data Publishing Should Be the Focus for Node 2.0. Data Publishing.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
ORACLE Lecture 1: Oracle 11g Introduction & Installation.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation Mike Smorul, Joseph JaJa, Yang Wang, and Fritz McCall.
Customising SharePoint David Gristwood Developer & Platform Group
® IBM Software Group © IBM Corporation IBM Information Server Deliver – Federation Server.
Live Meeting APIs Robert Devine Program Manager Microsoft Corporation.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Confidential ODBC May 7, Features What is ODBC? Why Create an ODBC Driver for Rochade? How do we Expose Rochade as Relational Transformation.
Enterprise Reporting with Reporting Services SQL Server 2005 Donald Farmer Group Program Manager Microsoft Corporation.
Data Integration in Service Oriented Architectures Rahul Patel Sr. Director R & D, BEA Systems Liquid Data – XML-based data access and integration for.
DBA230 Introducing SQL Server 2000 Reporting Services Jason Carlson Product Unit Manager SQL Server Microsoft Corporation.
Introducing SQL Server 2000 Reporting Services Geoff Snowman Developer Community Champion Microsoft Corporation.
Copyright © The OWASP Foundation Permission is granted to copy, distribute and/or modify this document under the terms of the OWASP License. The OWASP.
Best Practices for Data Warehousing. 2 Agenda – Best Practices for DW-BI Best Practices in Data Modeling Best Practices in ETL Best Practices in Reporting.
Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.
Auditing Authentication & Authorization in Banner
Message Brokers and B2B Application Integration Chap 13 B2B Application Integration Sungchul Hong.
CHAPTER 14 USING RELATIONAL DATABASES TO PROVIDE OBJECT PERSISTENCE (ONLINE) © 2013 Pearson Education, Inc. Publishing as Prentice Hall 1 Modern Database.
Midterm Exam Chapters 1,2,3,5, 6,7 (closed book) March 11, 2014.
UDDI ebXML(?) and such Essential Web Services Directory and Discovery.
© 2006 IBM Corporation IBM WebSphere Portlet Factory Architecture.
Java-Based Middleware IT 490 Stan Senesy IT Program NJIT.
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
Building an E-Commerce website Dr. John P. Abraham.
1 Knowledge Portals and Knowledge Management Tools Chapter 13.
Business and IT Working Together to Streamline Corporate Reporting Stephen Hord, Director of Product Development – UBmatrix.
DATABASE MANAGEMENT SYSTEMS IN DATA INTENSIVE ENVIRONMENNTS Leon Guzenda Chief Technology Officer.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
® IBM Software Group Tivoli Directory Integrator Don’t mistake simplicity for triviality Eddie Hartman
1 1 EPCC 2 Curtin Business School & Edinburgh University Management School Michael J. Jackson 1 Ashley D. Lloyd 2 Terence M. Sloan 1 Enabling Access to.
9 th Open Forum on Metadata Registries Harmonization of Terminology, Ontology and Metadata 20th – 22nd March, 2006, Kobe Japan. Presentation Title: Day:
Alexandria Digital Earth ProtoType DIGITAL LIBRARIES AND ENVIRONMENTAL INFORMATION Terence R. Smith Alexandria Digital Library Project.
An Interoperable Portal for the Historic Environment Tony Austin, Julian Richards Archaeology Data Service, Department of Archaeology,
INFSO-RI Enabling Grids for E-sciencE OGSA DAI Data Access and Integration Marek Ciglan Institute of Informatics, Slovac Academy.
1/22/08 RTR Project Presentation to TPTF RTR Project Michael Daskalantonakis & Brian Cook.
OGSA-DAI Neil Chue Hong 29 th January 2007 OGF19, Chapel Hill.
Create Content Capture Content Review Content Edit Content Version Content Version Content Translate Content Translate Content Format Content Transform.
Oracle HFM Implementation Boot Camp
EbXML Registry and Repository Dept of Computer Engineering Khon Kaen University.
OBIEE Architecture.
Cognos 8 BI Product Overview Cognos 8 BI. Objectives  In this module we will examine:  Cognos 8 Business Intelligence  key themes of Cognos 8 Business.
Distributed Archives Interoperability Cynthia Y. Cheung NASA Goddard Space Flight Center IAU 2000 Commission 5 Manchester, UK August 12, 2000.
1 Copyright © 2012 Tata Consultancy Services Limited Windchill Architecture.
Introduction to SQL Server 2000 Reporting Services Jeff Dumas Technical Specialist Microsoft Corporation
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
CMPE 226 Database Systems April 19 Class Meeting Department of Computer Engineering San Jose State University Spring 2016 Instructor: Ron Mak
Slide 1 © 2016, Lera Technologies. All Rights Reserved. SAP BO vs SPLUNK vs OBIEE By Lera Technologies.
DO YOU TRUST YOUR DATA? KNOW THE ANSWER WITH EIM! Jose Hernandez Director, Business Intelligence Dunn Solutions Group.
Apache Cocoon – XML Publishing Framework 데이터베이스 연구실 박사 1 학기 이 세영.
1 Case Study: Business Intelligence & Customer Data Customer Support Web-based Dashboard VP Marketing SQL XSLT XML Data Grid Customer Data Customer Order.
Preservation Data Services Persistent Archive Research Group Reagan W. Moore October 1, 2003.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
9 Copyright © 2004, Oracle. All rights reserved. Getting Started with Oracle Migration Workbench.
Amy Krause EPCC OGSA-DAI An Overview OGSA-DAI on OMII 2.0 OMII The Open Middleware Infrastructure Institute NeSC,
October 2014 HYBRIS ARCHITECTURE & TECHNOLOGY 01 OVERVIEW.
The Holmes Platform and Applications
Introducing SQL Server 2000 Reporting Services
OGSA Data Architecture
Chris Menegay Sr. Consultant TECHSYS Business Solutions
Chapter 14: Meta Data Repository Development
PRESENTER: Entrinsik, Inc.
Presentation transcript:

1 Data Architecture Strawman - Grimshaw Important points Everything is a service (object) >All have a name (EPR) and an interface (type) One or more base types >stream, byte_vector, directory, cache, file container, authorization_server, stored_procedure, RDBMS, etc. >Derived types such as parallel file, replicated file, read_only file possible Multiple levels of abstraction to users >High-level standard interfaces for low activation energy >Direct access for performance Management control and site autonomy are REQUIREMENTS

2 Avaki Data Grid 4.0 A single, integrated system to provision, access and integrate distributed data A data service layer for connecting multiple, federated data sources to applications >Single service >Abstracts underlying data sources >Framework for executing actions on data DATA GRID Provision Access Integration

3 Data Services Framework – Three Layer Architecture DATA GRID Provision Access Integration ETL Profiling & Quality XML Mapping Development Tools Metadata Registry Distributed Query Core “Data Service Layer” Additional & 3 rd Party Data Integration Capabilities Data Catalog

4 Data Services Core Data Services >Single data service – hides interfaces & security of many data sources >Caching – speed data access – protect source >Data Catalog – find, invoke, and track data >Security – single sign-on Additional Data Services >Data execution “framework” –Data as Web services or Java objects –Data flows –Data aggregation & transformation through XML/XSL >Data “entities” – coarse grain abstraction of multiple data elements –Customer, order, entities, etc. >Third-party data tools – ETL, profiling, cleansing XML schema

5 Data Provisioning >“Publish” any relational data, files, XML, and application data sources –Federated data service across heterogeneous, distributed sources –Unified data catalog –Data remains local & local ownership –Files shared from source location –SQL statements, stored procedures –Application data via HTTP or Java classes >Control access with one unified system –Data owners control access rights at data object level –Integration with multiple, heterogeneous authentication services (LDAP, Microsoft Active Directory, NIS) DATA GRID Provision Access Integration Data Sources

6 Data Access >Simplified access to federated data –Unified view of all available data provides a single service for retrieving all data objects –SQL result sets, XML views, files, application data sources –Access data anywhere as if it were local –Read and write –Caching speeds performance >Standard Access –ODBC –JDBC –File read/write – NFS, WinFS –Web Services/SOAP –JSP/Tag library >“Drill Down” –For performance Data Sources WinFS NFS JSP ODBC/ JDBC Portal/ Dash- board BI App UNIX App Win32 App AVAKI DATA GRID Provision Access Integration

7 Data Integration >Data manipulation –Transformers >Multiple data sources into a single view >Transform data formats –Technical and semantics >Schedule and trigger transformations >Link and trigger transformations for automated data flows Provision Access Integration AVAKI DATA GRID Data Sources WinFS NFS JSP ODBC/ JDBC Portal/ Dash- board BI App UNIX App Win32 App