DiGIR1 Distributed Databases and Applications John Wieczorek Museum of Vertebrate Zoology, UC Berkeley.

DiGIR1 Distributed Databases and Applications John Wieczorek Museum of Vertebrate Zoology, UC Berkeley

DiGIR 2 Distributed Databases – Discipline-specific The Species Analyst (TSA)TSA The Integrated Taxonomic Information System (ITIS)ITIS FishNet The Mammal Networked Information System (MaNIS)MaNIS HerpNET The Ornithological Information System (ORNIS) …

DiGIR 3 Distributed Databases – International European Natural History Science Information Network (ENHSIN)ENHSIN Biological Collection Access for Europe (BioCASE)BioCASE Australia Virtual Herbarium (AVH)AVH Red Mundial de Información Sobre Biodiversidad, Comisión Nacional para el Conocimiento y Uso de la Biodiversidad (REMIB, CONABIO)REMIB …

DiGIR 4 Distributed Databases – Regional Mountain and Plains Spatio-Temporal Database- Informatics (MaPSTeDI)MaPSTeDI Ocean Biogeographic Information System (OBIS)OBIS Pacific Basin Information Node, National Biological Information Infrastructure (PBIN, NBII)PBIN Species Link, Centro de Referência em Informação Ambiental (Species Link, CRIA)Species Link A Virtual Herbarium of the Chicago Region (vPlants)vPlants Spatial Analysis of Local Vegetation Inventories Across Scales (SALVIAS)SALVIAS …

DiGIR 5 Distributed Databases – Intra-institutional Berkeley Natural History Museums (BNHM)BNHM Association of Biological Collections, UC Davis …

DiGIR 6 Distributed Databases – “Nodes” LifeMapper National Biodiversity Information Infrastructure (NBII)NBII Global Biodiversity Information Facility (GBIF)GBIF

DiGIR 7 GBIF Work Programmes NODES ECAT – Electronic Catalogue of Names of Known Organisms DIGIT – Digitisation of Natural History Collections OCB – Outreach and Capacity Building DADI – Data Access and Database Interoperability

DiGIR 8 Taxonomic Database Working Group Standards development and maintenance Access to Biological Collections Data (ABCD)ABCD Darwin Core Version 2 (DwC2)DwC2 Structure of Descriptive Data (SDD) DiGIR Others…

DiGIR9 DiGIR Distributed Generic Information Retrieval John Wieczorek, Stan Blum, Dave Vieglais, P.J. Schwartz

DiGIR 10 Information Retrieval Distributed - a protocol for retrieving structured data from multiple, heterogeneous databases across the Internet. Generic - a protocol independent of the data retrieved and of the software to retrieve it.

DiGIR 11 Project Rationale Avoid multiple incongruous development efforts Pool resources and create a support community of experts Solve scalability problems

DiGIR 12 Design Goals Use open protocols and standards, such as HTTP and XML Decouple the protocol, software and semantics Make new data provider installations as easy as possible Develop open source software with GNU General Public Licensing (It’s free).

DiGIR13 DiGIR Component Summary

DiGIR 14 DiGIR Architecture Provider

DiGIR 15 Provider Receives requests Retrieves data from database Sends results to requestor Supplies metadata to describe content, contacts, and capabilities Logs requests

DiGIR 16 DiGIR Architecture Portal Engine

DiGIR 17 Portal Engine The entry point for an application Can query a registry to discover potential providers Can determine, based on provider metadata, whether a provider should be queried Can send requests to multiple providers

DiGIR 18 Portal Engine, continued Assembles responses from providers Returns packaged results to the requesting application Communicates via protocol compliant messaging only Logs activity

DiGIR 19 Registry Provides a “yellow pages” to advertise the existence and capabilities of a provider Provides a means to discover potential providers of interest May be public or private Need not be a part of the architecture

DiGIR 20 DiGIR Architecture Provider Registry (register)

DiGIR 21 DiGIR Architecture Portal Engine Registry (discover)

DiGIR 22 DiGIR Protocol Defines request and response message formats for communication between provider, portal engine, and applications Metadata requests Search requests Inventory requests Remains unfettered by the structure of the data it transfers

DiGIR 23 DiGIR Architecture Application

DiGIR 24 DiGIR Architecture Application Protocol (request) Portal Engine

DiGIR 25 DiGIR Architecture Application Protocol (request) Portal Engine Protocol (request) Provider

DiGIR 26 DiGIR Architecture Application Protocol (request) Portal Engine Protocol (response) Provider

DiGIR 27 DiGIR Architecture Application Protocol (response) Portal Engine

DiGIR 28 Applications Must be able to assemble and send a request document to a portal Must be able to receive and interpret a response document from the portal Must do something incredibly useful and interesting with the data This is where the real fun is!

DiGIR 29 Hot topics – Interesting problems Persistent unique identifiers Web services (converters, translators, calculators, transformation services) Data validation (taxonomic and geographic thesauri, ecological niche modeling, expedition analysis, outlier detection,…) Spatial query interfaces Data quality feedback mechanisms Automated georeferencing, event gazetteers Concept libraries, schema extensions, schema libraries, federated ontologies

DiGIR30 MaNIS – The Mammal Networked Information System It’s more than just a pangolin…

DiGIR 31 MaNIS Network Configuration LACM MS Access Database Online MS Access Database MVZ Sybase Database MaNIS DiGIR Portal LSUMZ 4D-Mac Database Online MS Access Database UAM Oracle Database Online MS Access Database MaNIS DiGIR Portal MaNIS DiGIR Portal MVZ-MaNIS Presentation Layer UMNH-MaNIS Presentation Layer UWBM-MaNIS Presentation Layer DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider CAS SQL Server Database

DiGIR 39 MaNIS Network Configuration LACM MS Access Database Online MS Access Database MVZ Sybase Database MaNIS DiGIR Portal LSUMZ 4D-Mac Database Online MS Access Database UAM Oracle Database Online MS Access Database MVZ-MaNIS Presentation Layer DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider CAS SQL Server Database

DiGIR 43 MaNIS Network Configuration LACM MS Access Database Online MS Access Database MVZ Sybase Database MaNIS DiGIR Portal LSUMZ 4D-Mac Database UAM Oracle Database Online MS Access Database MVZ-MaNIS Presentation Layer DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider CAS SQL Server Database Online MS Access Database

DiGIR 44 MaNIS Network Configuration LACM MS Access Database MVZ Sybase Database MaNIS DiGIR Portal LSUMZ 4D-Mac Database UAM Oracle Database Online MS Access Database MVZ-MaNIS Presentation Layer DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider CAS SQL Server Database Online MS Access Database Online MS Access Database

DiGIR 45 MaNIS Network Configuration LACM MS Access Database Online MS Access Database MVZ Sybase Database MaNIS DiGIR Portal LSUMZ 4D-Mac Database MVZ-MaNIS Presentation Layer DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider CAS SQL Server Database UAM Oracle Database Online MS Access Database Online MS Access Database

DiGIR 46 MaNIS Network Configuration LACM MS Access Database Online MS Access Database MVZ Sybase Database MaNIS DiGIR Portal LSUMZ 4D-Mac Database UAM Oracle Database Online MS Access Database MVZ-MaNIS Presentation Layer DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider CAS SQL Server Database Online MS Access Database

DiGIR 50 MaNIS Network Configuration LACM MS Access Database Online MS Access Database MVZ Sybase Database MaNIS DiGIR Portal LSUMZ 4D-Mac Database Online MS Access Database UAM Oracle Database Online MS Access Database MaNIS DiGIR Portal MaNIS DiGIR Portal MVZ-MaNIS Presentation Layer UMNH-MaNIS Presentation Layer UWBM-MaNIS Presentation Layer DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider CAS SQL Server Database … … … … …… ……

DiGIR 51 “CalNet” Network Configuration LACM MS Access Database Online MS Access Database MVZ Sybase Database LSUMZ 4D-Mac Database Online MS Access Database UAM Oracle Database Online MS Access Database DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider CAS SQL Server Database CalNet DiGIR Portal

DiGIR 52 Event Gazetteer Network Configuration LACM MS Access Database Online MS Access Database MVZ Sybase Database LSUMZ 4D-Mac Database Online MS Access Database UAM Oracle Database Online MS Access Database BioGeomancer Web Service DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider CAS SQL Server Database CalNet DiGIR Portal

DiGIR 53 NBII Network Configuration LACM MS Access Database Online MS Access Database MVZ Sybase Database LSUMZ 4D-Mac Database Online MS Access Database UAM Oracle Database Online MS Access Database DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider CAS SQL Server Database NBII DiGIR Portal

DiGIR 54 GBIF Network Configuration LACM MS Access Database Online MS Access Database MVZ Sybase Database LSUMZ 4D-Mac Database Online MS Access Database UAM Oracle Database Online MS Access Database GBIF Presentation Layers DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider DiGIR Provider CAS SQL Server Database NBII DiGIR Portal

DiGIR 55 Intra-Network Configuration (BNMH) PHMA Working Database Online Database UCBG Working Database DiGIR Provider BNHM DiGIR Portal UCJEPS Working Database Online Database UCMP Working Databases (4) Online Database Essig Working Database Online Database Online Database BNHM Presentation Layer

DiGIR 56 Other Network Configurations Working Database Online Database DiGIR Provider DiGIR Provider DiGIR Portal Working Database Online Database DiGIR Provider Working Database Online Database DiGIR Portal Working Database Online Database DiGIR Provider DiGIR Portal Working Database

DiGIR 61 Other Network Configurations Working Database Online Database DiGIR Provider DiGIR Portal Working Database Working Database

DiGIR 62 Project Information DiGIR is a collaborative open source development project on SourceForge (https://sourceforge.net/projects/digir).https://sourceforge.net/projects/digir Software and documentation are available on the DiGIR web site (http://digir.net).http://digir.net MaNIS is an international network collaboration among mammal specimen collections (http://elib.cs.berkeley.edu/manis).http://elib.cs.berkeley.edu/manis

DiGIR 63 Hot topics – Interesting problems Persistent unique identifiers Web services (converters, translators, calculators, transformation services) Data validation (taxonomic and geographic thesauri, ecological niche modeling, expedition analysis, outlier detection,…) Spatial query interfaces Data quality feedback mechanisms Automated georeferencing, event gazetteers Concept libraries, schema extensions, schema libraries, federated ontologies

DiGIR1 Distributed Databases and Applications John Wieczorek Museum of Vertebrate Zoology, UC Berkeley.

Similar presentations

Presentation on theme: "DiGIR1 Distributed Databases and Applications John Wieczorek Museum of Vertebrate Zoology, UC Berkeley."— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

DiGIR1 Distributed Databases and Applications John Wieczorek Museum of Vertebrate Zoology, UC Berkeley.

Similar presentations

Presentation on theme: "DiGIR1 Distributed Databases and Applications John Wieczorek Museum of Vertebrate Zoology, UC Berkeley."— Presentation transcript:

Similar presentations

About project

Feedback