Presentation is loading. Please wait.

Presentation is loading. Please wait.

The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia International.

Similar presentations


Presentation on theme: "The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia International."— Presentation transcript:

1 The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia International Digital Curation Conference, 2010

2

3

4 Started in late 2007 Public Access to Raw Protein Crystallography Data Fedora Commons Based Federated Storage Protein Crystallography Specific Code

5 The TARDIS Framework Federated Data Storage TARDIS.edu.au Repository

6 TARDIS’ Internal Structure Thanks to Alistair Grant

7 Generic Parameter Support Thanks to Alistair Grant

8

9 Why Fedora wasn ʼ t suitable for large datasets.. HTTP Protocol Multiple / Large File Downloading Setup and maintenance Existing repository solutions at institutions.. Willingness / funds for libraries to store large datasets

10 Data - From Production to Publication Publication Production Processing Managed by an instrument/facility’s system, such as that at the Australian Synchrotron ??? Data exists on researchers’ personal computers and is usually NOT managed in any standard, persistent way Solutions exist for deposition of data into several sources. TARDIS currently solves for raw Px data

11 The Need for Data Management at Time Of Processing Processing

12 From Capture to Publication

13

14

15 Also deployed at: University of Mebourne La Trobe University

16

17

18

19

20

21 TARDIS: Internals Lightweight Architecture

22

23 6 Datasets, 5140 Datafiles ~90GB

24 Data ‘staging’ mechanism. Upcoming Features.. MyTARDIS

25 We’re now the ‘official solution’ for instruments at AS + ANSTO!..so more instruments + facilities “TARDIS/MyTARDIS system for high-end instrumentation data capture (e.g. X-ray diffraction images) has been chosen by both the Australian Synchrotron and ANSTO (Australian Nuclear Science and Technology Organisation) as the platform for metadata capture. Congratulations to the developers of TARDIS/MyTARDIS: Monash University biochemist, Associate Professor Ashley Buckle and software engineer Mr Steve Androulakis. (Support received from the Monash e-Research Centre, the Victorian eResearch Strategic Initiative, the Australian Synchrotron and the Australian National Data Service).” Australian Synchrotron / ANSTO

26 Test instances already receiving SAXS/WAXS and IR data… New Authorisation Engine Enables Various Access Rules For: Groups of users People in specific locations (ip based) Custom rules (such as embargo periods) Powerful Search Interface Generic search across all parameters by various rules Discipline specific ‘canned’ searches Easy Parameter Schema Definition (in conjunction with Monash Metadata Store project) Users to define new parameter sets Coming in a later iteration.. Advanced Parameter Editing (in conjunction with Monash Metadata Store project) Australian Synchrotron / ANSTO

27 Molecular Biology Auto-Processing Thanks Grischa Meyer

28 Upcoming Projects…

29 RMIT – Microscopy 9 Microscopes New ‘Filter’ Module Functionality RMIT eResearch Office – Heinz Schmidt / Ian Thomas The Ian Wark Research Institute – Particle Physics Instrument Linkage University of SA - Ryan Green Peter Mac Institute – Next Gen Sequencing Instrument Linkage Courtesy of VeRSI – Lyle Winton APS Chicago?! Upcoming Projects

30 TARDIS’ Modular Framework MyTARDIS Synchrotron TARDIS.edu.au Microscopy VBL Download VBL Authentication Visual Style Parameter Schemas Parameter ‘Filters’ Visual Style Parameter Schemas Federated Storage Support Visual Style and Templates Parameter Schemas http://code.google.com/p/mytardis/http://code.google.com/p/mytardis/ (BSD)

31 This project is supported by the Australian National Data Service (ANDS) ANDS is supported by the Australian Government through the National Collaborative Research Infrastructure Strategy Program and the Education Investment Fund (EIF) Super Science Initiative

32 Special thanks to.. Find us at: tardis.edu.au


Download ppt "The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia International."

Similar presentations


Ads by Google