Project Database Handler The Project Database Handler dbCCP4i is a brokering application that mediates interactions between the project database and an.

Slides:



Advertisements
Similar presentations
TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.
Advertisements

CCPN project modeling framework University of Cambridge European Bioinformatics Institute MSD group.
DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
Distributed Data Processing
Test Case Management and Results Tracking System October 2008 D E L I V E R I N G Q U A L I T Y (Short Version)
Web Visualization Technology Horner APG Ver 1.0.
PiMS overview: version 0.3 & beyond Robert Esnouf, PiMS Project Sponsor, Oxford.
The MEMOPS Programming Framework Wayne Boucher, Cambridge
Access 2007 Product Review. With its improved interface and interactive design capabilities that do not require deep database knowledge, Microsoft Office.
Peoplesoft: Building and Consuming Web Services
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
 MODERN DATABASE MANAGEMENT SYSTEMS OVERVIEW BY ENGINEER BILAL AHMAD
Digitization Workflow Management System for Massive Digitization Projects Bibliotheca Alexandrina November 19, 2006 The 2 nd International Conference on.
26-28 th April 2004BioXHIT Kick-off Meeting: WP 5.2Slide 1 WorkPackage 5.2: Implementation of Data management and Project Tracking in Structure Solution.
● Problem statement ● Proposed solution ● Proposed product ● Product Features ● Web Service ● Delegation ● Revocation ● Report Generation ● XACML 3.0.
Discussion and conclusion The OGC SOS describes a global standard for storing and recalling sensor data and the associated metadata. The standard covers.
9 Feb 2004Mikko Mäkinen & Saija Ylönen Joint UNECE/Eurostat/OECD work session on statistical metadata (METIS) Geneva, 9-11 February 2004, Topic (ii): Metadata.
23 rd August 2005CCP4 Workshop IUCr 2005 Florence Italy 1 N6: A Protein Crystallographic Toolbox: The CCP4 Software Suite and PDB Deposition Tools IUCr.
C Copyright © 2009, Oracle. All rights reserved. Appendix C: Service-Oriented Architectures.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
CCP4 Study Weekend 3rd January 2003 CCP4i - “Tricks and Tools” Peter Briggs CCP4 Daresbury.
Peter J. Briggs, Liz Potterton *, Pryank Patel, Alun Ashton, Charles Ballard, Martyn Winn CLRC Daresbury Laboratory, Warrington, Cheshire WA4 4AD, UK *
23 rd August 2005CCP4-RCSB Workshop IUCr 2005 Florence Italy 1 N6: A Protein Crystallographic Toolbox: The CCP4 Software Suite and RCSB PDB Deposition.
Image Collection Backend for Cameraphones. Introduction Project Goals Design an integrated system to upload image from a mobile phone to a remote server.
Authors Project Database Handler The project database handler dbCCP4i is a small server program that handles interactions between the job database and.
EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
28 th March 2007CCP4 Developers Meeting BIOXHIT/CCP4(i) Database Wanjuan Yang & Peter Briggs.
CCP4(i) Database Development Wanjuan (Wendy) Yang CCP4 Annual developer’s meeting March 28, 2006 York.
29-30 th March 2006CCP4 Annual Developers’ Meeting CCP4i: Recent Developments, Future Prospects Peter Briggs, CCP4.
23 rd March 2005CCP4 Annual Developers’ Meeting 1 DL: Releases, Conferences and Other Activities Peter Briggs, CCP4 Daresbury.
XML Registries Source: Java TM API for XML Registries Specification.
1 st -4 th December st BioXHIT Annual Meeting WorkPackage 5.2: Implementation of Data management and Project Tracking in Structure Solution Peter.
28-29 th March 2006CCP4 Automation STAB MeetingCCP4i and Automation 1 CCP4i and Automation : Opportunities and Limitations Peter Briggs, CCP4.
Update on e-Placement at Aon Ian Summers. Aon Limited is authorised and regulated by the Financial Services Authority in respect of insurance mediation.
An Introduction to CCP4i The CCP4 Graphical User Interface Peter Briggs CCP4.
1 AutoCAD Electrical 2008 What’s New Name Company AutoCAD Electrical 2008 What’s New AMS CAD Solutions
INFO1408 Database Design Concepts Week 15: Introduction to Database Management Systems.
17 th October 2005CCP4 Database Meeting (York) CCP4(i)/BIOXHIT Database Project: Scope, Aims, Plans, Status and all that jazz Peter Briggs, Wanjuan Yang.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Developments with CCP4i & the Database Handler Peter Briggs.
Presented by Scientific Annotation Middleware Software infrastructure to support rich scientific records and the processes that produce them Jens Schwidder.
Presented by Jens Schwidder Tara D. Gibson James D. Myers Computing & Computational Sciences Directorate Oak Ridge National Laboratory Scientific Annotation.
26-28 th April 2004BioXHIT Kick-off Meeting1 Task 4.7.1: Automation in Computation Peter Briggs, CCP4.
Data Harvesting: automatic extraction of information necessary for the deposition of structures from protein crystallography Martyn Winn CCP4, Daresbury.
Cole David Ronnie Julio. Introduction Globus is A community of users and developers who collaborate on the use and development of open source software,
Project Database Handler The Project Database Handler is a brokering application that mediates interactions between the project database and the external.
17 th October 2005CCP4 Database Meeting York University Database Requirements for CCP4 Projects Monday 17 th October 2005 Abstract Gather information on.
© 2013, published by Flat World Knowledge Chapter 10 Understanding Software: A Primer for Managers 10-1.
Project Database Handler The Project Database Handler is a brokering application, which will mediate interactions between the project database and other.
SR Users Meeting 10-11th September 2003 CCP4 Release 5.0 Peter Briggs CCP4/CCLRC Daresbury Laboratory.
28 th May 2005CCP4 Workshop ACA 2005 Orlando FL 1 WK04: A Protein Crystallographic Toolbox: The CCP4 Software Suite ACA 2005 Orlando May 28th 2005.
Object storage and object interoperability
Software automation – What STAB sees as key aims? 1.Brief review of activities and recommendations (so far) 2.Reality checks 3. Things to do…
Future plans & strategy for CCP4 (for discussion) Tadeusz Skarzynski, 30 March 2006.
An Open Data Platform in the framework of the EGI-LifeWatch Competence Centre Fernando Aguilar Jesús Marco
Peter J. Briggs, Alun Ashton, Charles Ballard, Martyn Winn and Pryank Patel CCLRC Daresbury Laboratory, Warrington, Cheshire WA4 4AD, UK The CCP4 project.
Exeter – Implementation of a Crosswalk Connector S. Trowell, University of Exeter Nov 2013.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
Advanced Higher Computing Science The Project. Introduction Worth 60% of the total marks for the course Must include: An appropriate interface using input.
Scientific Linux Inventory Project (SLIP) Troy Dawson Connie Sieh.
A Semi-Automated Digital Preservation System based on Semantic Web Services Jane Hunter Sharmin Choudhury DSTC PTY LTD, Brisbane, Australia Slides by Ananta.
Project Database Handler The Project Database Handler is a brokering application which will mediate interactions between the project database and other.
What is BizTalk ?
Architecture Review 10/11/2004
CCP4 6.1 and beyond: Tools for Macromolecular Crystallography
Database Requirements for CCP4 17th October 2005
Project tracking system for the structure solution software pipeline
CCP4-PDB Workshop ACA 2004 Chicago
Background: Currently CCP4i puts each structure determination into a separate project directory, and automatically keeps a “Project History Database” recording.
N6: A Protein Crystallographic Toolbox:
Presentation transcript:

Project Database Handler The Project Database Handler dbCCP4i is a brokering application that mediates interactions between the project database and an external applications. It is a lightweight Python server program that acts as a single point of access to the data for external applications and hides the implementation of the database from them. hidden within “client API” libraries. (So far Tcl and Python libraries have been implemented). The tracking database backend is based on the CCP4i “def file” format. An SQLite backend is also available which will be used for the proposed “knowledge database”. Work is also ongoing to integrate the handler into CCP4i (the CCP4 graphical user interface). WP 5.2: CCP4i Data Tracking in the PX Structure Determination Software Pipeline Introduction A key part of the integrated technology platform being delivered by the BIOXHIT project is the development of automated structure determination software pipelines that cover the post-data collection stages of structure solution by protein X-ray crystallography (PX). These pipelines need to accurately record and track the data that they produce, both for their own operation and for final deposition of the determined structures. BIOXHIT Workpackage 5.2 is principally concerned with developing a system for performing this data management in order to address the needs of software pipelines. This poster reports on the progress that has been made by CCP4 (BIOXHIT Partner 10) towards this end in the last year. Database for Project Data & Tracking A database is being designed and implemented which will be capable of storing both project data (the information used by each step in a pipeline) and project history (the steps taken and the provenance and evolution of information as the project progresses). The current “schema” is based on the CCP4i project and job database model, which supports simple tracking of project history by recording “jobs” (runs of software components). This is implemented using a CCP4i “def file” backend. In the next year of the project we aim to expand the tracking database and associated functionality, and supplement it with the implementation of an SQLite “knowledge database” component that will be able to store the crystallographic data items that are common between different applications in the software pipeline. The knowledge database content will be grown from a small “kernel” of data items and will be informed by a SQL schema developed in the previous year of the project. Visualisation Tools We have developed the dbviewer program as the first version of a visualiser for the project history data stored in the current version of the tracking database. This is a Tcl client application of the handler which uses the Graphviz package ( to show the history as a directed graph. Additional functions allow the user to explore various aspects of the history data to better understand the progress of their structure determination project. Project tracking system for the structure solution software pipeline Acknowledgements Workpackage 5.2 is co-ordinated by the Collaborative Computational Project No4 (CCP4), which provides a software suite for macromolecular structure determination by X-ray crystallography. Funding for the work described here has been provided by the European Commission as part of the BIOXHIT project, and by CCLRC. Valuable contributions to the work have also been made by the developers of the CCP4 Automation (HAPPy), XIA/e-HTPX and CRANK Projects, and by the EMBL Hinxton and EMBL Hamburg Partners within the BIOXHIT project. Peter Briggs and Wanjuan (Wendy) Yang, CCLRC Daresbury Laboratory, Warrington WA4 4AD, UK Project Database Handler CCP4 applications Non-CCP4 applications Project database CCP4i user interface Project Data Visualiser Other databases (PIMS, beamlines) Components of the system Project database handler Database for Project Data & Tracking Visualisation tools These components and their relationships are shown schematically in the figure (right), and are described in more detail in the sections below. Key considerations Implement a system for both manual and automated structure determination Allow multiple database back-ends Gather as much information from client programs as possible automatically Open architecture accommodating heterogenous software components Next steps Over the next 12 months the aims are to: Make release 0.1 of dbCCP4i and the visualiser to users and developers Finish integrating dbCCP4i into CCP4i Work with users to identify improvements to the visualiser Work with developers to integrate dbCCP4i into their applications and pipelines Expand the tracking database, and develop and implement the “knowledge database” See for more informationhttp:// The handler and clients communicate using XML-encoded messages passed via sockets; however these details are XML Tagging We have worked with the EBI to develop an XML schema that describes the final project history for deposition. We have also developed a client application starkey that can generate the project history marked up using the BIOXHIT XML tags. Availability The initial version of the handler, database and visualiser are due for public release by the end of February 2007, and will be available at along with other CCP4 BIOXHIT deliverables.