Data collection and organization Bob Sinkovits AfCS Bioinformatics Lab SDSC.

Slides:



Advertisements
Similar presentations
Abuse Testing Laboratory Management Laboratory Management.
Advertisements

Chapter 20 Oracle Secure Backup.
Do Now: Choose One 1) List the three major kinematic equations 2) Define displacement, velocity and acceleration using complete sentences.
Data Extraction, Cleanup & Transformation Tools
The Rice Functional Genomics Program of China cDNA microarray database (RIFGP-CDMD) consists of complete datasets, including the probe sequences, microarray.
Active Directory: Final Solution to Enterprise System Integration
Glue Microarray Database System Using Struts Technology Chen Liu Bioinformatics Group Meeting May 13, 2002.
Bioinformatics Core (B) Progress and Future Goals
MASPLAS’02 Online Course Opinion Survey System by Saurabh Pethe, Richard Hennings, William Baker, Nadine Brown, Shobhana Misra.
REMODECE MEETING January, the 29th ENERTECH REMODECE Web server Query analyzer Data base software WEB USER Browser Query Answer Database Design.
Components and Architecture CS 543 – Data Warehousing.
Multiple Tiers in Action
Report Distribution Report Distribution in PeopleTools 8.4 Doug Ostler & Eric Knapp 7264.
How Clients and Servers Work Together. Objectives Learn about the interaction of clients and servers Explore the features and functions of Web servers.
MARS: Microarray analysis, retrieval, and storage system Albert F. Cervantes.
CaTissue customizations at Indiana University and Regenstrief Institute.
Laboratory Information Management Systems. Laboratory Information The sole product of any laboratory, serving any purpose, in any industry, is information.
Ligand Screens in RAW Cells – Cytokine Release Ron Taussig AfCS Annual Meeting Dallas, TX May, 2004.
Yeast 2-hybrid database Plasmid database ATCC plasmid distribution Alliance for Cell Signaling Myriad Genetics Inc. American Type Culture Collection.
Star (Traditional) Database Tasks & MySQL 1. Database Types & Operation Issues 2. Server & Database deployments 3. Tools with MySQL 4. Data definition.
ADVANCED MICROSOFT ACTIVE DIRECTORY CONCEPTS
Chapter 9 Collecting Data with Forms. A form on a web page consists of form objects such as text boxes or radio buttons into which users type information.
Week 6 Operating Systems.
© 2008 LabKey Software Simplifying Scientific Data Management with LabKey Server January 29, 2009 Presenter: Peter Hussey,
Computing for Bioinformatics Introduction to databases What is a database? Database system components Data types DBMS architectures DBMS systems available.
Data management, curation, statistical analysis & display Bob Sinkovits AfCS Bioinformatics Lab San Diego Supercomputer Center UC San Diego.
BaBar WEB job submission with Globus authentication and AFS access T. Adye, R. Barlow, A. Forti, A. McNab, S. Salih, D. H. Smith on behalf of the BaBar.
Week 7 Lecture Web Database Development Samuel Conn, Asst. Professor
© 2011 Delmar, Cengage Learning Chapter 9 Collecting Data with Forms.
The AfCS Bioinformatics Laboratory The AfCS Data Coordination and Bioinformatics Laboratory 2002 Goal 1 Acquire, Process, and Disseminate Information.
Admin Tool June 11, Admin Tool Overview Architecture Implementation Dependencies Futures 2.
Chapter 3.  Help you understand different types of servers commonly found on a network including: ◦ File Server ◦ Application Server ◦ Mail Server ◦
Rahul Raman, Ram Sasisekharan Bioinformatics Core Massachusetts Institute of Technology Glue Grants Bioinformatics Meeting April 22-23, 2004 San Diego,
 Chapter 6 Architecture 1. What is Architecture?  Overall Structure of system  First Stage in Design process 2.
Security David Frommer Principal Architect Business Intelligence Microsoft Partner of the Year 2005 & 2007.
Putting it all together Dynamic Data Base Access Norman White Stern School of Business.
OME-TIFF and Bio-Formats K. Eliceiri, E. Hathaway, M. Linkert, and C. Rueden
1 maxdLoad The maxd website: © 2002 Norman Morrison for Manchester Bioinformatics.
Genomics Laboratory University Medical Center Utrecht... Microarray technology group microarray production and use Transcription regulation genome-wide.
2-Tier,3-Tier datawarehouse Submitted by Manisha Dubey & Akanksha Agrawal.
MIS2502: Data Analytics The Information Architecture of an Organization.
CS 7: Introduction to Computer Programming Java and the Internet Sections ,2.1.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 14 Database Connectivity and Web Technologies.
Introduction Sample Projects Resources Summary Future Plans Bioinformatics Support Information Session Karsten Hokamp TCD 3rd October, 2007.
Advanced samples Printing two types of labels from two different custom forms We have two different labels that contain the same data. One is suitable.
XML Standards for Proteomics Data Andrew Jones, Dr Jonathan Wastling and Dr Ela Hunt Department of Computing Science and the Institute of Biomedical and.
Experiment Management System CSE 423 Aaron Kloc Jordan Harstad Robert Sorensen Robert Trevino Nicolas Tjioe Status Report Presentation Industry Mentor:
Acknowledgements Frank Amador and Becky Fulin of the AfCS Antibody Laboratory; Katherine Hawes, Jason Polasek, and Paul Sternweis (Director) of the AfCS.
E-Curator: A Web-based Curatorial Tool Ian Brown, Mona Hess Sally MacDonald, Francesca Millar Yean-Hoon Ong, Stuart Robson Graeme Were UCL Museums & Collections.
RAW two-ligand screen Strategy to Monitor Protein Phosphorylation for the Macrophage Ligand Screen  Cell Preparation and Analysis Lab: Expose RAW.
File Manager A Robust User Interface to the Stanford Microarray Database (SDM) M.S. Pilot Adviser: M. W. Berry John Clayton England, III 04/10/2003.
CaArray User Community Meeting Feature Overview and Review of MAGE-TAB Update and Export Specification Call in: Participant Passcode:
ESG-CET Meeting, Boulder, CO, April 2008 Gateway Implementation 4/30/2008.
Difference between DBMS and File System
Thanks for giving me an opportunity to share with you our process for controlling media and other supplies. Disclaimer: We are not yet accredited to ISO.
Rights Management for Shared Collections Storage Resource Broker Reagan W. Moore
Mass Spectrometic Analysis of Phosphatidylinositol Phosphates Pavlina T. Ivanova, Stephen B. Milne, Jeffrey S. Forrester, Michelle D. Armstrong and H.
The Bovine Genome Database Abstract The Bovine Genome Database (BGD, facilitates the integration of bovine genomic data. BGD is.
Current Globus Developments Jennifer Schopf, ANL.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Motivation Give the users a quick overview of the signaling pathways activated by selected ligands. Provide an easy way to navigate through the data. Offer.
11 Copyright © 2004, Oracle. All rights reserved. Performing a Migration Using Oracle Migration Workbench (Part II)
Informatics Tools applicable to diverse entomological studies of mosquitoes Samson Kiware Research Scientist/Wellcome Trust Fellow Ifakara.
Sample Registration - Introduction
Web App vs Mobile App.
A Guide to Shift’s Open Data ecosystem & Data workflow
A Web-Based Tool for Gathering Ordinal Rankings
Number Scoring of Phosphospecific
Presentation transcript:

Data collection and organization Bob Sinkovits AfCS Bioinformatics Lab SDSC

Experimental data Data acquisition for the AfCS involves the separate transfer of experimental data and the description of the experiment SDSC Experimental Lab GUIs wget

GUIs GUIs based on the Java Swing classes are used to collect information about the experiment. For example Cell prep, mouse, thaw, information Protein, mRNA, lipid extracts Ligands, solutions, reagents, buffers Technician, laboratory, date Protocols and equipment details

Ligand GUI

Treatment GUI

GUI deployment – Java web start

Barcoding All experimental samples and materials (protein extracts, gels, cell preps, plasmids, solutions, reagents, etc.) are physically labeled using a 2-d barcode. Zebra Z4M barcode printer Symbol Cyclone scanner

Transfer of experimental data Experimental data files transferred on a nightly basis using UNIX wget utility under control of cron job StanfordCaltech SDSC UTSWUCSF Ca++, cAMP phosphoprotein cytokine microarray microscopy single cell Ca++ Ca++ Vanderbilt Lipid MS Myriad Y2H

Storage of experimental data Each type/category of experimental data is stored in a separate database schema Easier to work with schemas containing smaller numbers of tables Minimizes possibility of data loss/corruption Avoids confusion due to multiple developers working in a single schema (overlap of namespaces) Easier recovery Privileges granted as needed between schemas

Storage of experimental data LIMS (GUI) applications insert data directly into BARCODE database schema Unprocessed experimental results files stored directly in Storage Resource Broker Results files processed using perl scripts and loaded into appropriate schemas cytokine calcium camp western y2h (yeast two-hybrid) lipid_ms m_array

Interactions between schemas Experimental results labeled using barcode IDs generated by LIMS. Select privileges granted from BARCODE to experimental schemas so that data can be grouped and analyzed ECD031202A01ECD031202A02ECD031202A RAW cells treated with 10  M UTP (data from BARCODE schema) Ca++ time course data

Security and access control Access to all restricted areas of AfCS project (including GUIS) controlled through centralized access control system  Access to barcode GUIs  Access to data curation

Data authentication All experimental data comes from trusted sources and is downloaded from servers at the participating laboratories For the AfCS data, the main problems are Flagging bad experiments Controlling release of data to public (data not released until it has been verified and replicated) Curation of data done through web interfaces

Data curation Main curation page provides links to data sets

Data curation Curation of Ca++ assay results