08-Nov-2007 Ekkehard Wieprecht SVR III MPE PCSS / HCSS / Pipeline Framework.

Slides:



Advertisements
Similar presentations
Configuration management
Advertisements

PACS SVR22/23 June 2006 Erich Wiezorrek, MPE Test Facility Capabilities EGSE.
Components of a Data Analysis System Scientific Drivers in the Design of an Analysis System.
Networking Problems in Cloud Computing Projects. 2 Kickass: Implementation PROJECT 1.
Key-word Driven Automation Framework Shiva Kumar Soumya Dalvi May 25, 2007.
PRESENTATION 3 Sri Raguraman CIS 895 Kansas State University.
Post Mortem Workshop - discussion1 17/1/2007 HWC Requirements GMPMA  Concentrate on pre-beam requirements Post-quench analysis ([semi-] automatic) Integrity.
Progress Report 11/1/01 Matt Bridges. Overview Data collection and analysis tool for web site traffic Lets website administrators know who is on their.
What is Where? u Getting Started With Geographic Information Systems u Chapter 5.
Computers: Information Technology in Perspective By Long and Long Copyright 2002 Prentice Hall, Inc. Developing Business Information Systems Chapter 11.
Julie McEnery1 Installing the ScienceTools The release manager automatically compiles each release of the Science Tools, it creates a set of wrapper scripts.
WP6: Grid Authorization Service Review meeting in Berlin, March 8 th 2004 Marcin Adamski Michał Chmielewski Sergiusz Fonrobert Jarek Nabrzyski Tomasz Nowocień.
7.1 The Software Engineering Discipline 7.2 The Software Life Cycle 報告者 : 林建任.
Condor Technology Solutions, Inc. Grace RFTS Application Extension Phase.
The Astro-Wise Pipeline Conceptual Design Review Roeland Rengelink Requirements Development Framework Prototype.
FP OntoGrid: Paving the way for Knowledgeable Grid Services and Systems WP8: Use case 1: Quality Analysis for Satellite Missions.
29/01/08Copyright AxoNet Software GmbHPage1 asanetwork An overview.
RUP Fundamentals - Instructor Notes
Implementing File and Print Services
Implementation Considerations Yonglei Tao. Components of Coding Standards 2  File header  file location, version number, author, project, update history.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
Conditions DB in LHCb LCG Conditions DB Workshop 8-9 December 2003 P. Mato / CERN.
MACIASZEK, L.A. (2001): Requirements Analysis and System Design. Developing Information Systems with UML, Addison Wesley Chapter 6 - Tutorial Guided Tutorial.
Maria Grazia Pia, INFN Genova Test & Analysis Project aka “statistical testing” Maria Grazia Pia, INFN Genova on behalf of the T&A team
1 st -4 th December st BioXHIT Annual Meeting WorkPackage 5.2: Implementation of Data management and Project Tracking in Structure Solution Peter.
Consortium Meeting La Palma October ICC Status Tanya Lim 1 SPIRE Consortium Meeting La Palma, Oct. 1 – ICC Status Tanya Lim RAL.
Visual Linker Prototype presentation.
A portal interface to my Grid workflow technology Stefan Rennick Egglestone University of Nottingham
Software Status Sonja Vrcic Socorro,
The perfSONAR Test Harness Brian Tierney, LBNL/ESnet.
SiD Workshop October 2013, SLACDmitry Onoprienko SiD Workshop SLAC, October 2013 Dmitry Onoprienko SLAC, SCA FreeHEP based software status: Jas 3, WIRED,
Author: Vera Kukić Supervisors: Shaun Bangay Adele Lobb George Wells
Definition The framework is a library that controls the flow of events and data through well-defined interface points defined by user-written algorithm.
Feedback from the POOL Project User Feedback from the POOL Project Dirk Düllmann, LCG-POOL LCG Application Area Internal Review October 2003.
Slide 1 Archive Computing: Scalable Computing Environments on Very Large Archives Andreas J. Wicenec 13-June-2002.
Project Database Handler The Project Database Handler is a brokering application that mediates interactions between the project database and the external.
PACS ICC in Operations SVR-3 MPE, 8/9 Nov 2007 O.H. Bauer.
7/6/2004 CMS weekZhen Xie 1 POOL RDBMS abstraction layer status & plan Zhen Xie Princeton University.
8 February 2008 DVTk – IHE Actor Simulation Rick Busbridge Agfa Healthcare.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 HIPE Introduction and Setup for SPIRE David Shupe, NHSC/IPAC on behalf of the SPIRE.
Project Database Handler The Project Database Handler is a brokering application, which will mediate interactions between the project database and other.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
LCG LCG-1 Deployment and usage experience Lev Shamardin SINP MSU, Moscow
23/2/2000Status of GAUDI 1 P. Mato / CERN Computing meeting, LHCb Week 23 February 2000.
Status of Control Unit Software Cristiano Bozza – 26/8/2015.
Page 1 PACS GRITS 17 June 2011 Herschel Data Analysis Guerilla Style: Keeping flexibility in a system with long development cycles Bernhard Schulz NASA.
RoOUG Iunie Bucuresti, 26 Iunie Agenda Inregistrarea participantilor ODI – Common Use Cases 2Iunie 2013.
IBM Global Services © 2005 IBM Corporation SAP Legacy System Migration Workbench| March-2005 ALE (Application Link Enabling)
PACS IBDR 27/28 Feb 2002 PACS ICC1 ICC (EGSE, IA/QLA, HCSS) Otto H. Bauer MPE Garching.
08-Nov-2007 Ekkehard Wieprecht SVR III MPE PACS Photometer Pipeline.
CATI Pitié-Salpêtrière CATI: A national platform for advanced Neuroimaging In Alzheimer’s Disease Standardized MRI and PET acquisitions Across a wide network.
T Project Review MalliPerhe Iteration 3 Implementation
D. Duellmann - IT/DB LCG - POOL Project1 The LCG Dictionary and POOL Dirk Duellmann.
Overview of C/C++ DB APIs Dirk Düllmann, IT-ADC Database Workshop for LHC developers 27 January, 2005.
T Project Review Muuntaja I1 Iteration
PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Preparing HIPE for SPIRE work David Shupe, NHSC/IPAC on behalf of the SPIRE ICC.
Management Information Systems. Presentation On DSS.
Ganga/Dirac Data Management meeting October 2003 Gennady Kuznetsov Production Manager Tools and Ganga (New Architecture)
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
Development Project Management Jim Kowalkowski. Outline Planning and managing software development – Definitions – Organizing schedule and work (overall.
15th CAA Cross-calibration workshop CIS archiving activities report University College of London 2012, April
1 Science Goal Monitor (SGM) Code 588 / Jenny Geiger.
H2LC The Hitchhiker's guide to LSA Core Rule #1 Don’t panic.
Sponsored by Portakal Technologies
Current Status of the Geometry Database for the CBM Experiment
RSA Client and Executor B-Spec
A portal interface to myGrid workflow technology
Division of Air AirCom DARM’s New Compliance and Enforcement Database and Field Inspection Tool.
Web Service Security support in the SSE Toolbox
Presentation transcript:

08-Nov-2007 Ekkehard Wieprecht SVR III MPE PCSS / HCSS / Pipeline Framework

08-Nov-2007 Ekkehard Wieprecht SVR III MPE DataFlow Erich Wiezorrek

08-Nov-2007 Ekkehard Wieprecht SVR III MPE Status PCSS/HCSS/Pipeline Framework -1- Calibration Framework - Adoption of the PCSS framework to HCSS common framework - Conversion of existing calibration files on the way - Adoption of Pipeline Modules on the way - Quite some work at this point of time - Documentation on the way -2- Documentation - User Manual is under review - Reference Manual need urgent review -3- PA/QA TestHarnesses - We had a TestHarness Workshop - We will get coordination support from HSC - We hope to make significant progress in this area soon

08-Nov-2007 Ekkehard Wieprecht SVR III MPE Status PCSS/HCSS/PIPELIN Framework -4- History - Prototype product history available - Missing link to calibration data ! - Now under responsibility of PACS -5- New Unit Framework - Pipeline modules not yet using it - Like calibration framework we need time and resources to adopt to the changes in the common system -6- End2End Test III : Nov 26 – Nov Level 0 Product generation - Level 0 definition : - Pipeline PlugIn successfully used for PACS Pool population - Problems : - Evolution to new Unit Framework - User exposure - PAL stability and performance (discussed during last CSDT) - Next steps : - Stabilize Interface to uplink data - Implement link to calibration data - Get User to it....

08-Nov-2007 Ekkehard Wieprecht SVR III MPE # # Connect to the PCSS standard Pool on PACS1 storage = StorageManager.getStorage("stdprod") # # Browse the Pool with GUI and fill shopping basket with : # -> 0 : Frames # -> 1 : ProductContext result = browseProduct(storage) print result.size() # # # Extract the result of the ShoppingBasket # Frames f = result[0].product print f print f.dimensions # Observation Context # obsCont = result[1].product # level0 = prod1.level0 print level0 print level0.refs f2 = level0.refs["HPSFITB"].product.refs[0].product print f2 # Housekeeping data hk = obsCont.refs["HPSHK"].product.refs[0].product print hk Level 0 access :

08-Nov-2007 Ekkehard Wieprecht SVR III MPE PAL GUI Interface need improvements

08-Nov-2007 Ekkehard Wieprecht SVR III MPE IA Components : QLA - stable - but common system changes requested work -> now solved by moving to PACS packages TrendAnalysis - PACS TA HK Tool stable - but common system changes requested work - Common TA framework available - Database Query possibilities under construction - PACS defined one “TA Product” so far --> need to be implemented in common framework --> but common framework not ready yet QualityPipeline - Currently covered by Pipeline - Error computation currently “very basic” in the Pipeline - QualityProduct currently not yet used