A. Amorim 1 The HERA-B database services detector configuration, calibration, alignment, slow control, data classification The HERA-B detector The database.

Slides:



Advertisements
Similar presentations
The Architecture of Oracle
Advertisements

March 24-28, 2003Computing for High-Energy Physics Configuration Database for BaBar On-line Rainer Bartoldus, Gregory Dubois-Felsmann, Yury Kolomensky,
M. D'Amato, M. Mennea, L.Silvestris INFN-Bari CMS Data Model 9-11 Aprile 2001, Catania I Workshop INFN Grid CMS DATA MODEL M. D’Amato, M. Mennea, L. Silvestris.
1 Cheriton School of Computer Science 2 Department of Computer Science RemusDB: Transparent High Availability for Database Systems Umar Farooq Minhas 1,
1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
ICS (072)Database Systems: A Review1 Database Systems: A Review Dr. Muhammad Shafique.
Technical Architectures
MS DB Proposal Scott Canaan B. Thomas Golisano College of Computing & Information Sciences.
CS 501: Software Engineering Fall 2000 Lecture 16 System Architecture III Distributed Objects.
ACAT 2002, Moscow June 24-28thJ. Hernández. DESY-Zeuthen1 Offline Mass Data Processing using Online Computing Resources at HERA-B José Hernández DESY-Zeuthen.
1 Introduction The Database Environment. 2 Web Links Google General Database Search Database News Access Forums Google Database Books O’Reilly Books Oracle.
The University of Akron Dept of Business Technology Computer Information Systems Database Management Approaches 2440: 180 Database Concepts Instructor:
F Fermilab Database Experience in Run II Fermilab Run II Database Requirements Online databases are maintained at each experiment and are critical for.
2/10/2000 CHEP2000 Padova Italy The BaBar Online Databases George Zioulas SLAC For the BaBar Computing Group.
Management Information Systems, 4 th Edition 1 Chapter 8 Data and Knowledge Management.
Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.
Chapter 2 Database System Architecture. An “architecture” for a database system. A specification of how it will work, what it will “look like.” The “ANSI/SPARC”
HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.
Data & Databases Basic Data Fundamentals. Data vs Information l Data: facts Computer systems store data. l Information: facts organized for a specific.
1 Alice DAQ Configuration DB
1 Berkeley DB What is Berkeley DB? Core Functionality Extensions for embedded systems Size.
NoSQL Databases Oracle - Berkeley DB. Content A brief intro to NoSQL About Berkeley Db About our application.
Massively Distributed Database Systems - Distributed DBS Spring 2014 Ki-Joune Li Pusan National University.
Copyright 2006 MySQL AB The World’s Most Popular Open Source Database MySQL Cluster: An introduction Geert Vanderkelen MySQL AB.
1099 Why Use InterBase? Bill Todd The Database Group, Inc.
LHC: ATLAS Experiment meeting “Conditions” data challenge Elizabeth Gallas - Oxford - August 29, 2009 XLDB3.
Time and storage patterns in Conditions: old extensions and new proposals António Amorim CFNUL- FCUL - Universidade de Lisboa ● The “Extended”
Information System Development Courses Figure: ISD Course Structure.
Universal Data Access and OLE DB. Customer Requirements for Data Access Technologies High-Performance access to data Reliability Vendor Commitment Broad.
The BESIII Offline Software Weidong Li Institute of High Energy Physics, Beijing Workshop on the cooperation of PRC-US in HEP 16 June 2006.
Intro – Part 2 Introduction to Database Management: Ch 1 & 2.
Web application for detailed real-time database transaction monitoring for CMS condition data ICCMSE 2009 The 7th International Conference of Computational.
ICS (072)Database Systems: An Introduction & Review 1 ICS 424 Advanced Database Systems Dr. Muhammad Shafique.
Configuration Database Antony Wilson MICE CM February 2011 RAL 1.
ALICE, ATLAS, CMS & LHCb joint workshop on
ATLAS Detector Description Database Vakho Tsulaia University of Pittsburgh 3D workshop, CERN 14-Dec-2004.
A. Amorim 1 The HERA-B database services detector configuration, calibration, alignment, slow control, data classification The HERA-B detector The database.
Introduction to Oracle. Oracle History 1979 Oracle Release client/server relational database 1989 Oracle Oracle 8 (object relational) 1999.
Clara Gaspar, March 2005 LHCb Online & the Conditions DB.
The Persistency Patterns of Time Evolving Conditions for ATLAS and LCG António Amorim CFNUL- FCUL - Universidade de Lisboa A. António, Dinis.
Introduction CMS database workshop 23 rd to 25 th of February 2004 Frank Glege.
Databases in CMS Conditions DB workshop 8 th /9 th December 2003 Frank Glege.
INTRODUCTION TO DBS Database: a collection of data describing the activities of one or more related organizations DBMS: software designed to assist in.
Management Information Systems, 4 th Edition 1 Chapter 8 Data and Knowledge Management.
Database Server Concepts and Possibilities Lee Lueking D0 Data Browser Workshop April 8, 2002.
Michele de Gruttola 2008 Report: Online to Offline tool for non event data data transferring using database.
Dispatching Java agents to user for data extraction from third party web sites Alex Roque F.I.U. HPDRC.
DoE Review January 1998 Online System WBS 1.5  One-page review  Accomplishments  System description  Progress  Status  Goals Outline Stu Fuess.
ESG-CET Meeting, Boulder, CO, April 2008 Gateway Implementation 4/30/2008.
Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.
Configuration database status report Eric van Herwijnen September 29 th 2004 work done by: Lana Abadie Felix Schmidt-Eisenlohr.
The ATLAS DAQ System Online Configurations Database Service Challenge J. Almeida, M. Dobson, A. Kazarov, G. Lehmann-Miotto, J.E. Sloper, I. Soloviev and.
Summary of User Requirements for Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Offline Week Alignment and Calibration Workshop February.
Summary of Workshop on Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Computing Day February 28 th 2005.
The DCS Databases Peter Chochula. 31/05/2005Peter Chochula 2 Outline PVSS basics (boring topic but useful if one wants to understand the DCS data flow)
Zookeeper Wait-Free Coordination for Internet-Scale Systems.
1 Information Retrieval and Use De-normalisation and Distributed database systems Geoff Leese September 2008, revised October 2009.
E Ethernet C CAN bus P Profibus HV HV cables LV LV cables (+busbar) S Serial (RS232) Signal cable Other/Unknown Liquid or Gas Cable and/or Bus PCI-XYZ.
ATLAS The ConditionDB is accessed by the offline reconstruction framework (ATHENA). COOLCOnditions Objects for LHC The interface is provided by COOL (COnditions.
Making Sense of Service Broker Inside the Black Box.
Slow Control and Run Initialization Byte-wise Environment
Slow Control and Run Initialization Byte-wise Environment
Database Replication and Monitoring
Improving searches through community clustering of information
CMS High Level Trigger Configuration Management
Controlling a large CPU farm using industrial tools
Download Microsoft Exam Dumps - Valid Microsoft Question Answers - Realexamdumps.com
Developing and testing enterprise Java applications
HERA-B status report Reinhard Eckmann University of Texas at Austin
Presentation transcript:

A. Amorim 1 The HERA-B database services detector configuration, calibration, alignment, slow control, data classification The HERA-B detector The database problem The Architecture The Berkeley-DB DBMS The client/server integration The domains and solutions Conclusions and Outlook A. Amorim, Vasco Amaral, Umberto Marconi, Tome Pessegueiro, Stefan Steinbeck, Antonio Tome, Vicenzo Vagnoni and Helmut Wolters

A. Amorim 2 HERA-B Experiment B/B-tagging B 0 /B 0 J/  K S Vertex Detector Si strip 12  m resolution RICH (  /K) multianode PMT TRD (e  h) straw tubes +thin fibers ECAL(  +e  h) W/Pb scintillator shashlik MUON (  h) tube,pad and gas pixel chambers Tracking: - ITR(<20cm): MSGC-GEM - OTR(>20cm): 5+10mm drift cells Magnet: 2 Tm C 4 F 10 HiPt trigger pad/gas pixel

A. Amorim 3 The main challenge: Selecting

A. Amorim 4 HERA-B DAQ L2-farm: 240 PC’s L4-farm 200 PC’s 1000 SHARC (DSP) Detector Front End Electronics FCS DSP SWITCH Event Control Trigger PC Trigger PC Trigger PC INTERNET SWITCH 4LT PC 4LT PC Logger PC SLT/TLT 4LT

A. Amorim 5 The HERA-B database problem To provide persistence services (including online-offline replication) to: Detector configuration Common accepted schema Calibration and alignment Distributing information to the reconstruction and trigger farms Associate each event with the corresponding database information Slow control Manage updates without data redundancy Data set and event classification Online Bookkeeping Detector Configuration Calibration and Alignment Slow Control Data Set and Event Classification Online Bookkeeping

A. Amorim 6 Characterizing the context

A. Amorim 7 Keys, objects and client/server client/server at the SDB level + RPM -> an UDP based communication package. /PM/ Descrip. field1 ; field 2; Db: /RICH/HV/ versions Key= name+ version Machine independent blub of DATA

A. Amorim 8 The Berkeley DB See Embedded transactional store with: logging, locking, commit and roll back, disaster recovery. Intended for: high-concurrency read-write workloads, transactions and recoverability. Cursors to speed access from many clients.. Open Source policy The license is free for non-commercial purposes - rather nice support No client/server support is provided

A. Amorim 9 Slow Control Interface Metadata Object Data ObjectUpdate time Pmt1000 Pmt1003 Pmt2000 Update Optimized Queries

A. Amorim 10 Associations to Events Index Objects (referenced by events) Client/server Active server interface Index Obj.... Index Obj.... Revision 0 - online Index Obj. Calibrating 1 - offline Dynamic Associations Index Obj. Created in active Servers

A. Amorim 11 Basic n-n associations (LEDA) LEDA - Object Manager (hash table implemented associations) Key objects (referenced by events) Client/server Active server interface Key key’ Key key’ Associations are navigated with iterators Using hash tables. Keys as OID’s with the scope of classes. Explicitly loaded or saved (as containers)

A. Amorim 12 GUI for editing and drawing From R&D: JAVA, TCL/TK, gtk Reusing and extending widget. Data hidden from TCL/TK ROOT database Binding Socket: Client/ Server

A. Amorim 13 General Architecture 10 9 Evt./y

A. Amorim 14 Conclusions ONLINE: Large number of Clients => Gigabytes per Update broadcast simultaneously to SLT tree of cache database servers to the 4LT Correlates (dynamically) each event with the databases objects 600 k SLC parameters using data and update objects parameter history is re-clustered on the database servers The online database system has been successfully commissioned OFFLINE: Replication mechanism decouples online from offline also provides incremental backup of the data TCP/IP gateways and proxies “data warehousing” for data-set classification -> MySQL Relation to event tag under evaluation Also providing persistency to ROOT objects Using Open Source external packages has been extremely useful.