PACS SVR II – SPU HLSW Garching, 18th Jan 2007 prepared by R. Ottensamer and C. Reimers.

Slides:

Advertisements

Similar presentations

MEMORY MANAGEMENT Y. Colette Lemard. MEMORY MANAGEMENT The management of memory is one of the functions of the Operating System MEMORY = MAIN MEMORY =

Advertisements

Test process essentials Riitta Viitamäki,

Parameter control Chapter 8. A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Parameter Control in EAs 2 Motivation 1 An EA has many.

Parameter Control A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Chapter 8.

PACS IQR Kick-off ESTEC, 13 Jan 2005 PACS Management, …1 PACS Management, Funding and Schedule Otto H. Bauer MPE Garching.

Chapter 5: Common Support Problems

Computer Programming and Basic Software Engineering 4. Basic Software Engineering 1 Writing a Good Program 4. Basic Software Engineering 3 October 2007.

18 June 2010 Upgrading Your Geant4 Release J. Perl 1 Upgrading Your Geant4 Release Joseph Perl, SLAC.

70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 2: Managing Hardware Devices.

Runtime alignment system SOFTWARE DESIGN IDEAS Wed 4 th May 2005 P Coe.

PACS IIDR 01/02 Mar 2001 Herschel PACS SPU - IAC1 Herschel PACS - IIDR SIGNAL PROCESSING UNIT (SPU) HW Unit, Start-up SW and Low-level SW Drivers José.

Lecture 3 Properties of Summary Statistics: Sampling Distribution.

Activity 1 - WBs 5 mins Go online and spend a moment trying to find out the difference between: HIGH LEVEL programming languages and LOW LEVEL programming.

PACS IBDR 27/28 February 2002 PACS DEC/MEC1 Detectors & Mechanisms Controllers (DEC/MEC) J.-M. Gillis Centre Spatial de Liège (B)

Tuning DiFX2 for performance Adam Deller ASTRON 6th DiFX workshop, CSIRO ATNF, Sydney AUS.

Software Testing Life Cycle

70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 2: Managing Hardware Devices.

PACS IBDR 27/28 Feb 2002 SPU High Level Software1 H. Bischof, A.N. Belbachir (TUVIE) F. Kerschbaum, R. Ottensamer, P. Reegen, C. Reimers (UVIE)

PACS SVR22/23 June 2006 PACS Thermal Behaviour1 PACS Thermal Behaviour Tests T. Müller, H. Feuchtgruber, A. Contursi, Cs. Kiss, Sz. Csizmadia.

By Anthony W. Hill & Course Technology1 Common End User Problems.

Or ways to enhance coding enjoyment, productivity and, most of all, preserve your sanity. Nicolas Connault Web developer Moodle HQ February 19 th 2008.

CS 350 – Software Design The Object Paradigm – Chapter 1 If you were tasked to write code to access a description of shapes that were stored in a database.

HKS Analysis Status Report HKS Analysis Status Report Liguang Tang (Hampton/JLAB) Hall C User Meeting, Jan. 15, 2011 HKS has data taken in 2005 (E01-011)

PACS IQR 13 Jan 2005 PACS OBSW1/33 PACS On-board Software & User Manual A. Belbachir (UVIE/TUVIE, SPU) H. Feuchtgruber (MPE, SE) A. Mazy (CSL, DMC) S.

PACS IBDR 27/28 Feb 2002 IIDR Close-out1 Close-out of IIDR Recommendations A. Poglitsch.

1 ENERGY 211 / CME 211 Lecture 26 November 19, 2008.

CS 346 – Chapter 1 Operating system – definition Responsibilities What we find in computer systems Review of –Instruction execution –Compile – link – load.

Scheduling policies for real- time embedded systems.

PACS IIDR 01/02 Mar 2001 On-Board Data Compression1 On-Board Data Compression Concept A. N. Belbachir Vienna University of Technology.

PACS IQR 13 Jan 2005 First Assessment1 The PI’s Self-Assessment A. Poglitsch.

Software Engineering Chapter 3 CPSC Pascal Brent M. Dingle Texas A&M University.

PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 SPIRE AOTs, Products and Quick Look Tools Bernhard Schulz NHSC/IPAC on behalf of the.

1 Control Software (CAT) Introduction USB Interface implementation Calorimeter Electronics Upgrade Meeting Frédéric Machefert Wednesday 5 th May, 2010.

SCIOPS 2013 Reinhard Hanuschik, ESO Garching The VLT Quality Control Loop.

Page 1 PACS HSC SPIRE Webinar 6 th Mar 2013 Introduction and General HIPE changes that impact SPIRE Bernhard Schulz NHSC/IPAC on behalf of the SPIRE ICC.

Chapter 8 Delving Into The Use of Inference 8.1 Estimating with Confidence 8.2 Use and Abuse of Tests.

Basic Input/Output System

ESRI User Conference 2004 ArcSDE. Some Nuggets Setup Performance Distribution Geodatabase History.

Bit-DSP-MicrocontrollerTMS320F2812 Texas Instruments Incorporated European Customer Training Center University of Applied Sciences Zwickau (FH)

Memory Management. Introduction To improve both the utilization of the CPU and the speed of its response to users, the computer must keep several processes.

/ 26 Evolutionary Computing Chapter 8. / 26 Chapter 8: Parameter Control Motivation Parameter setting –Tuning –Control Examples Where to apply parameter.

Quantifying Population Extinction and Examining the Effects of Different Mutation Rates Jason Stredwick Farshad Samimi Wei Huang Matt Luciw Matthew Rupp.

Franco Carbognani, EGO LSC-Virgo Meeting May 2007 Status and Plans LIGO-G Z Software Management.

Copyright 2007, Information Builders. Slide 1 Machine Sizing and Scalability Mark Nesson, Vashti Ragoonath June 2008.

PACS IBDR 27/28 Feb 2002 OBSW Simulation1 PACS OBSW Simulation/Test A.Mazy (CSL), S.Pezzuto (IFSI), A.N.Belbachir (TUVIE), H. Feuchtgruber (MPE)

PACS SVR 22/23 June 2006 Test Campaigns1 Overview of PACS Test Campaigns Helmut Feuchtgruber MPE.

Herschel EQM – Results and Lessons Learnt6/7 Feb 2006 PACS Overall Analysis1 Overall PACS EQM IMT Analysis Contributions by PACS ICC.

JRA-1 Meeting, Jan 25th 2007 A. Cotta Ramusino, INFN Ferrara 1 EUDRB: A VME-64x based DAQ card for MAPS sensors. STATUS REPORT.

NETW3005 Memory Management. Reading For this lecture, you should have read Chapter 8 (Sections 1-6). NETW3005 (Operating Systems) Lecture 07 – Memory.

Building reliable, high- performance communication systems from components Xiaoming Liu, Christoph Kreitz, Robbert van Renesse, Jason Hickey, Mark Hayden,

1 Process Description and Control Chapter 3. 2 Process A program in execution An instance of a program running on a computer The entity that can be assigned.

Silberschatz, Galvin and Gagne ©2011 Operating System Concepts Essentials – 8 th Edition Chapter 2: The Linux System Part 3.

Observing the Current System Benefits Can see how the system actually works in practice Can ask people to explain what they are doing – to gain a clear.

Objectives 4 Identify the meaning of software maintenance and it’s importance in the project life cycle 4 Understand why maintenance is needed.

MINIX Presented by: Clinton Morse, Joseph Paetz, Theresa Sullivan, and Angela Volk.

PACS IHDR12/13 Nov 2003 Warm Electronics1 Warm Electronics: Overview, Interfaces, Grounding and EMC Martin von Berg PACS IHDR.

Legacy Systems and Software Reuse CS 560. Economics Software is expensive.  Most software development makes extensive use of existing software.  Developers.

Introduction to HPC Debugging with Allinea DDT Nick Forrington

First INFN International School on Architectures, tools and methodologies for developing efficient large scale scientific computing applications Ce.U.B.

T Project Review X-tremeIT PP Iteration

Optimizing your windows system. Windows updates Updates Security updates Feature updates Driver updates Service pack A group of features & Security updates.

Whatcha doin'? Aims: To start using Python. To understand loops.

Data Processing Status

Mission Science By Team 07.

Memory Management Tasks

Object-Oriented and Classical Software Engineering Fifth Edition, WCB/McGraw-Hill, 2002 Stephen R. Schach

LGS Project Meeting December 21, 2006 Agenda SWIFT update - A. Bouchez

Parameter control Chapter 8.

Parameter control Chapter 8.

Presentation transcript:

PACS SVR II – SPU HLSW Garching, 18th Jan 2007 prepared by R. Ottensamer and C. Reimers

PACS SVR II - SPU HLSW Garching, 18th Jan 2007 SVR I – SVR II: Overview SVR I: v12.2 FM-ILT: v12.81 SVR II: v13.1 „Cleaned“ „Problematic“ „Survive ILT“ Photometry broken, various problems tests were made with no major showstoppers better performance, CAPTEC comments, reliability, maintainability

PACS SVR II - SPU HLSW Garching, 18th Jan 2007 Starting Point: SVR I in June 06 SVR I: v12.2 Spectroscopy CQM data: 16 samples/mean 100 kbit/s, CPU at 100% Photometry FM testdata: 150 kbit/s CPU at 100% Various open problems Synchronization, Bol Signs,... „Problematic“ -red colour in almost all areas, especially CPU load -biggest problem: FM Bol Data so much different than expected -code is very unclean / hard to maintain -another question mark: FM Spec Data -tests would have been possible, but with some restrictions -risk of running into unknown bugs

PACS SVR II - SPU HLSW Garching, 18th Jan 2007 Support by MPE (1) Roland Ottensamer HLSWDOC/PAPCSS Christian Reimers Angela Baier M. Wetzstein E. Wieprecht DXSET Calfiles Next-Gen DXSET Editor SupportUM/TP/TR/...

PACS SVR II - SPU HLSW Garching, 18th Jan 2007 Rescue: Survival Version for the Tests -main goal: fix broken Photometry -v12.8 delivered major bugfix (v12.81) on very robust Photometry reduction scheme and LLC -bad luck: FM Spec Data lead to Autostop in best configuration -numerous smaller fixes / reactions to SPRs FM-ILT: v12.81 „Survive IMT“ Photometry kbit/s, mostly ~145 CPU at ~55% still some minor problems timing, bugs...  Tests performed in slope fitting mode Spectroscopy FM data: 16 samples/mean goes to Autostop (CPU)

PACS SVR II - SPU HLSW Garching, 18th Jan 2007 Support by MPE (2) Roland Ottensamer HLSW Christian Reimers Angela Baier Second SPU HW Setup A. Mazy independent from IMT code cleaning and optimization FM Data Analyses

PACS SVR II - SPU HLSW Garching, 18th Jan 2007 Improvements so far: Cleaned Version -development started in Sept 06 -strict coding conventions applied and CAPTEC recommendations incorporated -cleanup of old and unused code -Autostop strategy changed -clean task communication and reassigned task priorities -checksum for compressed data -CPU performance optimization ~10% -Photometry: Nr. of frames / average can be chosen freely SVR II: v13.1 „Cleaned“ Spectroscopy FM data: 16 samples/mean 120 kbit/s, CPU at 95% Various small improvements Maintainability, Robustness, Memory, Tasks, Errors,... Photometry kbit/s, mostly ~145 CPU at ~55%

PACS SVR II - SPU HLSW Garching, 18th Jan 2007 Lessons learnt: Don‘t trust the DSP Divisions, square roots and other math functions can have wrong results!... the compiler The default optimization flag –O2 can produce wrong code!... the drivers / library The function MEM_CopyDMToDM turned out to be a sink hole for CPU power!... bug reports Sometimes SPRs are raised just by suspicion hardware and documentation Detector sorting changed several times...

PACS SVR II - SPU HLSW Garching, 18th Jan 2007 Lessons learnt: Users don‘t use parameters Although a number of parameters can be set to configure compr/red, they have never been used!... detector selection Unless there is absolutely no other way, the whole array is always transmitted.... compression modes Other modes than default were hardly ever used.

PACS SVR II - SPU HLSW Garching, 18th Jan 2007 Next Improvements: Cleaned Version Photometry - final fine tuning of the „survival“ scheme and an adapted LLC allows 15% less TM at the cost of some CPU  125kbit/s at 70% load (TBC) tested and finalized in Feb Spectroscopy current scheme needs better adaptation to FM data current LLC needs revision/cleaning  save kbits and CPU power Header Compression - final fine tuning allows to save 1-2kbit/s and ~3% CPU at the same time Feb / Mar more cleaning / tuning Optimizations to save bandwidth and CPU power bugs still being found never ending? tested and finalized in Feb

PACS SVR II - SPU HLSW Garching, 18th Jan 2007 Goal: flight version 13.2 by February Photometry Spectroscopy averaging of 4 samples * 125 kbit/s at 70% CPU load * (remember: any number can be selected: 2, 3, 4, 5, 6, 7, 8, 9,...) 16 samples / submean 120 kbit/s at 90% CPU load