Data Examination and Checking Programs--Requirements B. Carlson

Slides:



Advertisements
Similar presentations
Test Builder & Test Executor Sonja Vrcic Socorro, December 12, 2007.
Advertisements

Pre-OTS Tests Penticton—H/W B. Carlson EVLA Correlator F2F Meeting Dec , 2007.
EE694v-Verification-Lect5-1- Lecture 5 - Verification Tools Automation improves the efficiency and reliability of the verification process Some tools,
Principle of Functional Verification Chapter 1~3 Presenter : Fu-Ching Yang.
Troubleshooting methods. Module contents  Avaya Wireless tools  Avaya Wireless Client Manager  Avaya Wireless AP Manager  Hardware indicators  Non.
Programmer’s Guide to the EVLA Correlator B. Carlson EVLA Correlator S/W F2F Apr. 3-4, 2006.
The Prototype Correlator Sonja Vrcic Socorro, 5. December, 2006.
14-15 May,2002 EVLA Correlator Backend Functional Design Tom Morgan 1 Backend Preliminary Functional Design.
Software Development Software Testing. Testing Definitions There are many tests going under various names. The following is a general list to get a feel.
Station Board EVLA F2F Meeting: December Dave FortEVLA F2F Meeting: 11/12 December Outline Station Board Review Station Board Status Delay.
Unit-5 Automated Comparison. VERIFICATION Verification and Validation are independent procedures that are used together for checking that a product, service,
Correlator Growth Path EVLA Advisory Committee Meeting, March 19-20, 2009 Michael P. Rupen Project Scientist for WIDAR.
Pre-OTS Testing in Penticton Sonja Vrcic Socorro, December 11, 2007.
Software Status Sonja Vrcic Socorro,
EVLA Correlator Prototype and OTS Testing B. Carlson EVLA Correlator S/W F2F Apr 3-4, 2006.
EVLA Corr Racks/Cables etc. B. Carlson EVLA Correlator F2F Meeting Dec , 2007.
WIDAR Real-Time Data Display D. Del Rizzo EVLA Correlator Software f2f April 3-6, 2006.
Brent CarlsonEVLA System PDR (Correlator V2) December 4-5, Correlator.
Introduction to EVLA Software Bryan Butler. 2006Dec05/06EVLA M&C Transition Software CDR2 EVLA Computing (Terse) History The original EVLA Phase I proposal.
Station Board Testing EVLA Correlator S/W F2F 3-4 April 2006 D. Fort.
18-19 July, 2002Correlator Backend System OverviewTom Morgan 1 Correlator Backend System Overview Tom Morgan, NRAO.
Configuration Mapper Sonja Vrcic Socorro,
Output Formats Part I Bryan Butler NRAO Oct-31EVLA Correlator f2f2 Overview 2 types of data: –Monitor data - of interest to engineers and system.
M.P. RupenCorrelator Face-to-Face Meeting 31 Oct 2006 Output Formats Part II Michael P. Rupen.
M.P. RupenEVLA Advisory Committee Meeting September 6-7, Correlator Test Plan Michael P. Rupen.
M.P. RupenCorrelator Connectivity Scheme Review 31 July Correlator Specifications Michael P. Rupen.
Software Requirements for the Testing of Prototype Correlator Sonja Vrcic Socorro, December 11, 2007.
M.P. Rupen, Synthesis Imaging Summer School, 18 June Cross Correlators Michael P. Rupen NRAO/Socorro.
Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array ALMA Correlator.
CCNA 2 Router and Routing Basics Module 8 TCP/IP Suite Error and Control Messages.
Summary of IAPP scientific activities into 4 years P. Giannetti INFN of Pisa.
SAGE meeting Socorro, May 22-23, 2007 WIDAR Correlator Overview Michael P. Rupen Project Scientist for WIDAR & Software.
ITIL: Service Transition
Configuration Management
Software Testing Strategies for building test group
Software Overview Sonja Vrcic
Chapter 4: Business Process and Functional Modeling, continued
Chapter 11 Designing Inputs, Outputs, and Controls.
Software Project Management
EVLA Availability - or - When Can I Use It?
Lect 11 - Stimulus & Response
Identifying the troubles N Applying basic troubleshooting techniques
Some Simple Definitions for Testing
Correlator – Backend System Overview
Introduction to cosynthesis Rabi Mahapatra CSCE617
EVLA Correlator F2F Meeting Dec , 2007
EVLA Prototype Correlator (PTC)
EVLA Correlator New Connectivity Scheme Software Impact Sonja Vrcic
VCI Overview Sonja Vrcic
Introduction to Software Testing
PTC Setup at VLA B. Carlson
Lecture 09:Software Testing
STATIC TIMING ANALYSIS, CROSS TALK AND NOISE
Observational Astronomy
Observational Astronomy
Processor Fundamentals
Backend System Requirements
EVLA Monitor & Control System
Prototype Correlator Testing
Lect 11 - Stimulus & Response
This presentation document has been prepared by Vault Intelligence Limited (“Vault") and is intended for off line demonstration, presentation and educational.
Chapter 10 – Software Testing
Test Case Test case Describes an input Description and an expected output Description. Test case ID Section 1: Before execution Section 2: After execution.
NAT NPX138N VHF-FM Radio Part II
Prototype Correlator Tests on the Critical Path
Correlator Growth Path
VLA EXPANSION PROJECT Correlator Issues.
PSS0 Configuration Management,
Sam Williams IRAM Summer Retreat 2000
Verification and Validation
Presentation transcript:

Data Examination and Checking Programs--Requirements B. Carlson EVLA Correlator F2F Meeting Dec. 11-12, 2007

EVLA Correlator F2F Meeting - Data Check Progs. Outline Overview of data products. H/W validation. H/W verification. In-system checkout/operational verification. B. Carlson, 2007-Dec 11-12 EVLA Correlator F2F Meeting - Data Check Progs.

Overview of Data Products Station Board: Wideband state counts, autocorr coeffs. Sub-band filters: clip counts pre-requantizer power measurements re-quantizer state counts/power measure re-quantizer clip counter tone extractor coeffs RFI blanker Radar mode data capture. Comm path/H/W error detectors. B. Carlson, 2007-Dec 11-12 EVLA Correlator F2F Meeting - Data Check Progs.

Overview of Data Products Baseline Board: Correlation coefficients (lags) to CBE. Phased output (to VLBI recorders) Data quality measurements along the phasing signal path. Comm path/H/W error detectors. B. Carlson, 2007-Dec 11-12 EVLA Correlator F2F Meeting - Data Check Progs.

EVLA Correlator F2F Meeting - Data Check Progs. H/W Validation Occurs during prototype test/debug phase. Stimulate H/W with testvectors. Ensures that design/DSP is sound, producing correct data. Need visualization/analysis/comparison tools. Ideally compare with “known” results. In some cases, may not know “exact” results…need to do statistical/first principle analysis. B. Carlson, 2007-Dec 11-12 EVLA Correlator F2F Meeting - Data Check Progs.

EVLA Correlator F2F Meeting - Data Check Progs. H/W Validation Visualization/checking tools. RTDD (Real Time Data Display) Ready for Station Board. Some work required to look at Baseline Board output. “lagfan” and “lagcomp” C programs for corr chip testing are useful and reasonably powerful for now. What about phased output? Need to handle/display data products as defined in RXP RFS. Also need to have packet capture/compare capability…part of intelligent diff? RTDD? And, of course, image processing S/W for PTC tests. B. Carlson, 2007-Dec 11-12 EVLA Correlator F2F Meeting - Data Check Progs.

EVLA Correlator F2F Meeting - Data Check Progs. H/W Verification Once H/W is validated, build final test bed configurations, and develop a test suite for each one. With the X-bar Board in “testmode”, can build a separate and independent test bed for each board type. E.g. Baseline Boards can be verified independent of Station Boards and vice-versa. Each test within a test suite is one configuration, run for a set period of time, with a repeatable set of output data products. Number of tests in suite, duration of each test, configuration for each test not pre-defined…need to use experience, to get maximum coverage for reasonable execution time. B. Carlson, 2007-Dec 11-12 EVLA Correlator F2F Meeting - Data Check Progs.

EVLA Correlator F2F Meeting - Data Check Progs. H/W Verification A test suite produces a number of output files. Each board is run thru the same test suite, and run “intelligent diff” to compare data products with existing “golden files” for pass/fail indication. This is the primary (but not only) purpose of the Test Executor/intelligent diff. B. Carlson, 2007-Dec 11-12 EVLA Correlator F2F Meeting - Data Check Progs.

In-System Checkout/Verification Once partial or full installation at site, need to develop test suite/methods to initially and then periodically check hardware. Most hardware has built-in on-line and off-line connectivity checking that is built into normal hardware/software processing. But still need to check data products for on-chip failures. Likely board-to-board comparison is easiest way. And/Or can generate test vectors at various points and compare with golden files as well. Needs further definition of exactly what to do. B. Carlson, 2007-Dec 11-12 EVLA Correlator F2F Meeting - Data Check Progs.