SSFS Test Plan/Report Overview of the test cases What “success” means for a data format type test How the tests were conducted Key results and conclusions.

Slides:



Advertisements
Similar presentations
ADABAS to RDBMS UsingNatQuery. The following session will provide a high-level overview of NatQuerys ability to automatically extract ADABAS data from.
Advertisements

19/05/2011 CSTS File transfer service discussions CSTS-File Transfer service discussions (2) CNES position.
Module R2 CS450. Next Week R1 is due next Friday ▫Bring manuals in a binder - make sure to have a cover page with group number, module, and date. You.
Comp 335 File Structures Indexes. The Search for Information When searching for information, the information desired is usually associated with a key.
MP IP Strategy Stateye-GUI Provided by Edotronik Munich, May 05, 2006.
Answers of Exercise 7 1. Explain what are the connection-oriented communication and the connectionless communication. Give some examples for each of the.
© 2011 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Kiran Kaja | Accessibility Engineer Ensuring Accessibility in Document Conversion.
Folie 1 Service Oriented Architecture - Prototyping study - DLR/GSOC Author: S.Gully.
User studies. Why user studies? How do we know security and privacy solutions are really usable? Have to observe users! –you may be surprised by what.
Simulating A Satellite CSGC Mission Operations Team Cameron HatcherJames Burkert Brandon BobianAleks Jarosz.
© 2004, The Trustees of Indiana University 1 OneStart Workflow Basics Brian McGough, Manager, Systems Integration, UITS Ryan Kirkendall, Lead Developer.
Final Year Project LYU0301 Location-Based Services Using GSM Cell Information over Symbian OS Mok Ming Fai CEG Lee Kwok Chau CEG.
Testing - an Overview September 10, What is it, Why do it? Testing is a set of activities aimed at validating that an attribute or capability.
Maintaining and Updating Windows Server 2008
Introduction to XML This material is based heavily on the tutorial by the same name at
How to Establish a Blog. What is a Blog A blog is a collection of informational articles/ideas intended to update a viewer on new information associated.
XEROX DIGITAL PRINTING SYSTEM Brandon Romano Sang Jung Leon Dillard Kevin Forge.
November 2011 At A Glance GREAT is a flexible & highly portable set of mission operations analysis tools that increases the operational value of ground.
Students: Nadia Goshmir, Yulia Koretsky Supervisor: Shai Rozenrauch Industrial Project Advanced Tool for Automatic Testing Final Presentation.
Chapter 6– Artifacts of the process
Data Communications and Networks
S/W Project Management
Topics Covered: Data preparation Data preparation Data capturing Data capturing Data verification and validation Data verification and validation Data.
Database System Development Lifecycle © Pearson Education Limited 1995, 2005.
 By the end of this, you should be able to state the difference between DATE and INFORMAITON.
1 iBizBuilder from ClearPath Welcome to the ClearPath Networks iBizaBuilder online Tool! This innovative tool will be an online source for automating your.
WorkPlace Pro Utilities.
Training Workshop on the use of the CRF Reporter for European Community Experts Introduction Copenhagen – 12 September 2005 James Grabert Inventories sub-programme.
1SAS 03/ GSFC/SATC- NSWC-DD System and Software Reliability Dolores R. Wallace SRS Technologies Software Assurance Technology Center
GDT V5 Web Services. GDT V5 Web Services Doug Evans and Detlef Lexut GDT 2008 International User Conference August 10 – 13  Lake Las Vegas, Nevada GDT.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
At A Glance VOLT is a freeware, platform independent tool set that coordinates cross-mission observation planning and scheduling among one or more space.
DLR ITCT (Inputs To Current Topics) CCSDS CSSM Technical Meetings London, United Kingdom 9 November – 14 November 2014 Friendly provided to you by: Marcin.
SunGuide® Software Development Project Release 4.3 Express Lanes Enhancements Design Review December 15, 2009 December 15, 20091R4.3 Design Review.
Date: File:PRO1_12E.1 SIMATIC S7 Siemens AG All rights reserved. Information and Training Center Knowledge for Automation Troubleshooting.
AR354: Advanced Billing Welcome to AR354: Advanced Billing.
The european ITM Task Force data structure F. Imbeaux.
Data and information. Information and data By the end of this, you should be able to state the difference between DATE and INFORMAITON.
Pre-OTS Testing in Penticton Sonja Vrcic Socorro, December 11, 2007.
240-Current Research Easily Extensible Systems, Octave, Input Formats, SOA.
Recommendation 1 The IGS shall develop a standard protocol for exchanging information about IGS stations. The associated machine-readable database should.
The Software Development Process
March 2004 At A Glance autoProducts is an automated flight dynamics product generation system. It provides a mission flight operations team with the capability.
Sep 13, 2006 Scientific Computing 1 Managing Scientific Computing Projects Erik Deumens QTP and HPC Center.
Innovation Software Corporation's Cultural Awareness Training Program Presentation by:
Data Verification and Validation
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Copyright 2010, The World Bank Group. All Rights Reserved. Recommended Tabulations and Dissemination Section B.
© 2002 Six Sigma Academy and Helix Systems1 Interface Overview Version 1.0.
Web Services An Introduction Copyright © Curt Hill.
PestPac Software. Leads The Leads Module allows you to track all of your pending sales for your company from the first contact to the close. By the end.
Software Requirements Specification Document (SRS)
Program Assessment User Session Experts (PAUSE) Information Sessions: RSS & Subscription Services October , 2006.
Requirements Analysis
VOTable agenda Current VOTable status Current VOTable status News from Applications News from Applications Questions about VOTable schema Questions about.
ATML Test Description Orlando, FL January ATML Test Description2 September 2006 Agenda Status Feedback from Candidate evaluation Review standard.
Correlator GUI Sonja Vrcic Socorro, April 3, 2006.
GPS Data Automatic Computation Services of Hong Kong SatRef System JAMES WONG, LS/G(NT)
March 2004 At A Glance The AutoFDS provides a web- based interface to acquire, generate, and distribute products, using the GMSEC Reference Architecture.
Reports Oracle Subledger Accounting. Objectives After completing this lesson, you should be able to: Generate Subledger Accounting reports using Oracle.
DEVELOPING WEB SERVICES WITH JAVA DESIGN WEB SERVICE ENDPOINT.
1 A Look at the Application Authorized users can access Communicator! NXT from any Internet-capable computer via the Web.
Text2PTO: Modernizing Patent Application Filing A Proposal for Submitting Text Applications to the USPTO.
Scenario use cases Szymon Mueller PSNC. Agenda 1.General description of experiment use case. 2.Detailed description of use cases: 1.Preparation for observation.
ACES User Interface Workshop #1 Prototype Inspection 22. November 2011.
GLAST Large Area Telescope Instrument Flight Software Flight Unit Design Review 16 September 2004 Instrument Configuration by File James Swain Stanford.
The Federal Information Processing Standards (FIPS) Encryption Suite Sean Smith COSC
Critical Systems Testing Experts EXB Solutions - Contact us at cFS Workshop – Automated Test for NASA cFS David C. McComas 1, Susanne.
Instrument Teams to SOC Test Specifications
<Your Team # > Your Team Name Here
Presentation transcript:

SSFS Test Plan/Report Overview of the test cases What “success” means for a data format type test How the tests were conducted Key results and conclusions What needs to be addressed to complete the test report

Overview of SSFS Tests Goals of the tests were to demonstrate that the proposed schema can: be used to publish a schedule of services be applied to service schedules with time spans that are typical of normal operations scenarios including unused times of cross support service systems (CSSSs) Each test run represented simple schedule data exchanged from a Service Provider to a Service User. DLR-German Space Operations Center (GSOC) and NASA- Goddard Space Flight Center (GSFC), performed the tests acting as either the Service Provider or Service User To provide realistic prototype testing when acting in the role of the Service Provider, DLR and NASA used data from past missions: – DLR – GSOC missions TerraSAR-X, TET-1 and GRACE – NASA missions from the NASA Near Earth Network (NEN) (Solar- B mission and the NOAA Satellite Information System (NOAASIS)) and NASA’s Space Network (SN) for unused time.

Three Test Cases Test Case 1 focused on manually building an XML formatted file using the SSFS schema to test the ability to generate a schedule that is understandable to the Service User. – Demonstrated that a Simple Schedule could be developed with extended information and exchanged by . – 3 Test Runs of Test Case 1 were completed Test Case 2 utilized automated tools to build XML formatted files using the SSFS schema to test the ability to generate a large schedule used in operational scenarios that is understandable to the Service User. Large published schedules were represented. – Demonstrated that the Simple Schedule Format can be used in situations where there are numerous contacts and hence it’s practicality for use in an operational environment. – 5 Test Runs of Test Case 2 were completed Test Case 3 demonstrated the ability to build an XML formatted files using the SSFS schema to generate a schedule for unallocated time of the ground stations/relay satellites in the network to be used by missions that is understandable to the Service User. – 2 Test Runs of Test Case 3 were completed

Test Success Criteria Success criteria for the data/file format: The file formatting may be easily created by the Service Provider, so that all the required information is provided with no workarounds needed The file format created by the generating side, may be re-read by both the Service Provider and User and all the information is assessed as being correct and complete with no information is lost It is desirable that the file format allows for some kind of sanity check mechanisms (i.e. schema mechanism for XML files) The data/file format allows safe transport over whatever transport media (FTP, , web-services, etc…), so that no information content is being lost or changed during transport All the information shall be easy (uniquely) identifiable (i.e. with help of descriptive keywords or identifiers) The Service User shall be able make use of the transported information content When using automated software tools for processing the file format, the systems shall be able to process all different combinations of allowed content or file format options, as defined (i.e. with schema file) without a need for reprogramming. The file format shall contain all information required to understand the information transported. The file format shall allow for different amounts of information transported, thus not imposing any artificial limits on number of entries. File format containing high amount of information (like schedule for 1000 passes) may be processed by both sides (generator and receiver).

How the tests were conducted Service Provider: Obtained an existing published schedule in a conventional format Rendered the schedule in an XML file using the simple schedule format XML schema either manually or using automated tools Sent an to Service User with attached the XML file Service User: Received the Service Provider furnished XML file via Interpreted the XML file consistent with the simple schedule format XML schema Rendered the output either manually or in tabular form using automated tools and then manually verifying it against the input by verifying all output (with small schedules) or by picking random schedule entries to spot check. Sent the schedule entry output to the Service Provider for verification that the entries were interpreted correctly.

Key results and conclusions Test Case 1, Run 1A - successful Test Case 1 flushed out many uncertainties about what the actual test should be and parameters that should be included. Issues were a result of human errors and uncertainties, not a result of the SSFS Test Case 1, Run 1B - successful No issues Test Case 1, Run 1C – error in schema detected Identified a wrong definition in the Schema for numberOfScheduledPackages – nonPositiveInteger was the definition, which makes us use -1, -2, etc... Issue corrected in schema

Test Case 2, Test Run 2A – successful Minor errors occurred due to the tools not the SSFS Test Case 2, Test Run 2B – successful, no issues Test Case 2, Test Run 2C – successful, no issues Test Case 2, Test Run 2D-1 – Service Provider error ICD said all of passes were Full passes (Telemetry, Offline Telemetry and Telecommand) but the Service Provider mistakenly used “TELECOMMAND” for Service Type. Test Case 2, Test Run 2D-2 – successful, no issues Key results and conclusions

Test Case 3, Test Run 3A – successful Question raised concerning Schedule status - is it OPERATIONAL or PROVISIONAL? –RESPONSE: It could be either depending on if there is a mix of scheduled passes and free times or not. Question raised about Beginning of track and end of track required by the Schema - did not make sense because nothing is being tracked. –RESPONSE: BB updated to clarify: Antenna Free Time shall be specified with beginningOfTrack and endOfTrack parameters, whereas beginningOfActivity and endOfActivity shall stay NULL. Test Case 3, Test Run 3B – successful Key results and conclusions

What needs to be addressed to complete the test report Tighten Test conclusions – discussions were captured but could lead the reader to think that there were issues when there weren’t any Clean up Table of Contents Finalize Acronym list One additional pass with Marcin to finalize. Mission Ops personnel?….see next chart

Reference to Mission Ops During a previous discussion, it was recommended that we get input from the mission ops personnel about the SoS format. We didn’t get very much feed back. Recommend removing the reference to Mission ops from the test plan. Marcin showed the SSFS to some operations guys and even to the ground stations, but did not get from them any specific “survey” on that. More or less the reaction was “ooo… well… a bit different, but … ooo yes, yes… now I understand… seems good. When it will be available?”. I do not know if one can put it as “official response” into Test Report.