The Joint Polar Satellite System (JPSS) is the next generation polar-orbiting operational environmental satellite system. The first satellite in the JPSS.

Slides:

Advertisements

Similar presentations

ILD Quality Center Overview.

Advertisements

Figure 2 – ADL Concept of Usage Kerry Grant, JPSS CGS Chief Scientist Raytheon Intelligence and Information Systems, Aurora CO Gary Metz, IDPS ING/PRO.

DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.

NPP Calibration and Validation Rehearsals Janna H. Feeley NASA JPSS Ground Project Greenbelt, MD The Aerospace Corporation El Segundo, CA AMS 2012 Overview.

SNPP VIIRS green vegetation fraction products and application in numerical weather prediction Zhangyan Jiang 1,2, Weizhong Zheng 3,4, Junchang Ju 1,2,

NASA DRL Support for S-NPP Direct Broadcast Users

JPSS and GOES-R SST Sasha Ignatov

Community Satellite Processing Package NOAA Satellite Conference, 8-12 April 2013 Liam Gumley CIMSS/SSEC, UW-Madison Hurricane Sandy 2012/10/28 06:25 UTC.

OVERVIEW TEAM5 SOFTWARE The TEAM5 software manages personnel and test data for personal ESD grounding devices. Test and personnel data may be viewed/reported.

Premier Director Document Imaging

Software Delivery. Software Delivery Management  Managing Requirements and Changes  Managing Resources  Managing Configuration  Managing Defects 

Distribution of NPP/VIIRS data through the NOAA Archives NASA Ocean Color Research Team Meeting 23 April 2012, Seattle, Washington Presenter: Axel Graumann,

Green Vegetation Fraction (GVF) derived from the Visible Infrared Imaging Radiometer Suite (VIIRS) sensor onboard the SNPP satellite Zhangyan Jiang 1,2,

Processing Himawari-8 Geostationary Satellite Data Using GOES-R Algorithms for Algorithm Continuity in Operations Jonathan Wrotny1, A. Li1, H. Xie1, M.

POSTER TEMPLATE BY: VIIRS Active Fire algorithm integration in Suomi NPP Data Exploitation (NDE) environment: research to operations.

Integrating Changes to JPSS Cross-Track Infrared Sounder (CrIS) SDR Algorithm using the Algorithm Development Library (ADL) Vipuli Dharmawardane 1, Bigyani.

6 th Annual Focus Users’ Conference Texas Reporting Presented by: Bethany Heslam.

Suomi National Polar-orbiting Partnership (SNPP) Data Access NOAA Satellite Conference April 8-12, 2013 Kevin Berberich NESDIS/OSD NDE Project Photographs.

Introduction Land surface temperature (LST) measurement is important for understanding climate change, modeling the hydrological and biogeochemical cycles,

NASA Goddard Space Flight Center Direct Readout Laboratory NPP/JPSS HRD/LRD Status Patrick Coronado NASA Goddard Space Flight Center directreadout.sci.gsfc.nasa.gov/ipopp.

1 Validated Stage 1 Science Maturity Review for {JPSS Algorithm} Presented by Date.

Kerry Grant, Wael Ibrahim, Paula Smit, JPSS CGS Raytheon Intelligence, Information, and Services, Aurora, CO Kurt Brueske, JPSS CGS Raytheon Intelligence,

JPSS CGS IDPS Product Generation

Donald Stark National Center for Atmospheric Research (NCAR) The Developmental Testbed Center (DTC) Wednesday 29 June, 2011 GSI Fundamentals (1): Setup.

Module 14: Configuring Print Resources and Printing Pools.

NOAA Satellite Conference April 8-12, 2013 Mary Kicza Assistant Administrator for Satellite & Information Services.

Rsv-control Marco Mambelli – Site Coordination meeting October 1, 2009.

Chapter 9 Scripting RMAN. Background Authors felt that scripting was a topic not covered well Authors wanted to cover both Unix/Linux and Windows environments.

 Maintains the Instrument Database  Generates the Calibration Schedules  Maintains Calibration Records  Provides Facility to enter All types of.

6.4 N2/N6E Project Review 06 Oct 2011 Project: Preparing Tactical Ocean Optical Products for Future Polar- Orbiting Sensors

HDL Bencher FPGA Design Workshop. For Academic Use Only Presentation Name 2 Objectives After completing this module, you will be able to:  Describe the.

UNIX Commands. Why UNIX Commands Are Noninteractive Command may take input from the output of another command (filters). May be scheduled to run at specific.

Module 3: Creating Maps. Overview Lesson 1: Creating a BizTalk Map Lesson 2: Configuring Basic Functoids Lesson 3: Configuring Advanced Functoids.

Get your hands dirty cleaning data European EMu Users Meeting, 3rd June. - Elizabeth Bruton, Museum of the History of Science, Oxford

Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Current Status  Framework is in place and algorithms are being integrated.

Module 3 Configuring File Access and Printers on Windows ® 7 Clients.

Configuring Data Protection Chapter 12 powered by dj.

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.

Preparations for Assimilating Land Surface Observations from GOES-R, NPP/VIIRS and AMSR2 in NCEP NWP Models from GOES-R, NPP/VIIRS and AMSR2 in NCEP NWP.

Patrick Coronado - DRL. Driving Force Behind DRL Technology Development Utility and transportability of Earth science data Modularity, scalability, portability.

Module 3: Configuring File Access and Printers on Windows 7 Clients

Diane E. Wickland NPP Program Scientist NPP Science: HQ Perspective on VIIRS May 18, 2011.

January 7, 2015 Walter Wolf, Jaime Daniels, and Lihang Zhou NOAA/NESDIS, Center for Satellite Applications and Research (STAR) Shanna Sampson, Tom King,

March 2004 At A Glance autoProducts is an automated flight dynamics product generation system. It provides a mission flight operations team with the capability.

Framework Details  All products may be run from one program  Coordination of input data:  Model Forecast data  Emissivity Data  Instrument Data 

Implementation and Processing outline Processing Framework of VIIRS instrument monitoring System Processing Framework of VIIRS EV data Monitoring SD/SDSM.

Robert Wolfe NASA Goddard Space Flight Center Code 614.5, Greenbelt, MD Robert Wolfe NASA Goddard Space Flight Center Code 614.5,

STAR Algorithm and Data Products (ADP) Provisional Maturity Review Suomi NPP Surface Type EDR Products X. Zhan, C. Huang, R. Zhang, K. Song, M. Friedl,

NOAA Plenary Agenda Item th CEOS Plenary Kyoto International Conference Center Kyoto, Japan 5 – 6 November 2015 NOAA Satellite and Information Service.

Page 1 Land PEATE support for CERES processing Ed Masuoka Gang Ye August 26, 2008 CERES Delta Design Review.

 Establishing state-of-the-art coding, documentation, configuration management standards for the AWG.  Software development process comparable with CMMI.

Evolution of the JPSS Ground Project Calibration and Validation System Patrick Purcell, Gyanesh Chander and Peyush Jain JPSS Ground Project NASA, GSFC.

Hyperion Artifact Life Cycle Management Agenda  Overview  Demo  Tips & Tricks  Takeaways  Queries.

Page 1 Rapid Algorithm Integration in the Joint Polar Satellite System (JPSS) Common Ground System (CGS) Kerry Grant, Raytheon JPSS CGS Chief Scientist,

Understanding the Log. To examine the log result select the “View Log” button The Format Report box is displayed when a finished report is selected for.

Review of the 2012 Suomi NPP Applications Workshop: Outcomes, Results, Progress Forrest Melton November 18, 2014 Suomi NPP Applications.

CLASS Metadata and Remote Sensing Extensions CLASS Data Provider’s Conference September 2005 Anna Milan, Ted.Habermann,

N A T I O N A L O C E A N I C A N D A T M O S P H E R I C A D M I N I S T R A T I O N NPP DATA ACCESS Mitch Goldberg JPSS Program Scientist June 21, 2012.

Suomi NPP Sounding EDR Validation and Evaluation Zhenglong Li #, Jun Li #, Yue Li #, Timothy J. and Christopher D. # Cooperative Institute.

Transition of Science Algorithms into Enterprise Product Generation Operations 2016 AMS Annual Meeting Dylan Powell, Ph.D. Lockheed Martin ESPDS Science.

Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.

Oracle HFM Implementation Boot Camp Presented by Saravanan Singaravadivelan Developed by Saravanan Singaravadivelan Senior Consultant Qubix International.

Band 14 (11um) Winds Low-Level >700 mb Mid-Level mb High-Level mb   NPP VIIRS Polar Winds Products The GOES-R AWG Derived Motion Winds.

Space Science and Engineering Center University of Wisconsin-Madison Space Science and Engineering Center University of Wisconsin-Madison 1 NPP Atmosphere.

Architecture Review 10/11/2004

Central Satellite Data Repository Supporting Research and Development

Archiving and Document Transfer Utilities

GOES-R AIT: Updating the Data Processing System with data from the Himawari-8 Geostationary Satellite Jonathan Wrotny1, A. Li1, A. Ken1, H. Xie1, M. Fan1,

Ninghai Sun1, Lihang Zhou2, Mitch Goldberg3

Good Testing Practices

Presentation transcript:

The Joint Polar Satellite System (JPSS) is the next generation polar-orbiting operational environmental satellite system. The first satellite in the JPSS series of satellites, J-1, is scheduled to launch in early J1 will carry similar versions of the instruments that are on board of Suomi National Polar- Orbiting Partnership (S-NPP) satellite which was launched on October 28, To run S-NPP and pre-J1 algorithms in a development and test mode, the center for Satellite Applications and Research (STAR) Algorithm Integration Team uses the Algorithm Development Library (ADL). The ADL is an offline test system developed by Raytheon to mimic the operational system while enabling a development environment for plug and play algorithms. The STAR Algorithm Integration Team (AIT) has developed a Perl Chain Run Script to automate the staging and processing of multiple JPSS Sensor Data Record (SDR) and Environmental Data Record (EDR) products. The script has been used to provide test data for verification of algorithm and Look-Up-Table (LUT) changes related to various SDR and EDR products. In this poster, we will discuss the structure of the Chain Run Script and its use. We will use VIIRS Cloud Mask and Vegetation Index as examples to show how to use this script to process JPSS data. Abstract # Link and unpack RDRs # Link and unpack RDRs, convert ancillary data, prepare run set for each granule. # 1 st granule: 0002 d _t _e _b13235 Constructing Algorithm Chain... Construction Complete. Validating Algorithm Chain Prior to Run... Validation Complete. Algorithm Chain and Status: ProSdrViirsController:A1:NPP : Not Yet Built ProSdrViirsController:A1:NPP : Not Yet Built ProSdrViirsController:A1:NPP : Not Yet Built ProEdrViirsMasksController:A1:NPP : Not Yet Built Delta Algorithm Chain Run Started... Running Algorithms With 2 Threads. Algorithm Chain Queue: ProSdrViirsController:A1:NPP :Not Yet Built ProSdrViirsController:A1:NPP :Not Yet Built ProSdrViirsController:A1:NPP :Not Yet Built ProEdrViirsMasksController:A1:NPP :Not Yet Built Creating ProSdrViirsController.exe TK file for granule ID NPP /data/data020/weizhong/ADL4.1/CSPP/ADL4.2_mx8.4_base_a1/log/ProSdrViirsController_NP P xml Running ProSdrViirsController.exe for granule ID NPP :A1 /data/data020/weizhong/ADL4.1/CSPP/ADL4.2_mx8.4_base_a1/bin/ProSdrViirsController.exe Creating ProSdrViirsController.exe TK file for granule ID NPP /data/data020/weizhong/ADL4.1/CSPP/ADL4.2_mx8.4_base_a1/log/ProSdrViirsController_NP P xml Running ProSdrViirsController.exe for granule ID NPP :A1 /data/data020/weizhong/ADL4.1/CSPP/ADL4.2_mx8.4_base_a1/bin/ProSdrViirsController.exe Success for ProSdrViirsController.exe with granule ID NPP Creating ProSdrViirsController.exe TK file for granule ID NPP /data/data020/weizhong/ADL4.1/CSPP/ADL4.2_mx8.4_base_a1/log/ProSdrViirsController_NP P xml Running ProSdrViirsController.exe for granule ID NPP :A1 /data/data020/weizhong/ADL4.1/CSPP/ADL4.2_mx8.4_base_a1/bin/ProSdrViirsController.exe Success for ProSdrViirsController.exe with granule ID NPP Success for ProSdrViirsController.exe with granule ID NPP Creating ProEdrViirsMasksController.exe TK file for granule ID NPP /data/data020/weizhong/ADL4.1/CSPP/ADL4.2_mx8.4_base_a1/log/ProEdrViirsMasksControll er_NPP xml Running ProEdrViirsMasksController.exe for granule ID NPP :A1 /data/data020/weizhong/ADL4.1/CSPP/ADL4.2_mx8.4_base_a1/bin/ProEdrViirsMasksControll er.exe Success for ProEdrViirsMasksController.exe with granule ID NPP Chain Run Completed Successfully! Example 1: Cloudmask Overview  The ADL Chain Run script is developed by the STAR AIT.  The ADL chain run script is mainly Perl script to automate the staging and processing of multiple JPSS SDR and EDR products.  The script calls ADL’s “runADLChainRunner.pl” to process data.  The script uses a specified date with time range and/or a specified granule ID as an option to identify and stage input data. Get an ADL snapview from ClearCase in STAR’s network: 1.export $CSPP_HOME ($ADL_HOME= $CSPP_HOME/ADL) 2.source $ADL_HOME/build/envSetup.sh 3.Build ADL: “$ADL_HOME/buildAdl.ksh” or “perl ${ADL_HOME}/script/build_adl.pl -clean -makefiles -src -library -program -log $logfile” Build ADL Automated JPSS Products Processing of the Algorithm Development Library (ADL) by using Chain Run Scripts Weizhong Chen 1, Bigyani Das 1, Kristina Sprietzer 1, Valerie Mikles 1, Marina Tsidulko 1, Yunhui Zhao 1, Qiang Zhao 1, Vipuli Dharmawardane 1, and Walter Wolf 2 1 IMSG, Rockville, MD NOAA/NESDIS/STAR, College Park, MD Go to scripts location: “$CSPP_HOME/AIT_Scripts/ADL_Chain_Run/int_chainrun” 1.Modify “mruns_cm.sh”. 2.Modify “algorithm.list” file. (only keep the algorithms you want to run) 3.Modify “chainrun_config.txt”. Run “mruns_cm.sh algorithm.list &”. Run Chain Run Script 1. Modify “mruns_cm.sh”  # ADL location in ClearCase: CM_ADL_Name="ADL42_Mx84_snap" export CSPP_HOME="/data/data020/weizhong/CSPP_CM/ $CM_ADL_Name/home/pub/ClearCase/STAR/JPSS /ADL" export ADL_HOME=$CSPP_HOME/"ADL”  # Processing Date and rough time range: ProcessDate=" " stime="t " etime="e " #granID=“NPP “  # Log file Location of Chain Run Script for each algorithms log_dir=“./log" Structure and Functions ScriptDescription mruns_cm.sh Shell wrapper: Define the ADL location, date, start/end time, and/or granule ID chainrun_config.txt Configuration file of chain run script: define the input/output directory, case name, LUT location and Tiles location algorithm.list List of algorithms to be run. Upstream algorithms automatically processed in run. run_withMetadat a.pl Main chain run Perl script. ChainRuns.pm Primary Perl module: Prepare run set for each granule, call ADL’s “runADLChainRunner.pl” script to process data, then organize outputs. LinkConvertH5.p m Functions Perl module: include all functions to find and link RDR data from SCDR, then unpack them to ADL internal format as well as convert all ancillary data which include TLE, PW, NCEP and NAAPS. 2. Modify “algorithm.list”  Cloud Mask: # alg.vcm VIIRS-EDR-Masks  Surface Reflectance: # alg.surf VIIRS-EDR-SurfReflect  Vegetation Index: # alg.vi VIIRS-EDR-VI 2015 NOAA Satellite Conference, April 27-May 1, Greenbelt Marriott Hotel in Greenbelt, MD Corresponding Author: We have: Developed and utilized an ADL chain run script. Demonstrated the script capability and usefulness by assisting several algorithm development teams. Included both the script and documentation in ClearCase for configuration management Demonstrated ability to keep pace with new MX build releases. By using ClearCase with the ADL chain run script, running ADL becomes an easy job. Within STAR’s network, a user can stage ADL chain runs for any algorithm and any date and time and begin getting results in minutes. Summary  # -- user script location chainrun_dir=".“  # -- location to keep all inputs and output data. run_ADL_dir = "/data/data095/weizhong/run_aerosol_dr7723“  # -- unpacked ancillary data location run_ADL_dir_datasource "/data/data020/weizhong/run_ADL“  # -- Get the multiple inputs from the previous run’s “chainrun_config.txt” file in the following format. The default is empty. # input_dirs =“ 'algorithm name' 'CaseName' 'run_ADL_dir' ” # use ":" to separate different algorithms # use space to separate each items in every algorithm # input_dirs = " “ input_dirs = "VIIRS-EDR-Masks aerosol_vcm /data/data095/weizhong/run_aerosol_dr7723:\ VIIRS-EDR-SurfReflect aerosol_base /data/data095/weizhong/run_aerosol_dr7723“  # -- specific the folder's name of all results CaseName = "aerosol_vi_base"  # -- specific the folder to keep all links of h5 files in the given time range. UserData = "user_data"  # All the ancillary source data location: including all PolarWonder, TLE, NCEP and NAAPS data. pub_datasource="/data/data020/pub/NPP_DATA"  # Default LUTs location: $CSPP_HOME/LUTs # Run “$CSPP_HOME/AIT_Scripts/STAR_AIT_ADL_Setup.pl” to link all associated LUTs to your “$CSPP_HOME/LUTs”.The user can replace them with their own LUTs under “$CSPP_HOME/LUTs”. AllLuts="LUTs:"  # location of all Tiles all_tiles_withmeta="/data/data020/pub/NPP_DATA/TILES/NovGroundCCR692Tiles/with-meta-all" All those three directories have been prepared and maintained by STAR AIT. 3. Modify chainrun_config.txt 0003 d _t _e _b13235 NPP Constructing Algorithm Chain... Construction Complete. Validating Algorithm Chain Prior to Run... Validation Complete. Algorithm Chain and Status: ProSdrViirsController:A1:NPP :Built ProSdrViirsController:A1:NPP :Built ProSdrViirsController:A1:NPP :Built ProSdrViirsController:A1:NPP :Built ProSdrViirsController:A1:NPP :Built ProEdrViirsMasksController:A1:NPP :Built ProEdrViirsMasksController:A1:NPP :Built ProEdrViirsMasksController:A1:NPP :Built ProEdrViirsAerosolController:A1:NPP :Built ProEdrViirsSurfReflectController:A1:NPP :Built ProEdrViirsVI:A1:NPP : Not Yet Built Delta Algorithm Chain Run Started... Running Algorithms With 2 Threads. Algorithm Chain Queue: ProEdrViirsVI:A1:NPP :Not Yet Built Creating ProEdrViirsVI.exe TK file for granule ID NPP /data/data020/weizhong/ADL4.1/CSPP/ADL4.2_mx8.4_base/log/ProEdrViirsVI_NPP xml Running ProEdrViirsVI.exe for granule ID NPP :A1 /data/data020/weizhong/ADL4.1/CSPP/ADL4.2_mx8.4_base/bin/ProEdrViirsVI.exe Success for ProEdrViirsVI.exe with granule ID NPP Chain Run Completed Successfully! linking... VIVIO to userOutputDir: /data/data095/weizhong/run_aerosol_dr7723/data/output/use r_data/withMetadata/ProEdrViirsVIOutputs/ vi_base job_output_dir: /data/data095/weizhong/run_aerosol_dr7723 /data/output/withMetadata/ProEdrViirsVIOutputs/ vi_base/d _t _e _b13235 NPP : VIIRS-EDR-VI 0.65 min. Example 2: Vegetation Index