LSST Scheduler status Francisco Delgado Sr. Software Engineer Telescope & Site.

Slides:



Advertisements
Similar presentations
2007 CAH HF Program Group 2 Roadmap Next Steps for Phase II January – March 2007 JANFEBMARAPRMAYJUNJULAUGSEPOCTNOVDEC Engage Internal Stakeholders Plan/Educate.
Advertisements

CMSC 2006 Orlando Active Alignment System for the LSST William J. Gressler LSST Project National Optical Astronomy Observatory (NOAO) Scott Sandwith New.
Ninth Lecture Hour 8:30 – 9:20 pm, Thursday, September 13
Systems Engineering Breakouts George Angeli. Tuesday 11am Current Commissioning Plans – Chuck Claver Revised commissioning timeline Development plans.
The System and Software Development Process Instructor: Dr. Hany H. Ammar Dept. of Computer Science and Electrical Engineering, WVU.
Project Change Management
On-Time Product Delivery COPC - HPCC Best Practices March 2011 Allan Darling Deputy Director NCEP Central Operations Where America’s Climate, Weather,
Scheduling with Optimized Communication for Time-Triggered Embedded Systems Slide 1 Scheduling with Optimized Communication for Time-Triggered Embedded.
PALM-3000 PALM-3000 Software Requirements Review Thang Trinh PALM-3000 Requirements Review, Caltech Campus November 12, 2007.
The new The new MONARC Simulation Framework Iosif Legrand  California Institute of Technology.
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 4.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
Project Plan The Development Plan The project plan is one of the first formal documents produced by the project team. It describes  How the project will.
Copyright  Larry Dribin, Ph.D. SE470_EngFlows_v1.ppt SE470 EngFlows - 1 Excellence in Software Engineering Repeatable Level Defined Level Manage.
1 FPAW Fall Meeting, October 22, Develop an analytical model that explicitly incorporates weather forecasts, and their uncertainty, in estimating.
LSST Scheduler Development Workshop Scheduler Design Francisco Delgado Sr. Software Engineer Telescope & Site.
Hunt for Molecules, Paris, 2005-Sep-20 Software Development for ALMA Robert LUCAS IRAM Grenoble France.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
RUP Fundamentals - Instructor Notes
Control Software Integration German Schumacher T&S Software Lead.
Resource Management and Accounting Working Group Working Group Scope and Components Progress made Current issues being worked Next steps Discussions involving.
Project Progress Document Optimization 5 April 2007 Team members: Chris Catalano Chun-Yu Chang Chris Joson David Matthes.
McMullinEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Data Post-processing: SSG (AIPS++/CASA) Development J. McMullin.
LSST Telescope and Site Observatory Control System Interface Review Scheduler Design Francisco Delgado.
A Scheduling Algorithm with Dynamic Priorities Status Presentation Matias Mora Klein UTFSM Computer Systems Research.
LSST Scheduler requirements
ALMA Integrated Computing Team Coordination & Planning Meeting #2 Santiago, January 2014 Control Group Planning Rafael Hiriart, Control Group Lead.
American Community Survey (ACS) Program Review Webinar March 6, 2012.
ISM 5316 Week 3 Learning Objectives You should be able to: u Define and list issues and steps in Project Integration u List and describe the components.
Software Dynamics: A New Method of Evaluating Real-Time Performance of Distributed Systems Janusz Zalewski Computer Science Florida Gulf Coast University.
Doug Tody E2E Perspective EVLA Advisory Committee Meeting December 14-15, 2004 EVLA Software E2E Perspective.
The System and Software Development Process Instructor: Dr. Hany H. Ammar Dept. of Computer Science and Electrical Engineering, WVU.
Test and Integration Robyn Allsman LSST Corp DC3 Applications Design Workshop IPAC August , 2008.
LSST Scheduler construction plan Francisco Delgado Sr. Software Engineer Telescope & Site.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
FASR Software Considerations Gordon Hurford SSL AUI – August 2007.
Machine to Machine Interface Update 1 Machine to Machine Interface Update February 7th, 2007.
CSE 436—Software Development Models Ron K. Cytron 16 October 2006.
JPL Status Report, SCIGN Annual Meeting, 4/26/2004 JPL Update Danan Dong Michael Heflin Sharon Kedar Brian Newport Frank Webb.
ADASS the Planning and Scheduling Perspective Roadmap: - How planning and scheduling fits in at ADASS - ADASS planning and scheduling posters and presentations.
Proposal: staged delivery of Scheduler and OpSim V1 (2016) meet most of the SRD requirements – Deliver a system that can be extended with an improved scheduler.
GLAST Large Area Telescope LAT Flight Software System Checkout TRR Systems Engineering Mike DeKlotz GSFC Stanford Linear Accelerator Center Gamma-ray Large.
1 FINAL DESIGN REVIEW | TUCSON, AZ | OCTOBER 21-25, 2013 Name of Meeting Location Date - Change in Slide Master The LSST Opserations Simulator A. Saha.
1 Fermi Gamma-ray Space Telescope Users Group Meeting December, 2013 Mission Status Update J. McEnery.
Tracing the JWST Proposal from User Interface to Commanding of an Instrument Margaret Meixner & WIT Balzano, Robinson & CMD.
Frazer OwenNSF EVLA Mid-Project Review May 11-12, Transition to EVLA
HSC Queue Mode Implementation Plan ~ Stage I, II, III ~ Tae-Soo Pyo Subaru Telescope /01/15.
Tools Report Engineering Node March 2007
Paul Alexander1 DS3 Deliverable Status 4 th SKADS Workshop, Lisbon, 2-3 October 2008 DS3 Deliverables Review.
Development Project Management Jim Kowalkowski. Outline Planning and managing software development – Definitions – Organizing schedule and work (overall.
1 OBSERVATORY CONTROL SYSTEM (OCS) FRANCISCO DELGADO OCS CAM.
LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.
Outline Locations SOCS Configuration UI OpSim4 Tools Docker.
From LSE-30: Observatory System Spec.
LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.
Simulations, Metrics and Merit Functions for Mini-surveys and Deep Drilling 1.
OpSim4 vs OpSim3 Francisco Delgado
SOCS/Scheduler Development Plan Michael Reuter, Fransicso Delgado
EIN 6133 Enterprise Engineering
OCS Scheduler Status Francisco Delgado T&S Software Manager
LSST Control Software Integration Francisco Delgado OCS Software Manager LSST Commissioning Plan Review January 24-26, 2017.
OCS Scheduler Status Francisco Delgado T&S Software Manager
Software & Hardware for Wavefront Estimation Pipeline Development Te-Wei Tsai Software Engineer Joint Technical Meeting March 6, 2017.
Software Development Process
PCS New documentation September 2018 – Feb 2019.
Click to add title Planning for LSST Verification George Angeli LSST All Hands Meeting Tucson August 15, 2016.
Observatory Science Operations
Observatory Science Operations
GLAST Large Area Telescope
GLAST Large Area Telescope:
Presentation transcript:

LSST Scheduler status Francisco Delgado Sr. Software Engineer Telescope & Site

…since previous all-hands August 2014: LTS-226 “Scheduler Design” released September 2014: Scheduler design reviewed in OCS interface review March 2015: Scheduler workshop August 2015: DOC “Scheduler Requirements” updated August 2014: LTS-226 “Scheduler Design” released September 2014: Scheduler design reviewed in OCS interface review March 2015: Scheduler workshop August 2015: DOC “Scheduler Requirements” updated 2

3 Scheduler prototype in OpSim v3.3.1 new simulation baseline candidate enigma_1189

Scheduler release v0.1 Development Environment Design separated from OpSim Scheduler requirements document Scheduler interface JIRA plan+work=>PMCS SAL/python tests Scheduler release v0.1 Development Environment Design separated from OpSim Scheduler requirements document Scheduler interface JIRA plan+work=>PMCS SAL/python tests 4 Today…

Requirements Flow down 5 Science Requirements Document LPM-17 Science Requirements Document LPM-17 Scheduler Requirements DOC Scheduler Requirements DOC Observatory System Specifications LSE-30 Observatory System Specifications LSE-30 LSST System Requirements LSE-29 LSST System Requirements LSE-29 OpSim Requirements DOC OpSim Requirements DOC Observatory Control System Requirements LSE-62 Observatory Control System Requirements LSE-62 Science Book Metrics Requirements DOC Metrics Requirements DOC Science Collaborations

Scheduler Requirements 2.1Inputs 2.1.1Survey Parameters 2.1.2Scheduling Parameters 2.1.3System Parameters 2.1.4Internal Conditions 2.1.5External Conditions 2.1.6Performance Feedbacks 6

Scheduler Requirements 2.2Outputs 2.2.1Next Target 2.2.2Predicted Schedule 2.2.3Scheduling Meta Data 2.2.4Survey Progress 7

Scheduler Requirements 2.3Functional Requirements 2.3.1Observatory Model 2.3.2Update Observatory Model 2.3.3Scheduler History 2.3.4Science Proposals 2.3.5Sequences in Time Distribution Proposals 2.3.6Sky Brightness Model 2.3.7Update Sky Brightness Model 8

Scheduler Requirements 2.3.8Cost Function 2.3.9Filter Swap Self-balancing Proposal Progress Deterministic Look Ahead Downtime Handling Warm start capability Dithering Operation in Event of Input Failure 9

Scheduler Requirements 2.4Performance Requirements 2.4.1Speed 2.5Attributes 2.5.1Multiple Scheduling Algorithms 2.5.2Algorithms from OpSim 2.5.3Optimizations from OpSim 2.5.4Global Survey Optimization 10

Scheduler Interfaces to OCS 11 Scheduler Telemetry History Control Targets Image Quality OCS Application communications middleware TCS EFD DMCS OCS Sequencer Visits Sched Telem CCS Cmd Visits

Scheduler Internal Block Diagram Conductor Slew Time Scheduling Data Candidates Observation History Scheduler Control Telemetry History Image Quality Visits Targets Sched Telem Sched Mode Downtime Degraded Targets Observatory conditions Environment conditions Forecast Quality parameters Past observations Current observation Sched Telem Astronomical Sky Sky brightness coordinates Science Programs Value functions Cost functions Time Observatory Model Kinematic model coordinates Candidates Environment conditions Sched Config 12

Scheduler Construction Plan Scheduler is WBS 04C Integrated in OCS construction plan 12 releases 16 weeks each average Constant Validation with OpSim Redesign of OpSim -> SOCS (simulated OCS) Coordinated development plan Scheduler is WBS 04C Integrated in OCS construction plan 12 releases 16 weeks each average Constant Validation with OpSim Redesign of OpSim -> SOCS (simulated OCS) Coordinated development plan 13

Scheduler Interfaces to SOCS 14 Scheduler Telemetry History Control Targets Image Quality SOCS Kernel SOCS Kernel communications middleware SOCS Observatory Model SOCS Observatory Model SOCS Survey Database SOCS Survey Database SOCS Sequencer SOCS Sequencer Visits Sched Telem Cmd Visits SOCS Environment Model SOCS Environment Model SOCS Quality Simulator SOCS Quality Simulator

SOCS Internal Block Diagram 15 Simulation Kernel Survey Database SOCS Control Telemetry History Image Quality Visits Targets Sched Telem Sched Mode Downtime Degraded Targets Observatory conditions Environment conditions Forecast Quality parameters Past observations Current observation Sched Telem Quality Simulator Downtime Model Time Sequencer Observatory Model Kinematic model coordinates Environment Model Sky brightness coordinates Time Config Sched Config

OCS construction plan 16

Plan 100% Milestones Integrated with SOCS plan Release DateVersion Dec Basic functionality Aug Functional Scheduler (targets) Mar Look-ahead AprDithering Jul Complete Requirements in Doc Feb Additional community reqs 17

Plan 80% Milestones Integrated with SOCS plan Release DateVersion Dec Basic functionality Nov Functional Scheduler (targets) Jul Look-ahead OctDithering Feb Complete Requirements in Doc Nov Additional community reqs 18

Scheduler release v0.2 Scripted Targets Implement Scheduler structure with interface Implement time handling Refactor and integrate observatory model Implement Scripted Proposal Integrate with simulator (SOCS) Scheduler release v0.2 Scripted Targets Implement Scheduler structure with interface Implement time handling Refactor and integrate observatory model Implement Scripted Proposal Integrate with simulator (SOCS) 19

Scheduler release v0.3 Area Distribution Proposals Refactor and integrate Astronomical Sky Integrate Observatory Model slew time estimations Implement Survey Conductor with slew time cost Refactor and integrate Area Distribution Science Proposals Integrate and benchmark performance with SOCS Scheduler release v0.3 Area Distribution Proposals Refactor and integrate Astronomical Sky Integrate Observatory Model slew time estimations Implement Survey Conductor with slew time cost Refactor and integrate Area Distribution Science Proposals Integrate and benchmark performance with SOCS 20

Scheduler release v1.0 Time Distribution Proposals Refactor and integrate Time Distribution Science Proposals Incorporate filter swaps during new moon Handle downtime Handle dynamic configuration Implement inter-proposal self balancing priority Incorporate weather telemetry handling Integrate with SOCS Scheduler release v1.0 Time Distribution Proposals Refactor and integrate Time Distribution Science Proposals Incorporate filter swaps during new moon Handle downtime Handle dynamic configuration Implement inter-proposal self balancing priority Incorporate weather telemetry handling Integrate with SOCS 21

Scheduler release v1.1 Look Ahead Area Distribution Support for previous release Implement deterministic look ahead data structure Implement Look Ahead algorithm for Area Distribution Proposals Integrate and test with SOCS Scheduler release v1.1 Look Ahead Area Distribution Support for previous release Implement deterministic look ahead data structure Implement Look Ahead algorithm for Area Distribution Proposals Integrate and test with SOCS 22

Scheduler release v1.2 Look Ahead Time Distribution Support for previous release Implement Look Ahead algorithm for Time Distribution Proposals Integrate and test with SOCS Scheduler release v1.2 Look Ahead Time Distribution Support for previous release Implement Look Ahead algorithm for Time Distribution Proposals Integrate and test with SOCS 23

Scheduler release v1.3 Performance Support for previous release Evaluate and implement performance enhancements Scheduler release v1.3 Performance Support for previous release Evaluate and implement performance enhancements 24

Scheduler release v1.4 Warm Start Support for previous release Implement warm start capability Implement image quality feedback handling Implement degraded operational modes Integrate and test with SOCS Scheduler release v1.4 Warm Start Support for previous release Implement warm start capability Implement image quality feedback handling Implement degraded operational modes Integrate and test with SOCS 25

Scheduler release v1.5 Dithering Support for previous release Implement Dithering algorithm Implement handling of spatial distribution for weather telemetry Integrate and test with SOCS Scheduler release v1.5 Dithering Support for previous release Implement Dithering algorithm Implement handling of spatial distribution for weather telemetry Integrate and test with SOCS 26

Scheduler release v2.0 Predicted Schedule Support for previous release Implement publication of future targets schedule Integrate and test with SOCS Scheduler release v2.0 Predicted Schedule Support for previous release Implement publication of future targets schedule Integrate and test with SOCS 27

Scheduler release v2.1 Weather Forecast Support for previous release Implement handling of weather forecast in look ahead algorithms Integrate and test with SOCS Scheduler release v2.1 Weather Forecast Support for previous release Implement handling of weather forecast in look ahead algorithms Integrate and test with SOCS 28

Scheduler release v2.2 Community Optimizations Support for previous release Implement generic interface for optimization algorithms Incorporate community provided optimizations Scheduler release v2.2 Community Optimizations Support for previous release Implement generic interface for optimization algorithms Incorporate community provided optimizations 29