We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byAlberto Sport
Modified about 1 year ago
© NERC All rights reserved Storms rare but important Balance dataset otherwise storms look like noise Features selected like Split: training set, validation set, test set Training set scaled Some algorithms require use Principal Component Analysis to decompose Improving Operational Geomagnetic Index Forecasting Laurence Billingham [email@example.com], Gemma Kelly British Geological Survey, West Mains Road, Edinburgh, UK 1. Introduction The interest in space weather has never been greater, with society becoming ever more reliant upon technology and infrastructure which are potentially at risk. Geomagnetic storms are potentially damaging to power-grids, communication systems and oil and gas operations. 2. Data 3. Techniques Machine Learning A branch of statistics We use regression algorithms here Data laid out as for matrix inversion (little like finding best fit line with 2D data) Many algorithms (see  for an excellent introduction), some are like linear regression e.g. Workflow: Training: get coefficients from Tune model parameters against validation set Test and score model with test set Predict new a p from unseen data ARIMA Auto-regressive moving average A linear regression over a windowed average of a p Only input is a p timeline Currently operational: used here as a baseline quality comparison 5.Summary and Future Work 4.Results Initial dataset with 205 samples (small set) Some models much better at identifying storms than others Large range in rms values and percentage of predictions which are close to the true value We then increased the total dataset size to 1000 samples (large set) and tested the best performing models Again range of rms values All the machine learning models out perform the ARIMA model in terms of rms, HitRate and skill (HSS) Positive results: worth pursuing for production system References  McPherron, Magnetospheric Dynamics, in Introduction to Space Physics, edited by Kivelson, Russell, pp. 400-458, Cambridge University Press, 1995.  Hastie et al., The Elements of Statistical Learning Data Mining, Inference, and Prediction, Springer 2009(II) Geomagnetic indices Capture magnetic storm severity by summarising lots of data have become ubiquitous parameterisations of storm-time magnetic conditions required as inputs by a variety of models a p index captures amplitude of the disturbance in horizontal part of the field (see e.g.  for more detail) tracks disturbances within a 3-hour interval indicates the global level of disturbance Samples times over ~15 years of geomagnetic and solar wind data Same scaling applied to other sets Linear Regression LR + = RidgeLR + = Lasso LR + Lasso + Ridge = ElasticNet Scoping study results positive value in predictions proceed to operational system Here we only predict 1 a p interval into future Some models easily configures to predict multiple intervals Others need new train, validate, test cycles Classification not regression e.g. G1,..., G5 More useful aid to human forecaster Potentially easier computation Up-weight storm categories: balance dataset More features per sample Models converge with few training samples (see fig): models powerful enough Data mine human forecasts, coronagraph data... Science potential in ‘white-box’ models: which features give useful info? This work is powered by Python-Scikit-learn Pedregosa et al., Scikit-learn: Machine Learning in Python, JMLR 12, pp. 2825-2830, 2011. Metrics: rms: root-mean square error % within ±N: Percentage of predicted values within ±N of the observed value HitRate: how well do we predict the storms? 1 = predicted every single storm 0 = missed every storm HSS: Heidke skill score measures fractional improvement of the forecast over forecast by random chance HSS = 2 (ad – bc) / [(a+ c)(c + d) + (a + b)(b + d)] 1 = highly skilled 0 = no skill <0 = worse than random chance FAR: False alarm rate of storm prediction 0 = no false alarms 1 = all false alarms Event Forecast Storm Observed YesNo Forc Σ Yesaba + b Nocdc + d Obs Σ a + cb + da+b+c+d = n Small set Large set
Exploration Physics International, Inc. HAF: An Operational, Event-driven Solar Wind Forecast Model 1 Murray Dryer
Robin Hogan Ewan OConnor University of Reading, UK What is the half-life of a cloud forecast?
Data analysis tools Subrata Mitra and Jason Rahman.
Introduction The primary geomagnetic storm indicator is the Dst index. This index has a well established ‘recipe’ by which ground-based observations are.
Improving Space Weather Forecasts Using Coronagraph Data S.P. Plunkett 1, A. Vourlidas 1, D.R. McMullin 2, K. Battams 3, R.C. Colaninno 4 1 Naval Research.
The SWENET Online Archive: 10 years of a European Space Weather Community Resource H. Laurens¹, A. Glover¹², JP. Luntama¹, E.Amata³, E.Clarke ⁴, P. Beltrami.
Latest results in verification over Poland Katarzyna Starosta, Joanna Linkowska Institute of Meteorology and Water Management, Warsaw 9th COSMO General.
1 BA 555 Practical Business Analysis Review of Statistics Confidence Interval Estimation Hypothesis Testing Linear Regression Analysis Introduction Case.
Bob Jacobsen Aug 6, 2002 From Raw Data to Physics From Raw Data to Physics: Reconstruction and Analysis Introduction Sample Analysis A Model Basic Features.
PREDICT 422: Practical Machine Learning Module 5: Non-Linear Models Lecturer: Nathan Bastian, Section: XXX.
© NERC All rights reserved Chris Turbitt Observatories Manager Geomagnetism Team British Geological Survey BGS Observatory Network.
ACCURATE TELEMONITORING OF PARKINSON’S DISEASE SYMPTOM SEVERITY USING SPEECH SIGNALS Schematic representation of the UPDRS estimation process Athanasios.
Modeling Gene Interactions in Disease CS 686 Bioinformatics.
Multiple Regression The Basics. Multiple Regression (MR) Predicting one DV from a set of predictors, the DV should be interval/ratio or at least assumed.
The CME geomagnetic forecast tool (CGFT) M. Dumbović 1, A. Devos 2, L. Rodriguez 2, B. Vršnak 1, E. Kraaikamp 2, B. Bourgoignie 2, J. Čalogović 1 1 Hvar.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Evaluating Classifiers Esraa Ali Hassan Data Mining and Machine Learning group Center for Informatics Science Nile University Giza, Egypt.
General Mining Issues a.j.m.m. (ton) weijters Overfitting Noise and Overfitting Quality of mined models (some figures are based on the ML-introduction.
Learning Photographic Global Tonal Adjustment with a Database of Input / Output Image Pairs.
© 2013 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Oceanography 569 Oceanographic Data Analysis Laboratory Kathie Kelly Applied Physics Laboratory 515 Ben Hall IR Bldg class web site: faculty.washington.edu/kellyapl/classes/ocean569_.
TNO orbit computation: analysing the observed population Jenni Virtanen Observatory, University of Helsinki Workshop on Transneptunian objects - Dynamical.
Machine Learning Queens College Lecture 8: Evaluation.
Bob Weigel George Mason University. “We are still in the process of identifying characteristic behavior that identifies various modes as separate phenomena.”
Reliability / Life Cycle Cost Analysis H. Scott Matthews February 17, 2004.
Data Mining Lectures Lecture 7: Regression Padhraic Smyth, UC Irvine ICS 278: Data Mining Lecture 7: Regression Algorithms Padhraic Smyth Department of.
5 th European Space Weather Week, November 2008, Brussels Operational implementation of the SWIF model in DIAS system Tsagouri Ioanna Koutroumbas.
WCRP Extremes Workshop Sept 2010 Detecting human influence on extreme daily temperature at regional scales Photo: F. Zwiers (Long-tailed Jaeger)
Kp Forecast Models S. Wing 1, Y. Zhang 1, and J. R. Johnson 2 1 Applied Physics Laboratory, The Johns Hopkins University 2 Princeton Plasma Physics Laboratory,
Psychology 202b Advanced Psychological Statistics, II February 1, 2011.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
1 Simple Linear Regression Chapter Introduction In this chapter we examine the relationship among interval variables via a mathematical equation.
Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall7-1 Chapter 7: Forecasting.
Research Seminars in IT in Education (MIT6003) Quantitative Educational Research Design 2 Dr Jacky Pow.
Mixture Models, Monte Carlo, Bayesian Updating and Dynamic Models Mike West Computing Science and Statistics, Vol. 24, pp , 1993.
Traffic modeling and Prediction ----Linear Models Traffic models are important in the design, engineering and performance evaluation of networks. studying.
Heidke Skill Score (for deterministic categorical forecasts) Heidke score = Example: Suppose for OND 1997, rainfall forecasts are made for 15 stations.
© Crown copyright Met Office Forecasting Icing for Aviation: Some thoughts for discussion Cyril Morcrette Presented remotely to Technical Infra-structure.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Plasma Density Structures in the Inner Magnetosphere Derived From RPI Measurements B. Reinisch 1, X. Huang 1, P. Song 1, J. Green 2, S. Fung 2 V. Vasyliunas.
© Prentice Hall1 DATA MINING Introductory and Advanced Topics Part II Margaret H. Dunham Department of Computer Science and Engineering Southern Methodist.
Lecture 22: Evaluation April 24, Last Time Spectral Clustering.
A Global Climatology of Baroclinically Influenced Tropical Cyclogenesis Authors: Ron McTaggart-Cowan, et. Al. Monthly Weather Review June 2013.
Models of migration Observations and judgments In: Raymer and Willekens, 2008, International migration in Europe, Wiley.
Elaine Martin Centre for Process Analytics and Control Technology University of Newcastle, England The Conjunction of Process and.
Spreadsheet Modeling & Decision Analysis A Practical Introduction to Management Science 5 th edition Cliff T. Ragsdale.
© Crown copyright Met Office WAFC CAT verification Objective verification of GRIB CAT forecasts Dr Philip G Gill, WAFS Workshop on the use and visualisation.
Iowa State University Department of Computer Science Artificial Intelligence Research Laboratory Research supported in part by grants from the National.
Stat 112 Notes 9 Today: –Multicollinearity (Chapter 4.6) –Multiple regression and causal inference.
Zhangxi Lin ISQS Texas Tech University Note: Most slides are from Decision Tree Modeling by SAS Lecture Notes 5 Auxiliary Uses of Trees.
© 2017 SlidePlayer.com Inc. All rights reserved.