A Re-analysis of the Wolfer Group Number Backbone, I

Slides:



Advertisements
Similar presentations
Assumptions underlying regression analysis
Advertisements

Correlation and regression
Calibration of Sunspot Numbers Leif Svalgaard Stanford University Eddy Symposium 22 Oct
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 13 Nonlinear and Multiple Regression.
1 Reconciling Group and International Sunspot Numbers Leif Svalgaard, HEPL, Stanford University Edward W. Cliver, Space Vehicles Directorate, AFRL XII.
Introduction to Probability and Statistics Linear Regression and Correlation.
Fixing problems with the model Transforming the data so that the simple linear regression model is okay for the transformed data.
Solar Irradiance Variability Rodney Viereck NOAA Space Environment Center Derived Total Solar Irradiance Hoyt and Schatten, 1993 (-5 W/m 2 ) Lean et al.,
1 Reconciling Group and International Sunspot Numbers Leif Svalgaard, HEPL, Stanford University Edward W. Cliver, Space Vehicles Directorate, AFRL NSO.
Time series Model assessment. Tourist arrivals to NZ Period is quarterly.
CHAPTER 5 Regression BPS - 5TH ED.CHAPTER 5 1. PREDICTION VIA REGRESSION LINE NUMBER OF NEW BIRDS AND PERCENT RETURNING BPS - 5TH ED.CHAPTER 5 2.
1 Geomagnetic Calibration of Sunspot Numbers Leif Svalgaard HEPL, Stanford University SSN-Workshop, Sunspot, NM, Sept
Physics 2.1 AS Credits Carry out a practical physics investigation that leads to a non- linear mathematical relationship.
Machine Learning 5. Parametric Methods.
Section 1.6 Fitting Linear Functions to Data. Consider the set of points {(3,1), (4,3), (6,6), (8,12)} Plot these points on a graph –This is called a.
Unit 4 Lesson 3 (5.3) Summarizing Bivariate Data 5.3: LSRL.
1 Objective Calibration of Sunspot Numbers Leif Svalgaard Stanford University, Stanford, CA, USA. AGU Fall 2009,
Renewing our view to past solar activity: the new Sunspot Number series Frédéric Clette, Laure Lefèvre World Data Center SILSO, Observatoire Royal de Belgique,
Chapter 5 Lesson 5.2 Summarizing Bivariate Data 5.2: LSRL.
Validation/Reconstruction of the Sunspot Number Record, E.W. Cliver Air Force Research Laboratory, Space Vehicles Directorate, Hanscom AFB, MA.
1 Reconciling Group and Wolf Sunspot Numbers Using Backbones Leif Svalgaard Stanford University 5th Space Climate Symposium, Oulu, 2013 The ratio between.
1 Rudolf Wolf and the Sunspot Number Leif Svalgaard Stanford University Sept st SSN Workshop, Sunspot, NM.
Correlation and Regression Ch 4. Why Regression and Correlation We need to be able to analyze the relationship between two variables (up to now we have.
1 Building a Sunspot Group Number Backbone Series Leif Svalgaard Stanford University 3 rd SSN Workshop, Tucson, Jan
Least Squares Regression Textbook section 3.2. Regression LIne A regression line describes how the response variable (y) changes as an explanatory variable.
Chapter 5: 02/17/ Chapter 5 Regression. 2 Chapter 5: 02/17/2004 Objective: To quantify the linear relationship between an explanatory variable (x)
Yandell – Econ 216 Chap 15-1 Chapter 15 Multiple Regression Model Building.
Stats Methods at IC Lecture 3: Regression.
Ch5 Relaxing the Assumptions of the Classical Model
Copyright © Cengage Learning. All rights reserved.
Inference for Least Squares Lines
Part 5 - Chapter
Part 5 - Chapter 17.
Topic 10 - Linear Regression
Linear Regression.
Correlation, Bivariate Regression, and Multiple Regression
Statistics for the Social Sciences
Lesson 2 Graphs.
Cautions about Correlation and Regression
The Effect of Weighting and Group Over-counting on the Sunspot Number
Daniela Stan Raicu School of CTI, DePaul University
A Shocking Analysis Electricity Bill Evaluation IME 301 Brendan Cheng
Diagnostics and Transformation for SLR
Stats Club Marnie Brennan
CHAPTER 29: Multiple Regression*
Part 5 - Chapter 17.
“The need of revising the good old Wolf numbers”
^ y = a + bx Stats Chapter 5 - Least Squares Regression
Undergraduated Econometrics
Least Squares Fitting A mathematical procedure for finding the best-fitting curve to a given set of points by minimizing the sum of the squares of the.
What is Regression Analysis?
BA 275 Quantitative Business Methods
Chapter 2 Looking at Data— Relationships
CH2. Cleaning and Transforming Data
Graphing Techniques.
3 4 Chapter Describing the Relation between Two Variables
Looking at data: relationships - Caution about correlation and regression - The question of causation IPS chapters 2.4 and 2.5 © 2006 W. H. Freeman and.
Topic 1: Statistical Analysis
Daniela Stan Raicu School of CTI, DePaul University
Chapter 8: Estimating with Confidence
Least-Squares Regression
11C Line of Best Fit By Eye, 11D Linear Regression
The Examination of Residuals
Ch 4.1 & 4.2 Two dimensions concept
Correlation/regression using averages
8.3 Estimating a Population Mean
Diagnostics and Transformation for SLR
3.2. SIMPLE LINEAR REGRESSION
Regression and Correlation of Data
Correlation/regression using averages
Presentation transcript:

A Re-analysis of the Wolfer Group Number Backbone, I Leif Svalgaard Stanford University Feb. 2018 And comparison with Chatzistergos et al. A&A, 602, A69, 2017

The ISSI Team Meeting 2018 An ISSI Team meeting was held in Bern (CH) (Jan. 22–26, 2018): “Recalibration of the Sunspot Number Series” Led by Mathew Owens (UK) & Frédéric Clette (B) Although I was the instigator1 of the whole recalibration effort back in 2010 (based on work stretching back to 20072), my presence was not desired This talk is the presentation I would have given It validates the Svalgaard & Schatten (2016) reconstruction of the critical Wolfer GN Backbone 1 Jan Stenflo (2014): “We are grateful to Leif Svalgaard for his magnificent and thorough exploration of previous counting methods and putting his finger on the problem areas, identifying what will be needed to eliminate these problems and letting us see the way to move forward 2 See e.g. http://www.leif.org/research/Napa%20Solar%20Cycle%2024.pdf

Comparing Observer Selections for the Wolfer Backbones Cliver & Chatzistergos 2018 Cliver & Chatzistergos 2018 S&S 2016 argue that observers should be chosen on the basis of Long and regular observing series with good correlation (linear or otherwise) with the Primary observer without obvious drifts or discontinuities ‘All’ observers who satisfy (1) should be included. The Chatzistergos et al. 2017 backbone violates those criteria As a major discrepancy with the old Hoyt & Schatten (1998) Group Sunspot Number occurs around 1880 we especially should pay attention to observations in a window centered on 1880 [Red box 1860-1900]. (See e.g. Cliver, SWSC, 7, A12, 2017)

The [longest] and most Important Secondary Observer is Rudolf Wolf (small telescope) 1876-1893 Proportional Credit: Vera De Geest Wolf’s small telescope: aperture 37mm magnification 20X Used almost exclusively during 1861-1893 Linear w/offset Quadratic through Origin Quadratic w/offset We calculate the monthly average group counts and plot Wolfer against Wolf. The resulting relation is quite linear with R2=0.93. If we force the fit to be non-linear (up to quadratic, R2=0.85) the fit is less good. We shall use the average of all four fits, not being selectively biased towards any of them.

There is always a ‘Learning Curve’ There is always a ‘Learning Curve’. It takes Several Years to Become ‘Good’ at it Wolfer Large telescope 82mm, 64X Credit: ETH It took ~5 years for Wolfer’s k-value to stabilize [red box], illustrating the danger of relying only on a single secondary observer overlapping the primary during the early years (before 1883 for Wolf vs. Wolfer). Lesson: We need many (‘all’) observers.

How Well can we Represent Wolf on the Wolfer Scale? Monthly counts by Wolfer (red) and Wolf’s counts scaled by all four of the regression equations (grey), individually plotted. Early learning curve for Wolfer (in oval) is evident. Goodness of Fits of Monthly counts by Wolf to observed counts by Wolfer. Linear fit is better than the quadratic non-linear fit. Answer: Very well, indeed. Only ~10% is ‘unexplained’ variance. The goal is to reproduce Wolfer’s count with warts and all, so the appropriate least-square procedure is to minimize the ‘vertical’ variance (since counts have no errors).

The Sunspot Numbers and the Group Numbers are in Good Agreement On average GN = 20.3 * SN For monthly averages 12 13 No surprise as both are normalized to Wolf and Wolfer

Another Long and Important Secondary Observer is Pietro Tacchini in Palermo 1876-1900 Linear w/offset Proportional Quadratic through Origin Quadratic w/offset We calculate the monthly average group counts and plot Wolfer against Tacchini. The resulting relation is quite linear with R2=0.95. If we force the fit to be non-linear (up to quadratic, R2=0.95) the fit is also good. We shall use the average of all four fits, not being selectively biased towards any of them.

How Well can we Represent Tacchini on the Wolfer Scale? Monthly counts by Wolfer (red) and Tacchini’s counts scaled by all four of the regression equations (grey), individually plotted. Goodness of Fits of Monthly counts by Tacchini to observed counts by Wolfer. Answer: Very well, indeed. Only ~5% is ‘unexplained’ variance. The goal is to reproduce Wolfer’s count with warts and all, so the appropriate least-square procedure is to minimize the ‘vertical’ variance (since counts have no errors).

Weber in Peckeloh was a Regular Observer Since 1860 We calculate the monthly average group counts and plot Wolfer against Weber. The resulting relation is quite linear with R2=0.94. If we force the fit to be non-linear the fit is less good. We shall use the average of all four fits, not being selectively biased towards any of them.

How Well can we Represent Weber on the Wolfer Scale? Monthly counts by Wolfer (red) and Weber’s counts scaled by all four of the regression equations (grey), individually plotted. Goodness of Fits of Monthly counts by Weber to observed counts by Wolfer. Answer: Very well for the overlap. ~6% ‘unexplained’ variance. But: a potential (and large) problem is the [necessary] extrapolation from a low-activity fit to Wolfer to the high-activity reconstruction for the previous two cycles.

Schmidt in Athens Gave us an Amazing 42-year Series 1841-1883 We calculate the monthly average group counts and plot Wolfer against Schmidt. The resulting relation is quite linear with R2=0.96. If we force the fit to be non-linear the fit is equally good. We shall use the average of all four fits, not being selectively biased towards any of them (especially when they agree anyway).

How Well can we Represent Schmidt on the Wolfer Scale? Monthly counts by Wolfer (red) and Schmidt’s counts scaled by all four of the regression equations (grey), individually plotted. Goodness of Fits of Monthly counts by Schmidt to observed counts by Wolfer. Answer: Very well, indeed. Only ~4% ‘unexplained’ variance. But: a potential (and large) problem is the [necessary] extrapolation from a low-activity fit to Wolfer to the high-activity reconstruction for the previous two cycles.

Spörer was Another Distinguished Observer with a Long Record We calculate the monthly average group counts and plot Wolfer against Spörer. The resulting relation is almost linear with R2=0.89. If we force the fit to be non-linear the fit is less good. We shall use the average of all four fits, not being selectively biased towards any of them. Spörer’s series does not look as homogeneous as desired

How Well can we Represent Spörer on the Wolfer Scale? Monthly counts by Wolfer (red) and Spörer’s counts scaled by all four of the regression equations (grey), individually plotted. Goodness of Fits of Monthly counts by Spörer to observed counts by Wolfer. Answer: Reasonably well. ~14% ‘unexplained’ variance. But: The Spörer series looks to be less homogenous than we would like, especially for low activity where the observing may have been less enthusiastic.

W. M. Dawson Provides a Long, Albeit Somewhat Spotty1 Record We calculate the monthly average group counts and plot Wolfer against Dawson. The resulting relation is nicely linear with R2=0.93. If we force the fit to be non-linear the fit is as good. We shall use the average of all four fits, not being selectively biased towards any of them. A few months with only one observation have been omitted. 1 No pun intended

How Well can we Represent Dawson on the Wolfer Scale? Monthly counts by Wolfer (red) and Dawson’s counts scaled by all four of the regression equations (grey), individually plotted. Goodness of Fits of Monthly counts by Dawson to observed counts by Wolfer. Answer: Very well, indeed. Only ~7% ‘unexplained’ variance. But: a potential (and large) problem is the [necessary] extrapolation from a low-activity fit to Wolfer to the high-activity reconstruction for the previous cycle.

Padre Francesco Denza Observed at Moncalieri 1874-1893 We calculate the monthly average group counts and plot Wolfer against Moncalieri. The resulting relation is quite linear with R2=0.94. If we force the fit to be non-linear the fit is equally good. We shall use the average of all four fits, not being selectively biased towards any of them.

How Well can we Represent Moncalieri on the Wolfer Scale? Monthly counts by Wolfer (red) and Moncalieri’s counts scaled by all four of the regression equations (grey), individually plotted. Goodness of Fits of Monthly counts by Moncalieri to observed counts by Wolfer. Answer: Very well, indeed. Only ~6% ‘unexplained’ variance. We have allowed ourselves the luxury of removing two glaring outliers for two months with very few observations.

G. L. Ber naerts Observed in England during 1870-1879 We calculate the monthly average group counts and plot Wolfer against Bernaerts. The resulting relation is reasonably linear with R2=0.90. The range of values is too small to allow secure polynomial fits for group counts much outside the window of overlap, so extrapolation to the high activity in 1870-1871 is not advisable.

How Well can we Represent Bernaerts on the Wolfer Scale? Monthly counts by Wolfer (red) and Bernaerts’ counts scaled by all of the regression equations (grey), individually plotted. Goodness of Fits of Monthly counts by Bernaerts to observed counts by Wolfer. Answer: Very well, at least for this low activity period. With ~10% ‘unexplained’ variance. But: Extrapolation to 1870-1871’s level of activity yields values half of all the other observers

Putting It All Together: A New Wolfer Backbone

Perfect Agreement with Svalgaard & Schatten (2016) Wolfer Backbone The two backbones agree perfectly within their error bars (thin curves). This is not a surprise as they are based on the same input data and fundamentally sound (albeit different) analysis techniques. It would have been a surprise if they had not agreed.