A bin-free Extended Maximum Likelihood Fit + Feldman-Cousins error analysis Peter Litchfield  A bin free Extended Maximum Likelihood method of fitting.

Slides:



Advertisements
Similar presentations
London Collaboration Meeting September 29, 2005 Search for a Diffuse Flux of Muon Neutrinos using AMANDA-II Data from Jessica Hodges University.
Advertisements

Soudan 2 Peter Litchfield University of Minnesota For the Soudan 2 collaboration Argonne-Minnesota-Oxford-RAL-Tufts-Western Washington  Analysis of all.
Off-axis Simulations Peter Litchfield, Minnesota  What has been simulated?  Will the experiment work?  Can we choose a technology based on simulations?
CC analysis progress This talk: –A first attempt at calculating CC energy sensitivity using the Far Mock data MC files with full reconstruction. –Quite.
1 6 th September 2007 C.P. Ward Sensitivity of ZZ→llνν to Anomalous Couplings Pat Ward University of Cambridge Neutral Triple Gauge Couplings Fit Procedure.
MINOS Feb Antineutrino running Pedro Ochoa Caltech.
Blessed Plots 2005 The current set of Blessed plots available from the MINOS website are taken from the 5 year plan exercise that occurred in mid-2003.
Update on NC/CC separation At the previous phone meeting I presented a method to separate NC/CC using simple cuts on reconstructed quantities available.
MINOS 1 Beam e ’s from antineutrinos David Jaffe and Pedro Ochoa September 27 th 2007  Preliminaries  Data & MC  Expected sensitivities  Preliminary.
Search for B     with SemiExclusive reconstruction C.Cartaro, G. De Nardo, F. Fabozzi, L. Lista Università & INFN - Sezione di Napoli.
Far Detector Fiducial Volume Studies Andy Blake Cambridge University Saturday February 24 th 2007.
1 24 th September 2007 C.P. Ward Sensitivity of ZZ→llνν to Anomalous Couplings Pat Ward University of Cambridge Neutral Triple Gauge Couplings Fit Procedure.
CC/NC SEPARATION STUDY Andy Blake Cambridge University Friday February 23 rd 2007.
1 Latest CC analysis developments New selection efficiencies: –Based on C++ reco + PDFs rather than old (Fortran+reco_minos) cuts –Attempt to optimise.
1 CC analysis update New analysis of SK atm. data –Somewhat lower best-fit value of  m 2 –Implications for CC analysis – 5 year plan plots revisited Effect.
1 Recent developments on sensitivity calculations Effect of combined le and me running –Is there a statistical advantage over pure le running? Discrimination.
1/16 MDC post-mortem redux Status as of last CC meeting: –True values of cross-section and oscillation parameters were used to reweight the ND and FD MC.
CC ANALYSIS STUDIES Andy Blake Cambridge University Fermilab, September 2006.
1 Beam e ’s from antineutrinos – Update – David Jaffe, Pedro Ochoa November 13 th 2006  Part 1: from  + reweighing  Part 2: New ideas.
Measurement of the Branching fraction B( B  D* l ) C. Borean, G. Della Ricca G. De Nardo, D. Monorchio M. Rotondo Riunione Gruppo I – Napoli 19 Dicembre.
Atmospheric Neutrino Oscillations in Soudan 2
1 Super-Kamiokande atmospheric neutrinos Results from SK-I atmospheric neutrino analysis including treatment of systematic errors Sensitivity study based.
880.P20 Winter 2006 Richard Kass 1 Confidence Intervals and Upper Limits Confidence intervals (CI) are related to confidence limits (CL). To calculate.
A. Blondel, M.Campanelli, M.Fechner Energy measurement in quasi-elastics Unfolding detector and physics effects Alain Blondel Mario Campanelli Maximilien.
880.P20 Winter 2006 Richard Kass 1 Maximum Likelihood Method (MLM) Does this procedure make sense? The MLM answers this question and provides a method.
W  eν The W->eν analysis is a phi uniformity calibration, and only yields relative calibration constants. This means that all of the α’s in a given eta.
Minnesota Simulations Dan Hennessy, Peter Litchfield, Leon Mualem  Improvements to the Minnesota analysis  Comparison with the Stanford analysis  Optimisation.
 Candidate events are selected by reconstructing a D, called a tag, in several hadronic modes  Then we reconstruct the semileptonic decay in the system.
Astrophysics working group - CERN March, 2004 Point source searches, Aart Heijboer 1 Point Source Searches with ANTARES Outline: reconstruction news event.
Reconstruction techniques, Aart Heijboer, OWG meeting, Marseille nov Reconstruction techniques Estimators ML /   Estimator M-Estimator Background.
CP violation measurements with the ATLAS detector E. Kneringer – University of Innsbruck on behalf of the ATLAS collaboration BEACH2012, Wichita, USA “Determination.
Sensitivity to New Physics using Atmospheric Neutrinos and AMANDA-II John Kelley UW-Madison Penn State Collaboration Meeting State College, PA June 2006.
A taste of statistics Normal error (Gaussian) distribution  most important in statistical analysis of data, describes the distribution of random observations.
A statistical test for point source searches - Aart Heijboer - AWG - Cern june 2002 A statistical test for point source searches Aart Heijboer contents:
Latest Results from the MINOS Experiment Justin Evans, University College London for the MINOS Collaboration NOW th September 2008.
Ivan Smiljanić Vinča Institute of Nuclear Sciences, Belgrade, Serbia Energy resolution and scale requirements for luminosity measurement.
1 Iterative dynamically stabilized (IDS) method of data unfolding (*) (*arXiv: ) Bogdan MALAESCU CERN PHYSTAT 2011 Workshop on unfolding.
Search for Electron Neutrino Appearance in MINOS Mhair Orchanian California Institute of Technology On behalf of the MINOS Collaboration DPF 2011 Meeting.
Study of neutrino oscillations with ANTARES J. Brunner.
Study of neutrino oscillations with ANTARES J. Brunner.
Cedar and pre-Daikon Validation ● CC PID parameter based CC sample selections with Birch, Cedar, Carrot and pre-Daikon. ● Cedar validation for use with.
P. Vahle, Oxford Jan F/N Ratio and the Effect of Systematics on the 1e20 POT CC Analysis J. Thomas, P. Vahle University College London Feburary.
Optimization of Analysis Cuts for Oscillation Parameters Andrew Culling, Cambridge University HEP Group.
Fast Shower Simulation in ATLAS Calorimeter Wolfgang Ehrenfeld – University of Hamburg/DESY On behalf of the Atlas-Calorimeter and Atlas-Fast-Parameterisation.
Beam Extrapolation Fit Peter Litchfield  An update on the method I described at the September meeting  Objective;  To fit all data, nc and cc combined,
Study of pair-produced doubly charged Higgs bosons with a four muon final state at the CMS detector (CMS NOTE 2006/081, Authors : T.Rommerskirchen and.
ES 07 These slides can be found at optimized for Windows)
Mark Dorman UCL/RAL MINOS Collaboration Meeting Fermilab, Oct. 05 Data/MC Comparisons and Estimating the ND Flux with QE Events ● Update on QE event selection.
2005 Unbinned Point Source Analysis Update Jim Braun IceCube Fall 2006 Collaboration Meeting.
1 A study to clarify important systematic errors A.K.Ichikawa, Kyoto univ. We have just started not to be in a time blind with construction works. Activity.
A different cc/nc oscillation analysis Peter Litchfield  The Idea:  Translate near detector events to the far detector event-by-event, incorporating.
Update on my oscillation analysis Reconstructed Near detector data event Reconstructed Near detector MC event Truth Near detector MC event Truth Far detector.
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
Measuring Oscillation Parameters Four different Hadron Production models  Four predicted Far  CC spectrum.
September 10, 2002M. Fechner1 Energy reconstruction in quasi elastic events unfolding physics and detector effects M. Fechner, Ecole Normale Supérieure.
A New Upper Limit for the Tau-Neutrino Magnetic Moment Reinhard Schwienhorst      ee ee
PAC questions and Simulations Peter Litchfield, August 27 th Extent to which MIPP/MINER A can help estimate far detector backgrounds by extrapolation.
1 D *+ production Alexandr Kozlinskiy Thomas Bauer Vanya Belyaev
Extrapolation Techniques  Four different techniques have been used to extrapolate near detector data to the far detector to predict the neutrino energy.
MIND Systematic Errors EuroNu Meeting, RAL 18 January 2010 Paul Soler.
LNF 12/12/06 1 F.Ambrosino-T. Capussela-F.Perfetto Update on        Dalitz plot slope Where we started from A big surprise Systematic checks.
Mark Dorman UCL/RAL MINOS WITW June 05 An Update on Using QE Events to Estimate the Neutrino Flux and Some Preliminary Data/MC Comparisons for a QE Enriched.
Upsilon production and μ-tagged jets in DØ Horst D. Wahl Florida State University (DØ collaboration) 29 April 2005 DIS April to 1 May 2005 Madison.
23 Jan 2012 Background shape estimates using sidebands Paul Dauncey G. Davies, D. Futyan, J. Hays, M. Jarvis, M. Kenzie, C. Seez, J. Virdee, N. Wardle.
Systematics Sanghoon Jeon.
L/E analysis of the atmospheric neutrino data from Super-Kamiokande
Observation of Diffractively Produced W- and Z-Bosons
Study of e+e- pp process using initial state radiation with BaBar
Observation of Diffractively Produced W- and Z-Bosons
Presentation transcript:

A bin-free Extended Maximum Likelihood Fit + Feldman-Cousins error analysis Peter Litchfield  A bin free Extended Maximum Likelihood method of fitting oscillation parameters is described  A Feldman-Cousins style error analysis has been developed  Systematic errors are incorporated into the MC experiments comprising the F-C analysis giving error contours with statistical and systematic components

Extended Maximum Likelihood  Described by Roger Barlow; NIM A297,496  Maximum Likelihood with a normalisation condition  The standard maximum likelihood method maximises the likelihood function  where p is the probability density and is normalised to 1, M is the number of events, x is a measured quantity and the a i are parameters to be determined.  The fit thus only fits the shape and says nothing about the number of events

Extended Maximum Likelihood  In Extended Maximum Likelihood p is replaced by the un- normalised quantity P where  The predicted number of events, N, is a function of the fitted parameters.  It can then be shown that  It can also be shown that lnL is maximised for N=M

Extended Maximum Likelihood  In our case the function P is just the extrapolated predicted neutrino measured energy distribution for the given set of parameters.  Strictly P should be a continuous function but with a high statistics MC we can approximate it by the finely binned MC.  So we just sum over the number of predicted MC events N i (E m ) in the bin corresponding to the measured energy E m of each data event  In the plots that follow I use MeV MC bins between 0 and 50 GeV. The bins can be as narrow as the MC warrants.

Comparison Binned v Unbinned Likelihood  Binned likelihood has the standard 500 MeV bins below 10GeV  Unbinned gains at high  m 2 because of the improved resolution on the oscillation dip  Little gain at low  m 2 where there is no data

Feldman-Cousins error analysis  Following the F-C prescription, for each  m 2 -sin 2 2  bin I generate fake experiments with numbers of events Poisson fluctuated about the number predicted by my extrapolation.  For each experiment I select events at random from the full Far detector MC sample, up to the fluctuated number and according to the predicted energy spectrum.  The lnL distribution is calculated on the  m 2 -sin 2 2  grid for each experiment and the  2 difference between the best fit point and the generated point determined.  If say 1000 experiments are generated and fitted, the  2 are sorted and the 900 th  2 from the minimum gives the 90%  2 (  2 90 ) for that grid point.  If the data  2 for that grid point is less than  2 90, that grid point is within the 90% confidence allowed region

Data  2 Surface  2 90 surface F-C results

FC contours

Systematics Analysis  For each fake MC experiment the parameters of the experiment are varied according to a set of systematic errors.  The errors for a given experiment are taken randomly from a uniform distribution between + and – the estimated systematic error.  Notice that CPU time forbids repeating the extrapolation for the > 2.5 billion FC experiments required, so all errors are simulated by varying the selected far MC events.  Systematic parameters can be varied individually or all together. Correlations between systematic parameters are accounted for.  All identified systematics can be included without significant time or complication penalty

Systematics Included 1)Normalisation  The generated event distribution is scaled by a factor randomly selected between 1  )Relative hadronic energy scale  The hadronic energy of the selected far detector events is scaled by a number randomly chosen between 1  for each experiment 3)Muon energy scale  The muon energy is scaled randomly between 1  )Absolute energy scale  I cannot change the energy in the predicted distribution but a change in the absolute scale is equivalent to shifting the predicted oscillation dip in the far detector. The far detector truth energy is shifted by a random amount between  100MeV in calculating the oscillation probability

Systematics included 5)PID cut  The far MC events available at this point in the program have been selected by the PID. At the moment I can only make a one sided cut in the selection. Events with PID with a value randomly selected between 0 and 0.05 above the standard cut are removed from the fake experiments 6)NC background  In the selection of MC events a fraction randomly selected between  50% of true extra NC events are selected

Systematics included 7)Extrapolation error  To try to allow for the extrapolation error I have taken the ratio of the SKZP extrapolation to my extrapolation and scaled the predicted distribution by a random fraction between 0 and 1 of that difference for each experiment

Contours

1D errors -m2-m2 +m2+m2 -sin 2 2  No systematics NC  50%  Energy  0.036% Relative hadronic energy  Absolute hadronic energy  0.1Gev Pid Normalisation  Extrapolation  All systematics No systematics All systematics PRL

Unconstrained contours

To do  More fake experiments to smooth the F-C contours  This analysis just fits the E distribution. The bin-free analysis will be more advantageous for the E  v E shw analysis where the binning of the data is a problem  Extend to the nc and  - data when available