Presentation on theme: "Update on the Diphoton + MET Analysis Basckground Bruce Schumm, Susan Fowler (Penn), Osamu Jinnouchi (Tokyo Tech), Khilesh Mistry (Penn), Tobias Orthen."— Presentation transcript:
Update on the Diphoton + MET Analysis Basckground Bruce Schumm, Susan Fowler (Penn), Osamu Jinnouchi (Tokyo Tech), Khilesh Mistry (Penn), Tobias Orthen (Tokyo Tech), Ryan Reese (SCIPP), Sheena Schier (SCIPP), Brig Williams (Penn) 25 November 2014 SUSY Group Analysis Meeting
25 November 20142 Conference Note public in early January: Search for Supersymmetry in Diphoton Events with Large Missing Transverse Momentum in 8 TeV pp Collision Data with the ATLAS Detector ATLAS-CONF-2014-001 Since then…
25 November 20143 Complete retooling after loss of Ben Auerbach Updated software/tools releases “Harmonization” with other Photon + X + MET analyses Re-thinking of approach to QCD background (big conceptual change, small numerical change) FAR talk delivered 30 October presented new background numbers; based on Version 2.0 of backup note https://cds.cern.ch/record/1700554https://cds.cern.ch/record/1700554 (ATL-COM-PHYS-2013-442) Two sets of comments to address (Nikola from V2.0 reading, groups comments from FAR) to finalize background Evaluate signal systematics Set limits
25 November 20144 QCD Backgrounds Primer Estimate with MC Estimate via control sample Sum of contributions scaled to data for 0
"name": "25 November 20144 QCD Backgrounds Primer Estimate with MC Estimate via control sample Sum of contributions scaled to data for 0
25 November 20145 New (vs. Old) Background Results Note that QCD component uncertainties are >100%. OLD NEW “OLD” is from CONF Note
25 November 20146 I: Responses to Questions Raised in FAR Talk 1.Add uncertainty on the gamma-gamma MC modeling of Etmiss (e.g. add JES, photon ES, etc) Not yet done. However, given the large uncertainties on the QCD background component estimate, it is very unlikely to change things.
25 November 20147 2. Validate (e.g. using MC) that pseudo photon data (1 tight + 1 loose-not-tight) can model MET in gamma+jet and jet+jet data We find that the diphoton MET distribution has somewhat smaller tails than the control sample MET distribution, suggesting that the QCD background estimate may be a bit high. However, since the lower end of our systematic range for all 5 SR's QCD background estimate is 0 events, we feel that we should add no additional systematic uncertainty based on this comparison. -jet MC: control sample selection -jet MC: diphoton sample selection
25 November 20148 3. Document well how the systematics are extracted on the QCD background (in particular the question was on the upper limit of the SP SRs where the central value of the expectation is 0). SP1 & SP2 1)77% MC + 23% Control Sample N QCD < 0.11 @ 68% CL 2)50% MC + 50% Control Sample N QCD < 0.23 @ 68% CL 3)Since (0.11) 2 + (0.21) 2 = (0.23) 2 we say N QCD = 0.0 (+ 0.11 +0.21) (-0.00 -0.00) WP1 & WP2 Central value and stat error (actual stat error used is asymmetric Poisson) Sys error range
25 November 20149 4. Look at the diphoton cross-section analysis and check if you can use the gam-gam vs gam+jet fraction from that paper as a function of e.g. pt(gg) instead of using the inclusive H->gg analysis. From that paper, the fraction found for their selection is about 68%. For our result, we use 77%, with a systematic range between 50% and 100%. In addition, the MET and dphi distributions we observe for our selection suggest a larger, not a smaller, diphoton contribution than that suggested by the Higgs analysis. So we believe that the central value and range we have chosen make sense.
25 November 201410 5. Compare in one place the e->gamma fake factors and systematics of all photon+X analyses. (Related to this: Check that the systematics are evaluated consistently for all photon+X analyses when it should be the case (e.g. e->gamma fakes). The goal would be to be able to make a consistent description of the various analyses in the paper.) We compared our fake factors to those of the photon+bjet+MET analysis. The latter are higher than the former by 20-25%. However, our photon isolation requirement is tighter than that of the photon+b analysis because we have found this beneficial in reducing backgrounds. In addition, it should be noted that the background levels are an order of magnitude higher in the photon+b analysis than in the diphoton analysis. Thus, the degree of scrutiny placed on the estimation of the e->g fake rates might be expected to be rather different for the two analyses. To us it doesn't make sense for the diphoton analysis to throw effort into reducing e->g fake rate uncertainties given the small contribution and the large statistical errors arising from the control sample. Thus, upon thinking about it a bit more, we don't find it warranted to expend effort in "harmonizing" the fake-rate determinations and errors between the diphoton group and the remaining photon+X+MET groups.
25 November 201411 6. Check the photon pt spectrum in the el->ph fake control region and in signal regions. This would be important if the FF turn out to be pt-dependent. Rather than do this, we have instead explored the possible effect of a Pt dependence of the fake rate on the EW background estimate. Applying the Pt dependence measured by the photon+b analysis to our overall fake rate, we find a ~25% reduction in the EW background estimate. We now take this as an additional systematic uncertainty on our EW background estimate, although the effect on the overall background estimate from the inclusion of this systematic is negligible (an increase of.01 events in the systematic error for the WP2 and MIS SRs; no change for the other SRs).
25 November 201412 7. Plot the photon Etmiss component and the other Etmiss components separately for data vs MC. Also add plots of the diphoton system Still underway. Unlikely to impact final result. 8. Add a systematics band to data/MC comparisons (in particular because the modeling of Etmiss is not well-modeled on p.18) Still underway. Unlikely to impact final result.
25 November 201413 9. Add upper Etmiss cut on Wgg CR to avoid overlap with SRs The CR is now 50 < MET < 150. Since all events in the CR had MET<125, the "enhancement factor“ went up from 1.8 +- 1.0 to 2.3 +- 1.3. Lepton- CR 50 < MET < 150
25 November 201414 10. Add an uncertainty (e.g. 50%) to the bkgd contamination of the Wgg contamination and check the effect We have included an overall 50% uncertainty on the total background contribution to the lepton-gg control region. The resulting uncertainty on the Wgg production rate is 23%. We conservatively add this in quadrature to the 55% uncertainty from other sources. It makes little difference in the overall background uncertainty in the SR. 11. Explain clearly why there is no extrapolation uncertainty on going from Wgg CR-> SR (question from Mario) The K factor in question has a steep dependence on one variable: the magnitude of the momentum of the l system. However, above 100 GeV in this observable, the K factor levels out to its asymptotic value (which is about 20). On the other hand, the selection cuts for the various SRs bias the selection of W events to very high values of the l momentum - MC studies indicate that almost the entire contribution comes from events above 100 GeV. So as long as the control region itself has a lower bound of 100 GeV in this observable, we are measuring the correct region of phase space and there is no extrapolation to be done.
25 November 201415 II: Responses to selected CDS Questions From Nikola 1. Do you apply the BCH cleaning? We have explored the effects of BCH cleaning on the signal and background MC selection efficiencies and found the effects to be negligible. 2. How do you know that MC simulation reproduces MET tails? Why do you want to set the relative fraction of your fake met samples using the H sample sample? This has now been addressed above and in the prior FAR talk. 3. The QCD control sample needs to include backgrounds both from -jet and dijet events. The relative fractions of these contributions can depend on the kinematic cuts. Are the MET distributions the same for these two samples? All the same kinematic cuts are applied to the control sample as to the signal sample, for each SR independently. In addition, all control sample events include at least one jet faking a (loose) photon, with a corresponding effect on the MET tail. So within the large (> 100%) uncertainties, we believe that this is incorporated in our range of uncertainty.
25 November 201416 4. Why you did not consider performing a fit to extract the relative fraction of the and -jet subsamples of the QCD background model? In fact, we had wanted to do just that. However, in the control region, both samples (MC diphoton and the QCD control sample) overestimate the tight- isolated diphoton MET distribution for intermediate values of MET (between 50 and 100 GeV), with the MC diphoton distribution being much closer to the diphoton data than the control sample. Thus, it is clear that a fit would find that the sample is 100% diphoton. So in some sense we did do a fit, and include that result as a lower bound on the possible QCD background contribution.
25 November 201417 III: Updated Limit Results Expected vs. observed by SR Model-independent (number of event) limits from CONF Note Re-calculated model- independent limits using CONF Note inputs
25 November 201418 Question: Do we exclude low-mass winos? # events 95&CL is ~4 Yes, easily! Yield, in # events
25 November 201419 Expected and observed limits by SR; new background results, full signal systematics SP1 WP1 SP2 WP2
25 November 201420 Old/New Limits by Grid, New Background, Full Signal Systematics
26 August 201421 Analysis Strategy (lower reach of Wino-Bino limits) Also: require E T > 75 GeV for each of the two photons
26 August 201422 MC Generation/Simulation Tasks There were several issues to address that required more MC Low mass wino Extend grid from 300 GeV down to 100 GeV This is high cross-section/low-efficiency regime; required working out filtering mechanism Low mass bino Extend explored bino mass reach down from 50 GeV to 10 GeV for all gluino, squark, and wino masses Requires care to avoid metastable states, direct gravitino decays (our model requires decay through bino) Nearly degenerate case for EW production (M_bino close to M_wino) Add points with m of 25 and 10 GeV Again need to watch for pathologies Now done; awaiting analysis
26 August 201423 Analysis Tasks Increase jet E T cut from 20 to 40 GeV (M_eff reconstruction) very little change to anything Evaluate p T dependence of e fake rate play role in determination of EW background evaluated with “tag and probe” method No significant p T dependence observed Check grids developed for other signatures DISCUSS
26 August 201424 Background Studies Estimate H background Use existing H MC sample Pass through all 5 analysese Contributions at 10 -2 level or less DONE Re-evaluate jet-MET uncertainty Inclusion of overflow bin made diphoton and control distributions much more similar Reduce uncertainty accordingly (small change in overall background uncertainty DONE Explore Wgg-background control region ( l sample) for non- Wgg backgrounds This required developing the analysis from scratch since the sudden departure of Ben Aurebach Also want to add tt background just in case… Nominal subject of this talk
26 August 201425 New Wrinkle Comment on current version of Internal Note request that we update our analysis using BCH Cleaning In addition, we discovered that we had been unintentionally vetoing events containing identified muons, which was contrary to our intent Are updating analysis, but need to see if this will have an appreciable effect on the backgrounds. Note that this latter issue should not affect the Wgg analysis, since that explicitly requires events with muons, so no veto was applied.
26 August 201426 Wgg Background Studies New developments on W background calculation (Kaplan, Haas) Our “enhancement factor” of ~3 is relative to Alpgen Kaplan/Haas implement VBFNLO; see that Bozzi et al. NLO is consistent with Alpgen Expect no need for enhancement factor Bozzi et al. Kaplan/Haas
26 August 201427 Background Studies: New Issue Cont’d On the other hand, our W background estimate based on (e, ) control sample. Our “enhancement factor” of ~3 is relative to Alpgen Is this incompatible with Kaplan/Haas (phase space..) Have we missed some background to the l control sample? Can just expand error to include Kaplan/Haas result (but we do simultaneous fit… so need to understand how to do that!) Includes x3 enhancement factor W control region From CONF Paper Internal Note
26 August 201428 Ed Board Request: Look for Z contamination in W control sample Idea is to take l control sample, divide it into low and high MET (below and above 50 GeV) and look at the following quantities: P T (e ), P T ( ) M(e 1 ), M(e 2 ), M(e ), M( ), M(l ) (MET,l), (MET,e), (MET, ) But….
26 August 201429 Re-Assessing the W Control Analysis Re-invented Analysis Although signal selection was validated, lepton selection was not Signal and MC down by x2 relative to CONF NOTE analysis Exploring reasons for this Have included tt ; does not make much difference X3 enhancement factor still consistent with data (see 3, expect 4.5), but based on 3 events rather than 8, so little statistical significance.
26 August 201430 Summary Our tools for doing analysis and selecting events are largely back in place. While we seem to be able to reproduce our sample, our l sample has not been reproduced. If we decide current analysis is correct, could lower photon pT cut to get more statistics in control sample One bug (muon veto) and one analysis improvement (BCH cleaning) force us to recalculate backgrounds once again, but changes should be small. Should be quickly followed through upon once we work out the l problem.
17 June 201432 Interpretation/Limits Redo gluino/bino contour (changes very slight, except extension to M bino < 50 Set limit in squark/bino plane, including low bino mass Set limits in wino/bino plane, including lower limits (additional MC needed; hope to submit soon [Depending on manpower: Set limits in constrained SPS8 model (signal MC already in place)] Squark/bino limits done except low bino mass
17 June 201433 5 fb -1 analysis required E T > 50 GeV and Analysis Strategy Continued 1 fb -1 analysis required E T > 25 GeV MET > 125 GeV These will likely place lower limits on the wino mass than those of the 8 TeV analysis (which are still being determined) Estimate of lower wino limit for 1 fb-1 analysis underway… but can we really include that in a paper? DISCUSS Not good