1. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 BGWG blank sky updates Jenny Carter, University of Leicester Andy Read, University of Leicester

2. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 BG_WG_04_05: Selection tool, web based. Sketched out html/CGI script tool. Currently on hold. BG_WG_04_06: Individual users ghosting script. Available for testing through my pages. Needs link/upload to ESAC page Improved ghosting, re-release, add version of exp. maps with those with Jean Ballet flags, re-release files with larger source exclusion region (central residual sources) Sort out Bauer problem Improve selection tools if worthwhile Dataset increase, consider Status at end of last meeting Palermo April 2007

3. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Current status, November 2007 (1) Completed Action Items: AI_EPIC_BG_WG_04_06 – ghosting script now installed on web page. AI_EPIC_BG_WG_05_02 – count rate plots in SSC/PPS energy bands Update of files (events and exposure maps), removing low-E central ring, delivered May 2007. Vignetted exposure maps with sources removed for unfilled files delivered May 2007. Update of files, corrupt TIME column of refilled event files (FTOOL prob/space?), delivered Aug. 2007.

4. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Low-E residual sources issue ‘Dodgy’ component observations now removed from some data sets Updated files on web May 2007 e.g. M1 M FF 0.5 – 2.0 keV

5. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Current status, November 2007 (2) Uncompleted Action Items: BG_WG_04_05: Selection tool, web based. Sketched out html/CGI script tool. Currently on hold, suggest disregard (depending on current use). Other plans: Datasets still to be added to increase file size Advice regarding scaling exposure maps to different energy bands – later in presentation

6. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Blank sky web page Updates marked as before Addition of count rate graphs as EPIC_BG_WG_05 _02 – count rate plots in SSC/PPS energy bands

7. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07

8. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Maps of Blank Sky coverage – some examples M2 T FF PN M FF http://www.star.le.ac.uk/~jac48/BG/SkyMapsBGWGregions

9. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 User feedback presented to UG DateUserComment ProblemSolutionAvailable/Status Oct-07R. Gilli Confused over diff. in MOS/pn CRPointed to Blank Sky CR graphsOct-07 compared to User Handbook and ifon web and KK/SS 2007 paper MOS CR increasing with revn. as peron quiescent particle-induced AMR pres. 04/07 Pallermobkg Jun-07M. JacksonThanks for all Advice requiredEmail regardingJun-07 your help regarding scalingscaling method. of Blank Sky files Jun-07M. Jackson Query regardingAdvised newJun-07 selection regionsselection region - using SelectRADec toolimages sent of selection regions Apr-07H. Chen Exposure maps onlyAdvised scalingAwaiting feedback, in one energy bandmethodcurrent Mar-07G. Trinchieri InabilityTL keywordsApr-07 to merge files,need adding for refilled files (SAS-merge) Mar-07J. BalletV. Useful Bright annulus seenRemove componentMar-07 low energy (200-500eV)culprit observations some Blank Sky files Mar-07D.Hall Questions reQuestions dealt difficulties inwith (no problems)Mar-07 extracting out-FOV events Dec-06 M. Bauer If task skycast run onAppears to be when afterOngoing Blank Sky files, backscalerunning attcalc twice, unable to assign BACKSCAL investigating keyword Nov-06H. ChenThank you for 100eV shift seen ifInsert TLMINn/MAXnDec 06, Feb 07 your prompt response spectra created with nokeywords. New file expression in evselectrelease Oct-06D-W. KimThank you for making Prob. running SAS taskAbsence of DATE keywords,Oct-06 your blank sky data evigweightas intended in files, sets public in theadvice added to website first place!

10. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Oct-06D-W. KimQuery regardingAdded comments to websiteDec-06 filtering expressionand user advised by email Sep-06HelpdeskQuery regarding backscaleAdvice regarding addingSep-06 task and DATE keywordsadding keywords given Aug-06J.BalletNice job1. Offset rowNot reproducedFeb-07 you did!2. livetime discrepancy in row onNeeded FLAG&&0x2fb0008Feb-07 CCD edge PN exposure map 3. Request for extraNeeded FLAG&&0x2fb0008 flag in creation of exposure maps Aug-06A.JuettQuestions re SPQuestions dealtAug-06 filtering ofwith (no problems) blank sky files Jul-06M. EhleAbsence of GTI extensions,GTI extensions added.Aug-06 minor bugs in selectRADecBugs corrected. script Jun-06N.Schartelevselect fails onTSTART/TSTOPJun-06 GTI filteringkeywords to EXPOSUREn extensions Mar-06D.NeumannGreat that new files are coming out Mar-06R.SaxtonFile size issuesFiles reducedApr-06 (SAS & Linux)and/or split

11. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Other comments from UG How often are these files going to be updated. previous work up to revn. 1037 Inclusion of other modes, e.g. timing look up to revn. 1207 (XMM-Newton at revn. ~1450) Refilled files – that have gone through ghosting procedure, issue with flagging of events

12. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Updates and rare modes – up to revn. 1207, all obs ModeTotal Obs. EPNEMOS1EMOS2 Full-frame8622222331723227 Ext. full-frame730 N/A Large window895266320309 Large window – free running11N/A56 Small window1323538371424 Small window – free running22N/A11 Timing199 N/A Fast Compressed7N/A52 Fast Uncompressed798N/A528270 Burst34 N/A Full-frame two modes10N/A55 Refresh frame store31N/A1615

13. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Effects of ghosting/refilled files Query from UG – how to filter out good events that are now, for example in the wrong position spatially in the event file, or how to consider ‘bad’ events that have been ghosted into a ‘good’ area. How many extra bad-flagged events are seen in refilled event files Unfilled NAXIS2 Refilled NAXIS2 NAXIS2 % diff Unfilled next to win/border Refilled next to win/border Unfilled next to bad pixel Refilled next to bad pixel % diff. next to win % diff. next to bad M1 K FF44995152216716.051541165714337164237.5314.55 M1 M FF3961156450510113.7310874109231200031349520.4512.46 M1 T FF5259638584920411.211552915228156304171546-1.949.75 M2 K FF52942261100215.412435251311511126213.209.64 M2 M FF4153455470642713.31159291612588357958251.238.45 M2 T FF5163550570093810.411950718847109015115098-3.385.58 PN K EF6175346711938.6975290739431221712596-1.793.10 PN M EF10359282112912779.00896798886323141006149500-1.176.02 PN T EF13732526149671548.9913917401369387220664232080-1.615.17 PN K FF2816945334599818.7827478729737937812410288.228.51 PN M FF A106465681266153618.9394032110161351383681516688.069.61 PN M FF C136127511571744515.469501459773721321121405762.876.41 PN T FF A103225231149868911.398478548515351148731205150.434.91 PN T FF C99648741106036810.997691097722061073801112740.403.63

14. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Event selection MOS: #XMMEA 1 close to CCD border #XMMEA 5, 6, 8, 9, 10 close to onboard bad pixel, close to bright pixel, close to dead pixel, close to bad col, close to bad row PN: #XMMEA_2 close to CCD window #XMMEA 5, 6, 8 close to onboard bad pixel, close to bright pixel, close to dead pixel

15. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Images of files, events flag #XMMEA_1 – refilled files MOS M1 T FFM1 M FFM1 K FF M2 T FFM2 M FFM2 K FF

16. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Images of files, events flag #XMMEA_5, 6, 8, 9, 10 – refilled files MOS M1 T FFM1 M FFM1 K FF M2 T FFM2 M FFM2 K FF

17. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Images of files, events flag #XMMEA_2 – refilled files PN PN T EFPN M EFPN K EF PN T FF - APN M FF - A PN K FF PN T FF - CPN M FF - C

18. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Images of files, events flag #XMMEA_5, 6, 8 – refilled files PN PN T EFPN M EFPN K EFPN K FF PN T FF - APN M FF - APN T FF - CPN M FF - C

19. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Possible solutions to ghosting problem Masking chip gaps more stringently (good events in bad areas) – already the refilled files are conservatively cleaned Difficult to get bad events out of good areas Ideas? / a limitation to the refilled files and advise on the web page? New ghosting flag?

20. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Exposure map scaling to different E-bands User query – user would like to know how to scale the exposure maps to use in a different energy band Original files created between pimin=200 and pimax=10000 User’s exposure map – own band Blank Sky exposure map – in band pi 200 - 10000 Blank Sky file scaled to user’s energy band User’s exposure map – in band pi 200 - 10000 ×=

21. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Scaling exposure maps – testing method Create a Blank Sky exposure map for a choose band and compared to a Blank Sky exposure map in the original band that has been scaled to this choose band If this method is valid, the difference between these two files should be very small Choose band of interest, pi=200 to pi=500 Scale file User file in band of choice User file in band of blank sky files ÷

22. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 BGSelector To replace SelectRADec tool, which selected events within a given search area, on Blank Sky page Currently found at: http://www.star.le.ac.uk/~jac48/tools/ Can now select on: coordinates, equatorial or galactic, within a search radius revolution numbers within a range exposure times within a range time within a range nH values within a range

23. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07

24. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Extra slides …

25. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 XMMEA_0 = '(FLAG & 0x1) != 0' / DIAGONAL XMMEA_1 = '(FLAG & 0x2) != 0' / CLOSE_TO_CCD_BORDER XMMEA_5 = '(FLAG & 0x20) != 0' / CLOSE_TO_ONBOARD_BADPIX XMMEA_6 = '(FLAG & 0x40) != 0' / CLOSE_TO_BRIGHTPIX XMMEA_8 = '(FLAG & 0x100) != 0' / CLOSE_TO_DEADPIX XMMEA_9 = '(FLAG & 0x200) != 0' / CLOSE_TO_BADCOL XMMEA_10= '(FLAG & 0x400) != 0' / CLOSE_TO_BADROW XMMEA_11= '(FLAG & 0x800) != 0' / IN_SPOILED_FRAME XMMEA_13= '(FLAG & 0x2000) != 0' / ON_BADOFFSET XMMEA_15= '(FLAG & 0x8000) != 0' / FLICKERING XMMEA_16= '(FLAG & 0x10000) != 0' / OUT_OF_FOV XMMEA_17= '(FLAG & 0x20000) != 0' / IN_BAD_FRAME XMMEA_19= '(FLAG & 0x80000) != 0' / COSMIC_RAY XMMEA_21= '(FLAG & 0x200000) != 0' / ON_BADPIX XMMEA_22= '(FLAG & 0x400000) != 0' / REJECTED_BY_GATTI XMMEA_25= '(FLAG & 0x2000000) != 0' / OUT_OF_CCD_WINDOW XMMEA_26= '(FLAG & 0x4000000) != 0' / OUTSIDE_THRESHOLDS XMMEA_28= '(FLAG & 0x10000000) != 0' / ON_BADROW XMMEA_29= '(FLAG & 0x20000000) != 0' / BAD_E3E4 XMMEA_30= '(FLAG & 0x40000000) != 0' / UNDERSHOOT XMMEA_EM= '(FLAG & 0x766ba000) == 0' / Select good MOS events XMMEA_SM= '(FLAG & 0xfffffeff) == 0' / Select good MOS events for spectra XMMEA_0 = '(FLAG & 0x1) != 0' / INVALID_PATTERN XMMEA_2 = '(FLAG & 0x4) != 0' / CLOSE_TO_CCD_WINDOW XMMEA_3 = '(FLAG & 0x8) != 0' / ON_OFFSET_COLUMN XMMEA_4 = '(FLAG & 0x10) != 0' / NEXT_TO_OFFSET_COLUMN XMMEA_5 = '(FLAG & 0x20) != 0' / CLOSE_TO_ONBOARD_BADPIX XMMEA_6 = '(FLAG & 0x40) != 0' / CLOSE_TO_BRIGHTPIX XMMEA_8 = '(FLAG & 0x100) != 0' / CLOSE_TO_DEADPIX XMMEA_11= '(FLAG & 0x800) != 0' / IN_SPOILED_FRAME XMMEA_16= '(FLAG & 0x10000) != 0' / OUT_OF_FOV XMMEA_17= '(FLAG & 0x20000) != 0' / IN_BAD_FRAME XMMEA_19= '(FLAG & 0x80000) != 0' / COSMIC_RAY XMMEA_20= '(FLAG & 0x100000) != 0' / MIP_ASSOCIATED XMMEA_21= '(FLAG & 0x200000) != 0' / ON_BADPIX XMMEA_22= '(FLAG & 0x400000) != 0' / SECONDARY XMMEA_23= '(FLAG & 0x800000) != 0' / TRAILING XMMEA_25= '(FLAG & 0x2000000) != 0' / OUT_OF_CCD_WINDOW XMMEA_EP= '(FLAG & 0xfa0000) == 0' / Select good PN events

26. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Dear Stefano, you wrote: > I associate Prime Partial W2 and W4 to Small Window and Prime Partial W3 and W5 > to large Window, having the same pixel dimensions. In the UHB we are listing only mode names as they are visible in the remote proposal system, too. The W? MOS nomenclature was used in the early phase of the mission and might still be present as header keywords and in SSC products. Please, find below a table of corresponding MOS mode names: Prime Full Window = full frame Prime Partial RFS = refresh frame store Prime Partial W2 = small window Prime Partial W3 = large window Prime Partial W4 = small window free running (not offered) Prime Partial W5 = large window free running (not offered) Prime Partila W6 = full frame two nodes Fast Uncompressed = timing uncompressed Cheers, Matthias Matthias Ehle XMM-Newton SOC User Support Group

27. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Exposure map scaling to different E-bands User query – user would like to know how to scale the exposure maps to use in a different energy band Original files created between pimin=200 and pimax=10000 User’s exposure map – own band Blank Sky exposure map – band pi 200 - 10000 Ratio – scaling factor Blank Sky file scaled to user’s energy band User’s exposure map – in band pi 200 - 10000

28. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Refresh frame store – 6% exposure in FF L/S window free running – GATTI off

29. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Individual queries outstanding Jean Ballet 1.Offset between count maps and exposure maps, MOS. Michael Bauer Skycast and blank sky files. If use attcalc more than once then on using task backscale, the backscale keyword is 0.

30. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Exposure map Test with Blank Sky files create and merge exposure maps for test band use pimin=200 and pimax=500 does scaling of the blank sky file give the same result? test by ratio between scaled-bs- exposure map and this band-bs- exposure map, should be 1.0 all over map if scaling procedure perfect. minor differences found differences very small compared to max livetime of blank sky exposure map (in this case 931./251324s)

31. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Images of bad flags – refilled files MOS M2 T FF M2 M FF M2 K FF Expression MOS: M1 T FFM1 K FFM1 M FF Expression for MOS selection: expression="#XMMEA_0 || #XMMEA_1 || #XMMEA_5 || #XMMEA_6 || #XMMEA_8 || #XMMEA_11 || #XMMEA_13 || #XMMEA_15 || #XMMEA_16 || #XMMEA_17 || #XMMEA_19 || #XMMEA_21 || #XMMEA_22 || #XMMEA_25 || #XMMEA_26 || #XMMEA_28 || #XMMEA_29 || #XMMEA_30"

32. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 Expression for PN: expression="#XMMEA_0 || #XMMEA_2 || #XMMEA_3 || #XMMEA_4 || #XMMEA_5 || #XMMEA_6 || #XMMEA_8 || #XMMEA_11 || #XMMEA_16 || #XMMEA_17 || #XMMEA_19 || #XMMEA_20 || #XMMEA_21 || #XMMEA_22 || #XMMEA_23 || #XMMEA_25" PN M EFPN T EF Images of bad flags – refilled files PN PN K EFPN K FF PN T FF - CPN T FF - APN M FF - CPN M FF - A

33. XMM EPIC MOS Jenny Carter (jac48@star.le.ac.uk) 6 th EPIC BG WG Meeting Mallorca, Nov 07 My notes – exposure scaling testing First image – blankskyM1KFF_scaled Second image – diff_bsband_bsscaled Third image – ratio_bsband_bsscaled