Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005
March 21, 2005 Data Systems Overview System Overview DAQ Dispatch P&F Server Recon Worker X 50-60? 4-15MB/s Hz Tape Transient Buffer DAQ Land Raw Data Filt/RecDataFilt/RecData Online Analysis Recon Monitor Data Handling Rec/Filt Data ALL: RAW+FILT+REC FILT:RAW+FILT+REC ALL:FILT+REC Expt. Control / Logging Offline Software/IceTray
March 21, 2005 Data Systems Overview Data Handling Accomplishments –South Pole Test System operational since late last year. –South Pole System installed at the Pole in late December. –SPS operational with 1 string! –SPADE installed at Pole and used to transfer drill, webcam, and TestDAQ data. Coming Year Activities –Data ingestion to Data Warehouse to be implemented. –Web interface to Data Warehouse. –Upgrade data storage facilities. –IceCube Metadata standard and data directory structure to be defined. –Upgrade SPS and SPTS for upcoming season.
March 21, 2005 Data Systems Overview Experiment Control Provide system for South Pole operating –Control –Configuration –Monitoring –Logging –JBoss Support Based on “JBoss” –Infrastructure in place –Run-Control JMX Console in development
March 21, 2005 Data Systems Overview Filtering PnF System –V1.0 Tested at SPTS & deployed at Pole –Currently not in data stream Lacking some run information and testing –New Version of Monolith soon (April) Test & run PnF at Pole in preparation for next year Plans for next year –Integrate with Real DAQ,Exp Ctrl, DAQ Disp, SPADE at SPTS (August/Sept) PnF is output stream for Real DAQ Filtering at South Pole required
March 21, 2005 Data Systems Overview Offline Software Several incremental releases this past year –In use by reconstruction and simulation groups. –Many people developing physics modules –Lots of physics to do yet Current release: –OFFLINE-SOFTWARE V There are tools available for all –Event viewer –Script to make histograms for ROOT AMANDA muon reconstruction and merging by summer
March 21, 2005 Data Systems Overview Software 1
March 21, 2005 Data Systems Overview Software 2
March 21, 2005 Data Systems Overview Software 3
March 21, 2005 Data Systems Overview Event Viewer
March 21, 2005 Data Systems Overview ATWD Calibration & Feature Extraction
March 21, 2005 Data Systems Overview Simulation Version 0.2 released –Implemented in IceTray I3Db Corsika Reader MMC Propagator Hit Constructor (Photonics interface) Noise Generator ROMEO, ROMEO-AMANDA DOM Simulator (atwd,fadc,TWR) Trigger Sim ATWD Channel Merger Feature Extraction Event Viewer
March 21, 2005 Data Systems Overview JULIET 300 PeV
March 21, 2005 Data Systems Overview Simulation Plans Version 1.0 of IceCube simulation –Ready Mid April –Generate large set of events for validation against AMASIM with same Ice properties etc… New Photonics tables –Ready April-May Finalize metadata specs and production scripts Large production run using V1.0 –Data set in ware house
March 21, 2005 Data Systems Overview Summary Great Progress in the last year –SPADE operating reliably –PnF/DAQ Dispatch tested and running –Experiment Control system defined and providing Jboss support –Simulation V0.2 running –Broad range of developers in IceTray Decision for C++ and data classes 1 year ago For Next Year –Systems on track for physics from string detector Online system integration and testing in Aug/Sep Reconstruction and filtering