11/20/0711 Group Four Brian CurtisImran Shah Byeonghwa ParkFrancis Kanyugi CSI 710 Project 11/20/07.

Slides:



Advertisements
Similar presentations
IDN Services and SERF Update Heather Weir
Advertisements

DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
Distributed Data Processing
Uncovering the Global Slow Solar Wind Liang Zhao and Thomas H. Zurbuchen Department of Atmospheric, Oceanic and Space Sciences, University of Michigan.
© Copyright 2012 STI INNSBRUCK Apache Lucene Ioan Toma based on slides from Aaron Bannert
ACE Real Time Solar Wind Data Available on the Web Real Time data from four ACE instruments is available from NOAA’s Space Environment Center within 5.
Using R as enterprise-wide data analysis platform Zivan Karaman.
Presentation Outline  Project Aims  Introduction of Digital Video Library  Introduction of Our Work  Considerations and Approach  Design and Implementation.
14 1 Chapter 14 Database Connectivity and Web Development Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
ICPCA 2008 Research of architecture for digital campus LBS in Pervasive Computing Environment 1.
Knowledge Process Outsourcing1 Turning Information into Knowledge... for YOU The Gyaan Team.
Distributed Data Analysis & Dissemination System (D-DADS) Prepared by Stefan Falke Rudolf Husar Bret Schichtel June 2000.
LÊ QU Ố C HUY ID: QLU OUTLINE  What is data mining ?  Major issues in data mining 2.
B.A. (Mahayana Studies) Introduction to Computer Science November March Office Tools A look at the main tools most computer users.
Computer Programming My Home Page My Paper Job Description Computer programmers write, test, and maintain the detailed instructions, called programs,
CISTI Source & SiteSearch OCLC User Meeting 2001 Danielle Langlois & Carol Serroul May 9, 2001.
Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.
14-18 Nov 2005ESWW – SAAPS1 SAAPS Spacecraft Anomaly Analysis and Prediction System ESA Contract 11974/96/NL/JG(SC) Two year project (April 1999 – June.
Ihr Logo Data Explorer - A data profiling tool. Your Logo Agenda  Introduction  Existing System  Limitations of Existing System  Proposed Solution.
A Lightweight Approach To Support of Resource Discovery Standards The Problem Dublin Core is an international standard for resource discovery metadata.
©Ian Sommerville 2006Software Engineering, 8th edition. Chapter 12 Slide 1 Distributed Systems Architectures.
Numerical simulations are used to explore the interaction between solar coronal mass ejections (CMEs) and the structured, ambient global solar wind flow.
Accuracy assessment of the space weather characteristics forecasts used in the Russian Federal Space Agency Monitoring System V. Anashin 1, G. Protopopov.
DCS Overview MCS/DCS Technical Interchange Meeting August, 2000.
Information Systems: Databases Define the role of general information systems Describe the elements of a database management system (DBMS) Describe the.
A Metadata Based Approach For Supporting Subsetting Queries Over Parallel HDF5 Datasets Vignesh Santhanagopalan Graduate Student Department Of CSE.
Solar Weather and Tropical Cyclone Activity Abstract Worldwide tropical cyclone energy and frequency data was obtained from the Unisys Weather database.
Global Land Cover Facility The Global Land Cover Facility (GLCF) is a member of the Earth Science Information Partnership (ESIP) Federation providing data,
XP New Perspectives on The Internet, Sixth Edition— Comprehensive Tutorial 3 1 Searching the Web Using Search Engines and Directories Effectively Tutorial.
Federated Database Set Up Greg Magsamen ITK478 SIA.
GUIDED BY DR. A. J. AGRAWAL Search Engine By Chetan R. Rathod.
Facilitating Document Annotation using Content and Querying Value.
Presented by Scientific Annotation Middleware Software infrastructure to support rich scientific records and the processes that produce them Jens Schwidder.
+ Information Systems and Databases 2.2 Organisation.
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
March 2004 At A Glance autoProducts is an automated flight dynamics product generation system. It provides a mission flight operations team with the capability.
Near Real-Time Verification At The Forecast Systems Laboratory: An Operational Perspective Michael P. Kay (CIRES/FSL/NOAA) Jennifer L. Mahoney (FSL/NOAA)
SS Space Science MO&DA Programs - August Page 1 ACE Instrument Status Report Cosmic Ray Isotope Spectrometer (CRIS) Normal Operation. Electron Proton.
HDF EOS Workshop David Han Code
Digital Libraries1 David Rashty. Digital Libraries2 “A library is an arsenal of liberty” Anonymous.
Nishu Karna Mentor:Dr. William Dean Pesnell Code: 671 SESI Program-2009 Goddard Space Flight Center St. Cloud State University Date: August 5, 2009 RELATIVISTIC.
VIGNAN'S NIRULA INSTITUTE OF TECHNOLOGY & SCIENCE FOR WOMEN TOOLS LINKS PRESENTED BY 1.P.NAVEENA09NN1A A.SOUJANYA09NN1A R.PRASANNA09NN1A1251.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Devanshu Bawa Customization Specialist Logo Business Solutions.
The Virtual Heliospheric Observatory and Distributed Data Processing T.W. Narock 1,2, A. Szabo 2, A. Davis 3 1. L3 Communications,
Privacy-Enhanced Web Service Composition. Abstract Data as a Service (DaaS) builds on service-oriented technologies to enable fast access to data resources.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.
STEREO and the Virtual Heliospheric Observatory Tom Narock 1,2 Adam Szabo 1 Jan Merka 2 (1) NASA/Goddard Space Flight Center (2) L3 Communications, GSI.
PREPARED BY: PN. SITI HADIJAH BINTI NORSANI. LEARNING OUTCOMES: Upon completion of this course, students should be able to: 1. Understand the structure.
Presentation on Database management Submitted To: Prof: Rutvi Sarang Submitted By: Dharmishtha A. Baria Roll:No:1(sem-3)
June 27-29, DC2 Software Workshop - 1 Tom Stephens GSSC Database Programmer GSSC Data Servers for DC2.
Analysis of 3 and 8 April 2010 Coronal Mass Ejections and their Influence on the Earth Magnetic Field Marilena Mierla and SECCHI teams at ROB, USO and.
The CME geomagnetic forecast tool (CGFT) M. Dumbović 1, A. Devos 2, L. Rodriguez 2, B. Vršnak 1, E. Kraaikamp 2, B. Bourgoignie 2, J. Čalogović 1 1 Hvar.
IT 5433 LM1. Learning Objectives Understand key terms in database Explain file processing systems List parts of a database environment Explain types of.
Dynamic Query Forms for Database Queries. Abstract Modern scientific databases and web databases maintain large and heterogeneous data. These real-world.
GSU-Schedule File Transformation Tools Presented by: Radhika Eedara Pratima Dharmala Phanendar Movva Advisor: Dr. Soon Ok Park CPSC Spring 2016.
Programming with Java. Chapter 1 Focuses on: –components of a computer –how those components interact –how computers store and manipulate information.
TECH RELATED TOPIC PRESENTATION MICROPROCESSOR: CSE341 COURSE INSTRUCTOR DR. JIA UDDIN Assistant Professor Department of Computer Science and Engineering.
KMA Space Weather Service Presented to CGMS-44 on Working Group SWTT.
About the Contest In the fall of 2009, a forecasting competition will be initiated at The goal of the contest is to allow students.
Distributed Systems Architectures. Topics covered l Client-server architectures l Distributed object architectures l Inter-organisational computing.
GOES Data Status Mutual Benefits of NASA THEMIS and NOAA GOES
The Instruments Faraday Cup CfA/U of Mich & MIT
Outline Introduction Standards Project General Idea
Computer Software Lecture 5.
improve the efficiency, collaborative potential, and
Database Connectivity and Web Development
DATABASES WHAT IS A DATABASE?
Added-Value Users of ACE Real Time Solar Wind (RTSW) Data
Presentation transcript:

11/20/0711 Group Four Brian CurtisImran Shah Byeonghwa ParkFrancis Kanyugi CSI 710 Project 11/20/07

22 Area of science covered Space weather science 11/20/07

33 Queries take a long time Most analysis is of time series data for scientists Desire to focus on science not preparation of query and waiting for result Motivation 11/20/07

44 The project seeks to implement a web based system that allows for queries to a space weather science database for scientific research and analysis. 11/20/07 Our Research

11/20/ The majority of analysis done by space scientists concerns time series data. Existing databases in space science are suboptimal for queries over a long time span. Data were stored in different places. Various data formats are used. 11/20/07

11/20/0766 Data 1) Advanced Composition Explorer (Bz,Vx)‏ 2) National Space Science Data Center (Dst)‏ 3) Solar Influences Data analysis Center (SSN)‏ Data used reside on 1)ACE 1)NSSDC 1)SIDC 11/20/07

7  ACE spacecraft was launched by a Delta rocket on August 25, 1997  ACE spacecraft carries 9 instruments in order to collect and measure particles.  (CRIS, SIS, ULEIS, SEPICA, SWIMS, SWICS, EPAM, SWEPAM, MAG, RTSW)‏  MAG (Magnetometer ) measures Bz  SWEPAM (Solar Wind Electron, Proton, and Alpha Monitor ) provides better information of solar wind conditions (Vx)‏

11/20/078 4) SSN: Sunspot Number (DAT format)‏ Four variables are used: Bz, Vx, Dst, and SSN 1) Bz: North/South-component of magnetic field (HDF4 format)‏ 3) Dst: Disturbance Storm-time (DAT format)‏ Description of Variables

11/20/079 Suitable for large datasets & very fast access Easily share data over different platforms with various languages Hierarchical Data Format 5 (HDF5)‏

11/20/ Develop GUI interface Develop a code to read, extract, and analyze data Convert Data format DAT to HDF5 HDF4 to HDF5 (in both cases, we wrote code in Octave and Java)‏ 11/20/07 Get data from different sources

11/20/ /20/07 Hardware used: aurora.gmu.edu Software used: Matlab/Octave HTML, PHP Java 2 x 1.8 Ghz Processor 4 GB RAM 500 GB HDD Ubuntu Linux

11/20/0712 Architecture

11/20/ /20/07 GUI

11/20/0714 Retrieve Code 11/20/07

11/20/ How does correlation between the variability of 1-hour values of the north-south component of the interplanetary magnetic field, Bz, measured by the ACE satellite change over a 8-year interval? 2. How does the 1-hour value of the solar wind velocity measured at ACE correlate with the sunspot number over a 8-year interval? 3. How does the Dst Index correlate with Sunspot Number? 4. What are the times when Bz has its greatest positive to negative fluctuation? 5. When are the times when Bz was in the range of +-1nT (nanotesla) for 24 Hours? Scientific questions & Results 11/20/07

16 6. When Bz has its greatest positive to negative fluctuation, what does Vx do during this time? 7. When Bz was in the range of +-1nT (nanotesla) for 24 Hours, what does Vx do during this time? 8. When Vx has its greatest positive to negative fluctuation, what does Bz do during this time? 9. What is the probability distribution function that best characterizes the 1-hour values of Vx measured by ACE? 10. What is the probability distribution function that best characterizes the 1-hour values of Bz measured by ACE? Scientific questions & Results 11/20/07

-Link to 10 Query Questions

11/20/ /20/07 Conclusions -The response time of the query is fast allowing scientists to spend more time analyzing the data instead of waiting for the data -We’ve combined the function of retrieving data and data plotting/analysis into one easy to use GUI. Future Research -Add more data from different sources and years -Enhance user interface to allow for more operations -Enhance “look and feel” -Determine how retrieve function can be generalized to be more flexible for data with variable and possible dynamic start and end dates

11/20/0719  Brian Curtis (Group Leader)‏  Pictures used in this presentation  1. SWEPAM (  2. MAG (  3. ACE (  Data Sources  1. Mag (Bz) (ftp://mussel.srl.caltech.edu/pub/ace/level2)‏ftp://mussel.srl.caltech.edu/pub/ace/level2  2. SWEPAM (Velocity) (ftp://mussel.srl.caltech.edu/pub/ace/level2/)ftp://mussel.srl.caltech.edu/pub/ace/level2/  3. Sunspot number (  4. Disturbance Storm-Time (ftp://nssdcftp.gsfc.nasa.gov/spacecraft_data/omni/)‏ftp://nssdcftp.gsfc.nasa.gov/spacecraft_data/omni/ 11/20/07