Wouldnt it be cool if…. …at the press of a button, we could calculate Wedderburn number and other physical lake characteristics smooth buoy data to specific.

Slides:



Advertisements
Similar presentations
Closing the Gap Between Global Environmental Sensing Needs and Cyber Infrastructure Tools Jim Gray Jeff Burch Mark Ellisman Miron Livny David Maidment.
Advertisements

From Startup to Enterprise A Story of MySQL Evolution Vidur Apparao, CTO Stephen OSullivan, Manager of Data and Grid Technologies April 2009.
Trying to Use Databases for Science Jim Gray Microsoft Research
21 st Century Science and Education for Global Economic Competition William Y.B. Chang Director, NSF Beijing Office NATIONAL SCIENCE FOUNDATION.
Welcome 26 September st PRAGMA Institute. Conceptual Framework for Building and Sustaining Community (e) Science Previously Unobtainable Observations.
PRAGMA 14 Geosciences WG Activities Update G. S. Chang, W. F. Tsai NARL, Taiwan March 11, 2008.
1 N C H C 2007 /09/28 Flood Grids Fang-Pang Lin PRAGMA Institute, NCSA, 28, Sept, 2007.
Paul Hanson, Fang-Pang Lin, Miron Livny, Chin Wu, Chris Solomon, Many colleagues of the GLEON Transforming ecological sensor networks from data collectors.
IT Working Group Report Moderators: Barbara Benson Fang-Pang Lin.
Vega: A Flexible Data Model for Environmental Time Series Data L. A. Winslow, B. J. Benson, K. E. Chiu, P. C. Hanson, T. K. Kratz.
GLEON 8-IT Working Group (ITWG8) Fang-Pang Lin, Feuchtmayr Heidrun Barbara Benson, Hsiu-Mei Chou, Hipsey Matthew, Honti Mark, Nakamura Ryosuke, Solomon.
The Global Lake Ecological Observatory Network (GLEON) A grassroots network of –lake scientists, ecologists, engineers, information technology experts.
Universidade Federal do Rio Grande do Sul Instituto de Pesquisas Hidráulicas – IPH IPH-ECO: A complex dynamic model for aquatic ecosystems A Limnologist.
GLeon Ad hoc Mendota Modeling Researchers
Rolling Deck to Repository: Transforming the United States Academic Fleet Into an Integrated Global Observing System Suzanne M. Carbotte, Robert Arko,
DELOS Highlights COSTANTINO THANOS ITALIAN NATIONAL RESEARCH COUNCIL.
Cyberinfrastructure for Coastal Forecasting and Change Analysis
During spacecraft-level environmental testing, after all instruments were integrated, the government assembled a data clerk team to support test data collection.
GLEON Challenges Now and into the Future: World Café Part 2 Paul Hanson, Alo Laas, Peter Staehr, Grace Hong, Emily Read Thank you!!
Xsede eXtreme Science and Engineering Discovery Environment Ron Perrott University of Oxford 1.
Telescience WG Update Fang Pang Lin Shinji Shimojo Pragma 25.
0 General information Rate of acceptance 37% Papers from 15 Countries and 5 Geographical Areas –North America 5 –South America 2 –Europe 20 –Asia 2 –Australia.
Data Portal for the “Climate changes Spatial Planning” program Henk Klein Baltink (KNMI) Fred Bosveld (KNMI) Hans de Wolf (Dutch Space)
Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.
GLEON Data Management Luke Winslow PASEO 3/18/09.
1 BrainWave Biosolutions Limited Accelerating Life Science Research through Technology.
Tools for Publishing Environmental Observations on the Internet Justin Berger, Undergraduate Researcher Jeff Horsburgh, Faculty Mentor David Tarboton,
NSF EF Welcome to Summit III University of Florida Florida State University.
1 Building National Cyberinfrastructure Alan Blatecky Office of Cyberinfrastructure EPSCoR Meeting May 21,
Copyright © The OWASP Foundation Permission is granted to copy, distribute and/or modify this document under the terms of the OWASP License. The OWASP.
Discussion and conclusion The OGC SOS describes a global standard for storing and recalling sensor data and the associated metadata. The standard covers.
CI Days: Planning Your Campus Cyberinfrastructure Strategy Russ Hobby, Internet2 Internet2 Member Meeting 9 October 2007.
Chapter 1 Introduction to Data Mining
Environmental Monitoring: Database and Beyond Chengyang Zhang Computer Science Department University of North Texas.
Ohio State University Department of Computer Science and Engineering 1 Cyberinfrastructure for Coastal Forecasting and Change Analysis Gagan Agrawal Hakan.
The Global Lakes Ecological Observatory Network: merging limnology and information technology to understand lake dynamics at multiple scales Tim Kratz,
National Environmental Research Institute, Aarhus University, Denmark Dennis Trolle, Research Scientist Status update & Where to from here GLEON 10 in.
Design central EMODnet portal Objectives, Technical Proposal and Consultation Process.
What is Cyberinfrastructure? Russ Hobby, Internet2 Clemson University CI Days 20 May 2008.
Research and Educational Networking and Cyberinfrastructure Russ Hobby, Internet2 Dan Updegrove, NLR University of Kentucky CI Days 22 February 2010.
Transforming Agricultural Ecosystem Management with Web 2.0 Technology Doug Miller Center for Environmental Informatics Earth and Environmental Systems.
TTG, March 2014, Barcelona WP3: Capacity building and training.
1 Computing Challenges for the Square Kilometre Array Mathai Joseph & Harrick Vin Tata Research Development & Design Centre Pune, India CHEP Mumbai 16.
Lake observatories Data People 3 Networks 1.19 countries participating 2.More than 120 scientists 3.Most sites are developing.
Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
A radiologist analyzes an X-ray image, and writes his observations on papers  Image Tagging improves the quality, consistency.  Usefulness of the data.
ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University
PRAGMA Expedition Lake eutrophication Paul Hanson, Cayelan Carey, Renato Figueiredo, Craig Snortheim, Luke Winslow.
The US Long Term Ecological Research (LTER) Network: Site and Network Level Information Management Kristin Vanderbilt Department of Biology University.
Globus online Software-as-a-Service for Research Data Management Steve Tuecke Deputy Director, Computation Institute University of Chicago & Argonne National.
| nectar.org.au NECTAR TRAINING Module 2 Virtual Laboratories and eResearch Tools.
Cyberinfrastructure Overview Russ Hobby, Internet2 ECSU CI Days 4 January 2008.
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
CUAHSI HIS: Science Challenges Linking small integrated research sites (
Towards an IoT Ecosystem Flavia C. Delicato 1, Paulo F. Pires 1, Thais Batista 2, Everton Cavalcante 2, Bruno Costa 1, Thomaz Barros 1 1 Department of.
Project number: ENVRI and the Grid Wouter Los 20/02/20161.
Visual Knowledge ® Software Inc. Visual Knowledge BioCAD Case Study Parallels to Other Domains VK Semantic Web Server.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management.
Source: Paul Hanson. Collaboration in Environmental Science Global Lake Ecological Observatory Network A grassroots network of –People: lake scientists,
Developing our Metadata: Technical Considerations & Approach Ray Plante NIST 4/14/16 NMI Registry Workshop BIPM, Paris 1 …don’t worry ;-) or How we concentrate.
17 October 2015 Alo Laas, Emily Read, Peter Staehr, Grace Hong INTRODUCTION TO WORLD CAFÉ (IV) ‘CHALLENGES FOR GLEON: NOW AND INTO THE FUTURE’ PART I.
Delivery of Science Components to NRCS Business Applications
Meeting the challenges of an international, grassroots organization of sites deploying sensor networks: the Global Lake Ecological Observatory Network.
INTAROS WP5 Data integration and management
Joseph JaJa, Mike Smorul, and Sangchul Song
CUAHSI HIS Sharing hydrologic data
Staying afloat in the sensor data deluge
Large Scale Distributed Computing
Presentation transcript:

Wouldnt it be cool if…

…at the press of a button, we could calculate Wedderburn number and other physical lake characteristics smooth buoy data to specific scales isolate patterns by scale

…we could mine non-traditional data sources to help understand our lakes Lake Mendota, Wisconsin Beach monitoring network

Manual data MERIS 3D Simulation Buoy data …combine multiple data sources to simulate lakes

…we could work in teams to produce science that transcends site boundaries

CDI-Type II: Collaborative Research: New knowledge from the GLEON PIs Paul Hanson, UW Miron Livny, UW CS AnHai Doan, UW CS Chin Wu, UW CEE Ken Chiu, SUNY-B CS Matt Hipsey, UWA Fang-Pang Lin, NCHC Many GLEON collaborators!

Lauri Arvola University of Helsinki, Lammi Biological Station, Finland Thorsten Blenckner, Institute of Ecology & Evolution, Sweden Evelyn Gaiser Florida International University David Hamilton University of Waikato, New Zealand Zhengwen Liu Nanjing Institute of Geography and Limnology, China Diane McKnight University of Colorado, Boulder David da Motta Marques, Universidad Federal do Rio Grande do Sul, Brazil Kirsti Sorsa Public Health Madison, Wisconsin Peter Staehr University of Copenhagen, Denmark

transform ecological sensor networks from data collectors to knowledge generators through integration of the people, data, and cyberinfrastructure of lake sensor networks. CDI: Cyber-enabled Discovery and Innovation

Human interface Virtual private server Modeling CDI Each site has a POP that saves sensor data to text file. Web services for data access Vega data model on mySQL

20+ observatories 50+ sensing platforms >100 million records Projected > 1 billion by log GLEON Numbers (September 2009) 169 members from 25 countries

CDI Uses existing GLEON infrastructure Open to all interested scientists Its a way of doing science Starts at the data repository Implement existing technologies Develop some new technologies

GLEON Observational Data Repositories Query and display observational data dbBadger Software suite Streaming data Web, e.g., dbBadger Mendota buoy LSPA New to this proposal Model suite Existing 2 2 X Y Z Multi-dimensional virtual data Total Chl Mendota group: CFL, CEE, SSEC and others CDI Team: Wisconsin, NY, UWA, NCHC, GLEON

Some CDI Activities – 1 st year QA/QC Sensor network data Implement basic signal processing Incorporate manually sampled data Workshops to calibrate nD models Run nD models Web display of lake data

Get Involved! (Thur, 10:15 break)

Frequency Spatial extent MinuteHourDayMonthSeason 2 1 Meters Ecosystem 3 4 Model input Circle size data quality Lake Mendota, Wisconsin Target scale of model Sensor network data Unstructured data on singular events from watershed Historical data Unstructured data from life- guards and city of Madison Unstructured data

Raw sensor data level 1 Other data 1Other data 2Sensor data level 2,3 Model (filters, transforms, etc.) Standard data-model interface file (e.g., NetCDF) Model (process) Model (QA) Standard data-model interface file (e.g., NetCDF) Environment: Condor on cluster Workflow: DagMan Model (QA) Transfer protocols? Data structure? PCB model coupling? Algorithms? Visualization? Virtual private server

END

Opinions About Technology Solutions Best long-term solution is unknowable –Tools to move data rapidly to shareable state –Are short-term needs at odds with long-term solutions? Solutions for all ecologists –Most ecologists arent funded to create technology –Simplicity, autonomy, compatibility –Technology transfer? Who wants to adapt anothers system? Outsource, partner, federate Culture of experimentation and change –Must try solutions from outside science –Social networks as science networks? –Look to current graduate students

GLEON: an international grassroots network of people, data, and lake observatories Activities Share experience, expertise, and data Catalyze joint projects Develop tools Conduct multi-site training Create opportunities for students Meet and communicate regularly

Briefly… GLEON as an organization Current technology – from sensors to ecologists CDI – data to knowledge Points not covered: grassroots approach, decision making and timing; controlled vocabulary; metadata; the science of GLEON

Vega Data Model Value oriented structure Store data from any number of sites Highly optimized Values table Query Times < 1 sec GLEON central ~30 million values Streams

POP Text file Ziggy, state, metadata Virtual Private Server, Ubuntu Linux FTP (push) XML file Ziggy Vega, global db, mySQL POP XML file (http pull) Any db Site- specific Local db Buoy system Open source Proprietary e.g., Logger- Net Buoy system e.g., Logger- Net Web service