YOU? OpenEarth PMR-NCV … OpenEarthTools = Open source management of

Slides:



Advertisements
Similar presentations
Conversion of CPC Monitoring and Forecast Products to GIS Format Viviane Silva Lloyd Thomas, Mike Halpert and Wayne Higgins.
Advertisements

DRIVER Long Term Preservation for Enhanced Publications in the DRIVER Infrastructure 1 WePreserve Workshop, October 2008 Dale Peters, Scientific Technical.
SubVersion SubVersion svn.oss.deltares.nl. workflow.
What is a WIKI? Brief introduction to the tool for participatory document writing.
GIS - stepping stones for learning Conventional 2D maps Draped 3D maps modernising maps 3D visual skills.
Datawarehouse Workflow: ETLP Extract Transform LoadProvide Make user- friendly formats Dynamic database Charts & Maps Tools & websites Archive native formats.
DataTools Models Data, models and tools: Dealing with any complex hydraulic engineering problem invariable use is made of: data, models and tools.
Kick-off meeting Delft, April FP – SPACE no Data Fast First step in data management – repository Gerrit Hendriksen Gerben.
Use of OpenEarthTools to make netCDF
The North American Carbon Program Google Earth Collection Peter C. Griffith, NACP Coordinator; Lisa E. Wilcox; Amy L. Morrell, NACP Web Group Organization:
OpenEarth OpenEarthTools = Open source management of Data, Models and Tools for marine & coastal science & technology.. and what about More information.
Summary previous session 1 3 D:\ tools models add meta information netCDF on web server transform to netCDF netCDF on OPeNDAP server data.
Data Portal for the “Climate changes Spatial Planning” program Henk Klein Baltink (KNMI) Fred Bosveld (KNMI) Hans de Wolf (Dutch Space)
Software to Manage EEP Vegetation Plot Data A design proposal Michael Lee January 31, 2011.
Outline of Talk Introduction Toolbox functionality Results Conclusions and future development.
NCAR GIS Program : Bridging Gaps
BlogMyData A Virtual Research Environment for collaborative visualization of environmental data Andrew Milsted | 14 September 2010.
GNE: Global NEWS Modeling Environment What it is / what it’s not How it works Components, samples Installation NEWS 2 Implementation Emilio MayorgaMay.
Cyberinfrastructure Breakout Session Looking 5 years ahead... Broad themes that emerged: A) Calibration tools and skill assessment (MInt, as) B) More examples.
Collaborative Information Systems for Student Projects Chapter Extension 2.
RGS-IBG Online CPD course in GIS Exploring GIS Software Session 2.
Data Standards Workflow Raw dataScriptsDatabase Store raw data in subversion to keep track of history Stored files (netcdf) accessible through the web.
workflow. SubVersion Version control Quality control: “Something adheres to some criteria” Without a properly defined something there.
PopMedNet Software Development Life Cycle Chayim Herzig-Marx Harvard Pilgrim Health Care Institute Daniel Dee Lincoln Peak Partners.
Even More SQA: Work Procedures
` Dutch Data Award for beta sciences 2012 Feb 27 th, Unesco-IHE SDI meeting Feb 28 th 2013, SRIE 2013.
ArcGIS Workflow Manager An Introduction
INFSO-RI Enabling Grids for E-sciencE FloodGrid application Ladislav Hluchy, Viet D. Tran Institute of Informatics, SAS Slovakia.
OSU | PSU | UO The Oregon Spatial Data Library: A Vision for Increased Data Sharing Myrica McCune Institute for Natural Resources February 5, 2014.
Trimble Connected Community
David MillsI CefasI 2013, June 18/19th I UPMC I Paris JERICO MID TERM REVIEW WP 6.
LHeC beyond science Alessandra Valloni WHAT IF YOU DIGIT “LHeC” ON GOOGLE…? Many papers and presentations…
Interoperability ERRA System.
Communication & Web Presence David Eichmann, Heather Davis, Brian Finley & Jennifer Laskowski Background: Due to its inherently complex and interdisciplinary.
Managing Research Data – The Organisational Challenge at Oxford James A J Wilson Friday 6 th December,
Dr Lisa Wise 9/08/2002 The Evolution and Devolution of the Webmaster Role Dr Lisa Wise.
Introduction to ArcGIS for Environmental Scientists Module 1 – Data Visualization Chapter 1 – GIS Basics.
Event-Based Model for Reconciling Digital Entries Thesis Proposal Ahmet Fatih Mustacoglu 10/3/20151Ahmet.
Subversion Code Deployment LifeCycle August 2011.
How to use this presentation? In order to make your trainings more engaging and to capture the knowledge gain at the end of the session feel free to use.
Alma Swan Key Perspectives Ltd Truro, UK.  Use of proxy measures of an individual scholar’s merit is as good as it gets  The responsibility for disseminating.
` Dutch Data Award for beta sciences March 26 NCG.
Where to find LiDAR: Online Data Resources.
Summary Report Project Name: IHTSDO Workbench Brief Project Description: Development of a collaborative tool to allow maintenance of terminology, mapping.
Summary Report Project Name: IHTSDO Workbench Brief Project Description: Development of a collaborative tool to allow maintenance of terminology, mapping.
JWR 2 nd Dec 2013 wwww.OpenEarth.eu. OpenEarth is a workflow, and one free instance of that workflow Tools: internal + external: anything too small for.
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
ScholarSpace & Open UH Mānoa March 2013 Beth Tillinghast Web Support Librarian ScholarSpace & eVols Project Manager UHM Library.
Near Real-Time Verification At The Forecast Systems Laboratory: An Operational Perspective Michael P. Kay (CIRES/FSL/NOAA) Jennifer L. Mahoney (FSL/NOAA)
Introducing the Silverlight Rough Cut Editor (RCE) An Olympics case study Jason Suess Principle Technical Evangelist Media Delivery Scenarios.
E u r o p e a n C o m m i s s i o nCommunity Research Global Change and Ecosystems Malta, 27 January 2004 Alan Edwards EUROPEAN COMMISSION GMES – Implications.
Climate-SDM (1) Climate analysis use case –Described by: Marcia Branstetter Use case description –Data obtained from ESG –Using a sequence steps in analysis,
The Global Scene Wouter Los University of Amsterdam The Netherlands.
CARBOOCEAN Data management and SOCAT Benjamin Pfeil, Are Olsen, Jeremy Malzcyk, Steve Hanhin, Alex Kozyr and many others Partner 16 WDC-MARE Partner 19.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
Library Efforts and IT Infrastructure Services Paul Conway & Mike Pickett Duke University
NTG Spatially Online: Accessing spatial data on the net SSI Seminar Series September 2007.
Nci.org.au © National Computational Infrastructure 2016 Virtual Laboratories in Australia Lesley Wyborn (NCI) With contributions from:
Reading e-Science Centre Technical Director Jon Blower ESSC Director Rachel Harrison CS Director Keith Haines ESSC Associated Personnel External Collaborations.
Accessing the VI-SEEM infrastructure
Near-real-time monitoring activities: today and tomorrow
DataNet Collaboration
Collaboration and Outreach
Dutch Data Award for beta sciences 2012
Content Management Systems
Geospatial Technology Evolution and Future Trends
Be The Weather Guy Presented to UCALL on October 14, 2009
‘Basic approach: Reporting and data handling’
GitHub A Tool for software collaboration James Skon
WPS 4 ODV: on-the-fly server-side plotting of data (in Google Earth)
Presentation transcript:

YOU? OpenEarth PMR-NCV … OpenEarthTools = Open source management of Data, Models and Tools for marine & coastal science & technology wwww.OpenEarth.eu PMR-NCV .. and what about YOU?

An community of users since 2003 Delft3D is under strict version control; data, models and tools usually aren’t Make things beyond capabilities of single user: Google Earth DELFT3D preprocessing & MODELS input bathymetry input meteo input sources postprocessing TOOLS: output calibration output validaton DATA

What is OpenEarth: philosophy community repository delivery Cooperate

What is OpenEarth: community Prisoners dilemma & Tragedy of the commons: 1+1=3 sometimes sharing does not work, but usually it does OpenEarth accepts some asymmetry in sharing: it is the player that keeps the sharing going

What is OpenEarth: community philosophy community repository delivery Cooperate

What is OpenEarth: community needs structure all collaborating is not enough chaos coordination needed but no overall boss like wikipedia scripts mutate & spread: virus-like Cooperate Project 1 Project n Models Data Tools

What is OpenEarth: repository version philosophy community repository delivery Cooperate central storage What Wikipedia does for knowledge what SubVersion does for tools + data: “wikitoolia” or “toolipedia”

What is OpenEarth: web services version philosophy community repository delivery Cooperate central storage check this out What Youtube does for movies we want also for tools + data: 100% web services: “Datatube” or “Youdata”

http://www.youtube.com/user/FedorBaart#p/a/u/0/5OTko5bhFic

OpenEarth is already truly a community TOOLS: > 3000 commits! > 60 active users > 200 aanvragen DATA: > 1350 commits! > 60 active users

Overlay icons show status of local copy up to date modified added

Matlab toolbox for Delft3D in addition to: C:\Delft3D\w32\matlab\

Matlab toolbox for Delft3D-FLOW

Matlab toolbox for Delft3D-WAQ/PART

Matlab toolbox for SWAN-FLOW Some guidelines to make community toolbox work: * header line for contents * cut ‘n paste example * see also * unit test * copyright/disclaimer

Open1Earth2 weather models 10 km resolution Open1-access Google-Earth2-alike of all environmental data products covering any range of physical scales located anywhere on the world under rigorous version control satellite data 1km resolution Dutch digital elevation map 100 m resolution Proces scale: km/yr after De vriend coastal bathymetry 10 m resolution dune profiles 1m resolution scale of interest: km/yr

GooglePlot + convertcoordinates Matlab GooglePlot pcolor KMLpcolor surf KMLsurf text KMLtext contour KMLcontour scatter KMLscatter line KMLline quiver KMLquiver mesh KMLmesh [D.lon, D.lat,log]=convertCoordinates(D.x, D.y,… 'CS1.code',28992,… %local system 'CS2.code',4326) %wgs84

GooglePlot toolbox 2D Delft3D CSM

GooglePlot toolbox 2D Delft3D Kartina Delft3D Markermeer

GooglePlot toolbox 2D Unesco-IHE Westernschelt Delft3D Kartina

GooglePlot toolbox 3D Delft3D Markermeer

GooglePlot toolbox 3D Delft3D Rhine Rofi

GooglePlot toolbox 3D Delft3D Rhine Rofi

GooglePlot toolbox 3D Delft3D Rhine Rofi

DATA DELFT3D preprocessing & postprocessing TOOLS: MODELS input bathymetry input meteo input sources postprocessing TOOLS: output calibration output validaton DATA

Use of data directly from OPeNDAP server Delft3D-Quickplot Delft3D Quickplot Rookies can do this

How does OpenEarth do that: WORKFLOW tools data Version control and backup Web access to datasets Straightforward visualisation tools data & scripts from pluriform to standard format! open source software

Source control for Dash DashBoard Technical session tomorrow

Community of practice: OpenEarth has a wide range of users (Building with Nature, EU FP7 MICORE, Delft Cluster etc.). Building with Nature facilitates training sessions.

Summary An active community with 60 developers within 2 years 100’s of users 3000 commits: value 20k€ - 200k€ (6 - 60 minutes per commit) Crowd-sourcing did not lead to chaos: well-documented Repository of 1000’s of free matlab TOOLS Delft3D toolbox Google Earth toolbox coordinate conversion Organized workflow for DATA with open source tools: facilitate input facilitate calibration/vaildation

OpenEarth Sign-up @ www.OpenEarth.eu The username allows you to contribute immediately if you like it.