1. Next Generation Data System & Collaborative Portal November 2, 2006 James G Bellingham, Michael A Godin Dorota Kolber, Lionel Pawlowski Monterey Bay Aquarium Research Institute

2. Data/Collaboration Highlights “Virtual Experiments” preceded the field work Most researchers remained at home institutions. More real-time model outputs Standard products for comparing data A variety of ways to share findings and data –Collaborative system allowed investigators to post analyses and/or link to own sites 2006/11/02 Bellingham & Godin

3. Automated data collection system –Included data streams from outside the experiment –Often fragile with respect to source data changes –Mostly worked, but still finding some problems (thanks, Wayne!) Non-ASAP data originators often ‘last minute’ –Difficult to handle –Some errors in common data format resulted Collaborative portal used in lieu of RTOC meetings 2006/11/02 Bellingham & Godin Data/Collaboration Highlights

4. Data System Throughput From July 20 to September 14, 2006: 75,406 raw files (160 GB) collected by central server. 187,494 common format files (129 GB) created. 38 data formats handled 2200 GB data served 2006/11/02 Bellingham & Godin

5. MB2006 Data Collection LOCOASAPUPS/PLUSNetAESOPOther 2006/11/02 Bellingham & Godin

6. 2006/08 Overall Usage Teleconference Downloads Visits/Sites Hits 2006/11/02 Bellingham & Godin

7. Countries that accessed the site ArgentinaCzech RepublicItalyPortugal AustraliaDenmarkJapan Russian Federation BelgiumEstoniaKorea (South)Sweden BrazilFinlandMexicoSwitzerland CanadaFranceNetherlandsTaiwan ChileGermanyNetworkTurkey Cocos IslandsHungaryNew Zealand United Kingdom ColombiaIndiaNorwayUnited States Costa RicaIrelandPoland

8. Collaborative Portal Usage Distributed observatory management achieved Usage levels varied from day to day Tools other than portal were sometimes used More clarity in decisions on days when COOP tool was used heavily. 2006/11/02 Bellingham & Godin

9. 2006/08 Collaborative Portal Usage Teleconference Missed Teleconference Press DayNo Call Scheduled Proposals Postings Logins 2006/11/02 Bellingham & Godin

10. 2006 Experiment Lessons Standard visualizations are very useful Virtual experiments are useful for deciding upon standard visualizations Common format data needs formal, continuous QC Need versioning on both source (raw) data and common format data Collaborative tools should interoperate with familiar tools (e-mail lists, teleconference) 2006/11/02 Bellingham & Godin

11. Data System Thoughts Add archive data (MUSE-2000, AOSN-2003) Add missing/revised MB2006 data Refine access controls Continue as “ad hoc observatory” –All available data to 500km west of Monterey Apply in other field programs and observatories Allow real-time queries/visualizations (Metadata Oriented Query Assistant – MOQUA) 2006/11/02 Bellingham & Godin

12. User Feedback Data System –What worked / did not work for you? –What would you like to see in the future? Standard Products – can they be improved? Portal –What worked / did not work for you? –What would you like to see in the future? 2006/11/02 Bellingham & Godin

13. COOP thoughts Data system needs be brought into collaboration space –MOQUA as portlet? –Visualization portlet? –Produce movies of standard products? –Ability to share data by passing ‘pointers?’ –Ability to set up custom products or alerts?

14. COOP thoughts Needs to scale gracefully as duration, data volume, and number of users grow –Provide overview of COOP activity (e.g., when is there lots of discussion, when is there a lot of interrogation of the site, what is the favorite page of the moment, etc. etc.) –Search capability (when did a particular individual post material to COOP) –Pivot off of something other than day –Allow users to break into separate ‘experiment spaces?’

15. COOP thoughts Personalize COOP –News update for you when you log on (e.g. everyone voted on a new plan on the 12 th, a particular person posted a message, etc.) –News flashes email to you (email version of above, or email version of update)? –Custom comparison products produced for you in your private workspace? –Alerts triggered off of observations or data (e.g. winds predicted to be from the NW tomorrow)

16. Entrain talent Computer science community very excited about COOP Visualization – e.g. Donna Cox, UW effort using World Wind Work flow – e.g. KEPLER Data systems – e.g. MBARI Shore Side Data System Data systems – metadata standards…