1. Ocean Observatories Initiative R2.0 Beta Test Field Report January 24, 2013 1 ION R2.0 Beta Test 2013-Jan-24 Field Report Susanne Jul, Carolanne Fisher, Lynn Morgan CI User Experience Team

2. R2.0 Beta Session 4 January 24, 2013 Introduction This is a compilation of preliminary results from Sessions 1- 3 of the R2.0 Beta Test effort. It represents issues identified through a rapid triage process used while testing was in progress. An in-depth analysis of the data collected is in progress and may reveal deeper issues. The first section, Findings to Date, contains a summary of findings from the rapid analysis that was presented to the Beta Test User group on Jan 24. The second section, Findings Reported at Individual Sessions, contains the report-back of issues identified presented to testers on a session by session basis. 2

3. R2.0 Beta Session 4 January 24, 2013 FINDINGS TO DATE (PRELIMINARY) 3

4. R2.0 Beta Session 4 January 24, 2013 4 3 Sessions Completed # Start Date Title Topics Covered 112/18/2012 Session 1 - R2.0 Beta Test - System Setup & Orientation Browser set up, user documentation, sign in, account creation 201/09/2013 Session 2 - R2.0 Beta Test - Working with Marine Resources OOI marine resource preload, commanding marine resource, resource status, user roles/permissions 301/16/2013 Session 3 - R2.0 Beta Test - Working with Resources & Data OOI data product preload, interacting with charts, data visualizations, downloading data and attached files 401/24/2013 Session 4 - R2.0 Beta Test - Review Review of Findings, Discussion Topics 501/30/2013Session 5 - DiscussionContent as needed. 602/06/2013Session 6 - R2.0 Beta Test - tbdContent as needed.  Session topics adjusted with tester requests and system evolution

5. R2.0 Beta Session 4 January 24, 2013 13 Participants 5 11 individuals participating regularly 2 individuals with occasional particpation (B Pritchett, H-J Kim) Pilot testers test materials and system in advance of full group

6. R2.0 Beta Session 4 January 24, 2013 6 Tester Participation WebEx/ One-One Attendance Worksheets Completed Phone Debriefs Conducted Unique Issues Identified Session 112 11268** Session 29 8646 Session 311 9321*** Total to Date 32* 2811135*** * 13 different individuals ** Includes “Session 2” issues from 3 testers *** Collation still in progress – 176 total 1/24

7. R2.0 Beta Session 4 January 24, 2013 Types of Issues Identified 7 130 Issues 5 “Beta test” issues omitted ✕ ✕

8. R2.0 Beta Session 4 January 24, 2013 Types of Issues Beta test Issues related to test materials and dummy data Display Issue related to screen rendering (e.g., lines misaligned) Text formatting issues excluded Documentation Issues related to User Documentation (e.g., editing suggestions, content additions) Information displayed Issues related to information content of screens (e.g., information missing or superflous) Interaction o Issue related to user interaction and screen element behavior (e.g., button not working or suggestion for desired interaction) Naming & Terminology o Issues related to object names and on-screen labels Question or Misconception o Question about system or project plans (e.g., for FAQ) Security concern o Issue related to credentialing process Text format o Issue related to formatting or rendering of text on screen (e.g., font size, overlapping text) 8

9. R2.0 Beta Session 4 January 24, 2013 Issue Analysis 9 125 Issues Beta test, marine integration, security issues omitted

10. R2.0 Beta Session 4 January 24, 2013 Categories of Resolution Bug System is not as intended, recommend fixing Concern Further consideration needed to determine recommended solution Feature request System enhancement, consider when planning system evolution Known issue Fix is already planned User Documentation Issue is addressed through User Documentation FAQ Question response should be placed in FAQ and sent back to user community 10

11. R2.0 Beta Session 4 January 24, 2013 Resolution Status 11 28 Issues Fixed Bug/Known Issue/User Documentation

12. R2.0 Beta Session 4 January 24, 2013 Types of Issues 12 130 Issues Beta test omitted

13. R2.0 Beta Session 4 January 24, 2013 Naming & Terminology “Node” mapped to “Platform” Creates “Sub-Platform” Reference designators used as Instrument names Use of “Observatory,” Platform/Instrument “Family” New two-character codes 13

14. R2.0 Beta Session 4 January 24, 2013 Resolution Integrating OOI definitions and names into ION Issue caused by lag of information propagation Reviewing within CI Platform naming CI proposing standardized naming convention 14

15. R2.0 Beta Session 4 January 24, 2013 Marine Integration Clarification of social processes and plans for defining, implementing and testing status value calculations of marine assets (instrument, platform, observatory) Clarification of procedures for assigning Product and QC Levels of Data Products 15

16. R2.0 Beta Session 4 January 24, 2013 Resolution 16 TBD

17. R2.0 Beta Session 4 January 24, 2013 Proposed Next Steps Continue weekly sessions through Feb, Wed 1 pm PT Discussion forum to resolve issues and answer questions Hands-on as soon as useful and meaningful 17

18. R2.0 Beta Session 4 January 24, 2013 ION Beta Access Will be up as much as possible Check User Documentation page for status and planned downtime We will post summary of new features when system is updated Link from User Documentation status area Email to ionbetatesters and io_integration_group Briefing in Wed sessions 18

19. R2.0 Beta Session 4 January 24, 2013 Proposed Schedule Wed 1/30 Question responses Issue resolution discussion Topics determined Monday Fri 2/1 11 am PT R2.0 Beta Test Findings (Presentation) Wed 2/5 Hands-on (editing attributes, lifecycle state, charts, adding users) 19

20. R2.0 Beta Session 4 January 24, 2013 FINDINGS REPORTED AT INDIVIDUAL SESSIONS 20

21. Ocean Observatories Initiative R2.0 Beta Test Field Report January 24, 2013 21 Report-Back Session 1: System Setup and Orientation

22. R2.0 Beta Session 4 January 24, 2013 Key Findings 22 93 issues reported from 9 testers ~> 68 unique issues collected 7 - Fixed Main stumbling block with Session 1 was logging in using a Google account when another Google account was already in use on the browser. 51 – Under Evaluation 10 - Known Issues All beta testers successfully o opened Beta System on Chrome, Mozilla, or Safari browsers o signed-in using the test account o created account

23. R2.0 Beta Session 4 January 24, 2013 23 Report-Back Session 2 Working with Marine Resources

24. R2.0 Beta Session 4 January 24, 2013 Key Findings 24 Findings / Statistics – Session 2 67 issues reported from 9 testers > 47 unique issues collected 6 - Fixed Memory Issues in ion-beta Terminology & Composition 34 - Under Evaluation 3 - Known Issues Some Status page input Account Settings visible Commanding Instrument (3) 4 – longer term in JIRA 20 - Fixed 97 - Under Evaluation 12 - Known Issues 6 – longer term in JIRA All Beta Testing Findings / Statistics; Total unique issues - 135

25. Ocean Observatories Initiative R2.0 Beta Test Field Report January 24, 2013 Report-Back Session 3 Working with Marine Resources 25

26. R2.0 Beta Session 4 January 24, 2013 Key Findings – Session 3 26 Terminology & Marine IO feedback on Composition of System Memory Issues in ion-beta, system brought down Fri, 2 pm PT Findings / Statistics – Session 3 67 issues reported from 9 testers > 47 unique issues collected 6 - Fixed Memory Issues in ion-beta Terminology & Composition 34 - Under Evaluation 3 - Known Issues Some Status page input Account Settings visible Commanding Instrument (3) 4 – longer term in JIRA