We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byAna Patterson
Modified about 1 year ago
© Crown copyright Met Office Towards an optimized communication of probabilistic weather forecasts via the internet Liz Stephens 1, Ken Mylne and David Spiegelhalter 2 1. University of Bristol, 2: University of Cambridge
© Crown copyright Met Office Defining project Designing representations Developing game Running game Outcomes Intro Project Brief Summary review existing ways of representing probabilistic information develop online surveys to ascertain user preferences for specific designs analyse the outputs provide recommendations regarding which designs work best with people from different demographic profiles
© Crown copyright Met Office Defining project Designing representations Developing game Running game Outcomes Intro Current representations Summary Metcheck yr.no Australia Probcast (UW) UK Met Office
© Crown copyright Met Office Defining project Designing representations Developing game Running game Outcomes Intro Objectives, scope and limitations Addressing assumptions: “the public don’t understand uncertainty” “uncertainty is too difficult to communicate” …everyday weather not extremes …basic representations …no implicit representations …temperature and rainfall only …6 months Can players make better decisions? How does this vary with presentation type? Demographic influences Preference vs understanding Summary
© Crown copyright Met Office Defining project Designing representations Developing game Running game Outcomes Intro Summary
© Crown copyright Met Office Defining project Designing representations Developing game Running game Outcomes Intro Deterministic Basic Rating Percentage (rounded) Range of values & percentage Probability distribution & percentage Summary
© Crown copyright Met Office Defining project Designing representations Developing game Running game Outcomes Intro Maximise participants Start & finish game Want to do well To share with friends Useful tests Correct decision (relative) Understanding of actual confidence Appropriate Consider theme, style and complexity Not too specific Appeal to all demographics Realistic Associate with real weather situations Hint at utility of uncertainty information Summary
© Crown copyright Met Office Defining project Designing representations Developing game Running game Outcomes Intro Age, postcode, gender… Randomly assign presentation type Multiple questions: expect different responses depending on presentation type Outcomes generated on-the-fly (based on probabilities) Only look at 1 st time players Quadratic scoring rule Summary
© Crown copyright Met Office Playing the game How confident are you about each shift – tests understanding of presentation
© Crown copyright Met Office Scoring Each shift is allocated an outcome randomly selected from the forecast distribution Element of luck! Amount of ice cream bought and sold depends on advice and outcome Total score at end of game:
© Crown copyright Met Office Defining project Designing representations Developing game Running game Outcomes Intro Summary Outcomes >8000 people – largest survey of its kind (aiming for 10,000+) Hope to be able to: Identify the percentage of correct answers from each presentation type Identify the skill score of confidence ratings for each presentation type Link this with demographics
© Crown copyright Met Office DeterministicProbabilistic Defining project Designing representations Developing game Running game Outcomes Intro Summary Early Results Brad makes more money with probabilistic forecasts!
© Crown copyright Met Office
Under 16 16-2425-34 35-44 45-5455+ Defining project Designing representations Developing game Running game Outcomes Intro Summary
© Crown copyright Met Office Defining project Designing representations Developing game Running game Outcomes Intro Summary Game carefully designed to answer a few simple questions Large sample achieved across different demographics Early results show benefit of probabilistic forecasts Detailed analysis of different presentations is underway Men over 55 do spectacularly badly! You have a few days left to play: www.metoffice.gov.uk/weather/weather-game Not too late to win a T-shirt! email@example.com Thanks!
1 Classroom-Based Research: How to Be a Researcher in Your Classroom Basic Skills Initiative Teaching and Learning Workshop October 2009 Darla M. Cooper.
Page 1© Crown copyright 2006ESWWIII, Royal Library of Belgium, Brussels, Nov 15 th 2006 Forecasting uncertainty: the ensemble solution Mike Keil, Ken Mylne,
Approaches Workbook Conditioned Games – Teacher Answers.
Second Language Classroom Research (Nunan, D. 1990) Assoc. Prof. Dr. Sehnaz Sahinkarakas.
Details for Today: DATE:13 th January 2005 BY:Mark Cresswell FOLLOWED BY:Practical Dynamical Forecasting 69EG3137 – Impacts & Models of Climate Change.
Probability Evaluation 11/12 th Grade Statistics Fair Games Random Number Generator Probable Outcomes Resources Why Fair Games? Probable Outcome Examples.
Lecture 5 CS171: Game Design Studio 1I UC Santa Cruz School of Engineering 18 Feb 2010.
Evaluating Inforce Blocks Of Disability Business With Predictive Modeling SOA Spring Health Meeting May 28, 2008 Jonathan Polon FSA
CMU has been said to be the “most wired campus in the US” for two years in a row. What kind of impact does such a infrastructure has on the daily academic.
1. Introduction c) Probit Model Communication of Uncertainty in Weather Forecasts Pricilla Marimo, Todd R. Kaplan, Ken Mylne and Martin Sharpe Format A.
New Mexico Computer Science For All Designing and Running Simulations Maureen Psaila-Dombrowski.
Bridging Research, Information and Culture An Initiative of the Research and Planning Group for California Community Colleges Your Name Your Institution.
Searching for Extremes Among Distributed Data Sources with Optimal Probing Zhenyu (Victor) Liu Computer Science Department, UCLA.
© Crown copyright Met Office An Introduction to PRECIS PRECIS Workshop, University of Reading, 13 th -17 th May, 2013.
SIPR Dundee. © Crown copyright Scottish Flood Forecasting Service Pete Buchanan – Met Office Richard Maxey – SEPA SIPR, Dundee, 21 June 2011.
RESEARCH DESIGN. Design, at a basic level, means planning. Generally some decisions are to be taken before the actual action. The design is a plan to.
Managing Organizations Informed decision making as a prerequisite for success Action Vision Mission Organizational Context Policies, Goals, and Objectives.
Introduction to Information Skills & Systems Intro. to Information Systems.
Collider IT Project. Project Requirements Create a fun and addictive online multiplayer game Implement an Open Source physics engine (box2D) The.
Water Management Presentations Summary Determine climate and weather extremes that are crucial in resource management and policy making Precipitation extremes.
Signup Process Buy or Sell Stocks Look it up by name Click [list] to search Wikinvest Wikipedia = general company information Wikinvest = History, Charts,
Prepared by Poker Players Research Ltd.www.pokerplayersresearch.com Methodology for Spring 2010 Wave Poker Players Research Limited.
AIM Youth Advancing Integrated Microfinance for Youth Understanding How Youth Spend Their Time and Money: Lessons from Useful Research Tools Megan Gash.
Project Selection Techniques for selecting projects.
Approaches to quantifying uncertainty-related risk There are three approaches to dealing with financial and economic risk in benefit-cost analysis: = expected.
Marakas: Decision Support Systems, 2nd Edition © 2003, Prentice-Hall Chapter Chapter 4: Modeling Decision Processes Decision Support Systems in the.
Improving Academic Feedback - Turning the ship around with the power of 1000 students David Hope
Scottish National Golf Tourism Monitor. © Sports Marketing Surveys Ltd 2 »The programme agreed with VisitScotland & the Partner Agencies for the Scottish.
What is On Demand Testing? How does it work? What information can you get from the Adaptive and Linear Tests? How can you use the information to create.
Practical Application of Retention Modeling Chuck Boucek, FCAS e.
Non-parametric Bayesian value of information analysis Aim: To inform the efficient allocation of research resources Objectives: To use all the available.
Class Usability Experience User slides are in BLUE.
© 2008 Morningstar, Inc. All rights reserved. 3/1/2008 LCN Role of Immediate Annuities in Retirement.
You can use this presentation to: Gain an overall understanding of the purpose of the revised tool Learn about the changes that have been made Find advice.
Elementary statistics Ruth Anderson CSE 160 University of Washington 1.
Planning and Designing Effective Web Pages. When planning a new site Determine site goals 2. Identify the target audience 3. Conduct market research.
LECTURE 6 Randomness and Probability. RANDOM PHENOMENA AND PROBABILITY With random phenomena, we can’t predict the individual outcomes, but we can hope.
An Adjusted Matching Market: Adding a Cost to Proposing Joschka Tryba Brian Cross Stephen Hebson.
Questionnaire Analysis An analysis of the questionnaire in order to research demographical trends Errol Anderson.
EurEPS The Realization of an Operational LAM-EPS in Europe A SRNWP Project under EUMETNET Proposed to the EUMETNET Council at its 30 th meeting by Norwegian.
Copyright © 2009 Pearson Education, Inc. Publishing as Longman. Public Opinion and Political Action Chapter 6 Edwards, Wattenberg, and Lineberry Government.
Chapter 25 Asking and Answering Questions About the Difference Between Two Population Means: Paired Samples.
V WHAT MOTIVATES PROSPECTIVE STUDENTS? EXAMINING THE DECISION- TO-ENROLL PROCESS A Collaboration between Datamark and Kaplan University.
BA 201 Lecture 13 Sample Size Determination and Ethical Issues.
Deb Hearle and Nina Cogger. Cardiff University: Periodic Review & Re-validation Health Professions Council: Re-Approval College of Occupational.
Exploring uncertainty in cost effectiveness analysis NICE International and HITAP copyright © 2013 Francis Ruiz NICE International (acknowledgements to:
Copyright © 1997 CompassPoint Nonprofit Services What Does a Strategic Plan Look Like & How Do You Keep It Relevant? Anushka Fernandopulle CompassPoint.
e-marking in large-scale, high stakes assessments conference themes : role of technology in assessments and teacher education use of assessments for.
© Crown copyright Met Office Provision of Web Based Space Weather Services Catherine Burnett, ESWW-11, Liege, st November 2014.
-52- HMP654/EXECMAS Decision Analysis Alternatives and States of Nature Good Decisions vs. Good Outcomes Payoff Matrix Decision Trees Utility Functions.
© 2017 SlidePlayer.com Inc. All rights reserved.