1. INTRODUCTION TO COLLECT PRIORITIES 2014 v1.0

2. 2 COLLECT

3. Collect Insights, Perspectives and Data: Priorities 3 Resources Priorities Costs & Constraints Ratings Collect

4. Collect: Purpose of Establishing Priorities 4 Participate in a facilitated voting process to determine the relative importance of an organization’s goals Facilitate discussion to reveal stakeholder viewpoints and positions Understand consensus and how to use it Understand inconsistency and alignment Priority Graph ALIGNMENT INCONSISTENCY At Your Convenience (AYC) Voting ESTABLISH PRIORITIES RATE ALTERNATIVES Pairwise Criteria Understand Criteria Enter judgments Facilitator Techniques Show/Hide Votes Foster Discussion Understand Consensus Calculate # of Comparisons

5. How does an organization determine preference of rating factors? Absolute judgments  Rank order or assign weights  It is challenging to differentiate among many choices  Can be somewhat arbitrary Relative judgments  Compare two items at a time  Easier to select from a pair  Methodical approach to assigning preference Pairwise judgments  Enables us to layer in strength of feelings or preferences  Captures “shades of gray” 5

6. Comparing criteria enables us to quantify subjective judgments Which criterion is more important? How much more important is it? 6 Current Asset Condition Planning Factors Supports Mobility/ Congestion Principles Site Characteristics Current Asset Condition _ ??? Planning Factors __ ?? Supports Mobility/ Congestion Principles ___ ? Site Characteristics ____

7. How much more important is one choice over the other? Scale for Comparison 7 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 Equal importance Moderate importance Strong importance Very Strong importance Extreme importance By picking a number (X) on the scale you are saying that a given criteria is X times more important than the other.

8. The judgments we enter tell us the importance of each criterion with respect to the others Use keypads or individual computers to enter judgments when participants are together in a conference room Use a computer to enter judgments when participants are dispersed 8 Current Asset Condition Planning Factors Supports Mobility/ Congestion Principles Site Characteristics Priority Current Asset Condition __ 331.35 Planning Factors __ 13.32 Supports Mobility/ Congestion Principles __ 2.14 Site Characteristics __.12 100%

9. Introducing Criteria Comparison Voting Show the criteria model and explain that you will decide how to weight the criteria as a group Explain that there are two decisions to be made  Which criterion is more important?  How much more important is the criterion than the other one? Present the two judgments in the context of the decision goal The first time a criterion is introduced, display and read its definition 9

10. Establish Priorities Process 10 Access the pairwise comparison by clicking Tab 2 Collect then Priorities 11 Participants in the Meeting will be listed in bold on the left pane 22 2 2

11. Establish Priorities - Entering Judgments 11 Each participant makes judgments by clicking the cell they choose, or voting using their assigned keypad 22 Participants will make judgments on pairs of criteria by answering two questions: As it relates to this Decision Goal, 1. Which criterion is more important. 2. Evaluate how much more important 11 2 2

12. Establish Priorities - Entering Judgments cont. Explain voting scale on the first vote; ask voters to:  Click a 1: the criteria are equally important  Click a 5: Criteria A is strongly (5x) more important than B  Click Switch: Criteria B is strongly (5x) more important than A 12

13. To show remaining pairwise comparisons click Establish Priorities – Views and Navigation 13 22 To view the Criteria Definitions click 11

14. Establish Priorities – Views and Navigation cont. 14 The Navigation will now show all the comparisons at the bottom of the screen and you have the option to select the comparison you wish to vote on 11

15. Establish Priorities – Views and Navigation cont. 15 Click to show the Tree View icon, which displays the criteria framework. Paired comparisons are done at each level in the tree 11

16. Establish Priorities – Views and Navigation cont. 16 The Fullscreen feature expands the screen. Click to activate and deactivate the feature 11

17. Show/Hide Judgments (Votes) 17 The facilitator has the option to Show or Hide votes and lock this view 11

18. Select the option to Show vote direction which indicates the direction voters placed their judgments Show Judgments (Votes) 18 Show judgments to presenter allows the presenter to view votes as they are entered. Show judgments to participants allows for the presenter and all model participants to view votes 2211 Note: The screen displays which participants have voted 2 2

19. Another way to change a vote is to simply click on a new cell. This will change the vote to the new number Delete Judgments (Votes) 19 If a wrong vote was entered, the vote can be deleted by right clicking on the mouse and selecting Delete Vote 22 11

20. The solution will take you to the comparison. Clear out the text box by pressing when finished with the search Quick Search Feature 20 Use the Quick Search feature to search for a particular comparison by typing the name in the box and pressing ENTER 2211

21. Establish Priorities – Enhanced Filtering Within the Control Panel, there are capabilities to filter by participants or by Participant Groups.  Filter settings persist across screens for consistency  Filter Control Panel can be closed to maximize viewable work area  Filter ribbons show on screen what filters are in place and allow for one click reset (Priority Screen) 21

22. Establish Priorities – Control Panel 22 Note: Criteria Participant settings impact overall calculations To add filters open the Control Panel You can select all participants by clicking in the dial next to ALL or you can select individual participants by clicking in the dial next to their name. The selected participants will appear on the voting screen 11 22

23. Establish Priorities – Filter Ribbon 23 The Filter Ribbon in the Priority Graph shows what filter has been applied 11 Closing the filter with the X, will remove all filters 22

24. Facilitation Techniques: Group Discussion If hiding votes, show votes after all votes are cast Determine whether discussion is necessary  Relative agreement – no discussion required  Relative agreement with an outlier – not likely required  Relative disagreement – discuss varied points of view Guide discussion  Ask one participant on each side to provide their thoughts  Ask whether anyone had another point of view to share  Ask participants to enter any changes in light of the conversation 24

25. What is consensus? Consensus does not require unanimity, rather it represents the following: The absence of sustained opposition to substantial issues The inclusion of the viewpoints of all parties concerned Discussion of any conflicting viewpoints General understanding of the issues and agreement among participants It’s ok to agree to disagree 25

26. Parent/Child Relationship Parents are compared to all other parents Children are compared to children of the same parent 26 Children Parents Deliverability Traffic volume Planning Factors Pavement Risk Assessment Bridge Risk Assessment Truck Volume Insufficient Capacity (Level of Service) Supports Mobility/ Congestion Principles Supports Mobility/ Congestion Principles Prioritize Projects for Funding Site Characteristics Current Asset Condition Planning Support

27. Best Practices for Establish Priorities To ensure a better understanding of top level criteria, the facilitator should conduct “bottom up” voting  Top Down – start at the parent level criteria first (solution default)  Bottom Up – start with criteria that have children and compare children before comparing parents Whenever possible, conduct pairwise comparison as a group; group discussion can be more valuable than the answer itself The facilitator should be cognizant of the group dynamics and guide the use of Show/Hide Votes The facilitator should promote group discussion to inform and provide a rationale for voting discrepancies 27

28. Learn more at DLU.decisionlens.com