1. 21-05-0215-03-00001 IEEE 802.21 MEDIA INDEPENDENT HANDOVER DCN:21-05-0215-04 Title: IEEE 802.21 Down Selection Process Date Submitted: January 18, 2005 Presented at IEEE 802.21 Reflector Authors or Source(s): Ad hoc Group on Evaluation Criteria Abstract: This document summarizes the down-selection process for developing IEEE 802.21 draft specifications.

2. 21-05-0215-03-00002 IEEE 802.21 presentation release statements  This document has been prepared to assist the IEEE 802.21 Working Group. It is offered as a basis for discussion and is not binding on the contributing individual(s) or organization(s). The material in this document is subject to change in form and content after further study. The contributor(s) reserve(s) the right to add, amend or withdraw material contained herein.  This contribution is made by the National Institute of Standards and Technology and thus is not subject to copyright in the US. [The contributor grants a free, irrevocable license to the IEEE to incorporate material contained in this contribution, and any modifications thereof, in the creation of an IEEE Standards publication; to copyright in the IEEE’s name any IEEE Standards publication even though it may include portions of this contribution; and at the IEEE’s sole discretion to permit others to reproduce in whole or in part the resulting IEEE Standards publication. The contributor also acknowledges and accepts that this contribution may be made public by IEEE 802.21. Does not apply]  The contributor is familiar with IEEE patent policy, as outlined in Section 6.3 of the IEEE-SA Standards Board Operations Manual and in Understanding Patent Issues During IEEE Standards Development http://standards.ieee.org/board/pat/guide.html> Section 6.3 of the IEEE-SA Standards Board Operations Manualhttp://standards.ieee.org/guides/opman/sect6.html#6.3 http://standards.ieee.org/board/pat/guide.html

3. 21-05-0215-03-00003 IEEE 802.21 Down Selection Process The proposed down-selection process addresses the following issues: 1)giving enough buffer time between presentations in order to work out details and build consensus 2)providing material to group ahead of time to allow for more thorough review and allow focused discussion 3) having a rule to sunset unpopular proposals after two trials. This document describes the procedures and timeline, for proposal presentation and draft text selection.

4. 21-05-0215-03-00004 1.After the November 2004 meeting no new proposals will be accepted for presentation in response to the Call For Proposal document #21-04-0151-02 2.Proposals submitted in November 2004 are presented again in their improved, standalone or harmonized form in the initial Phase, Phase I and Phase II. 3.Presentations are made available one week prior to presentation time in order to allow for sufficient review time. 4.Proposals should be accompanied with 1) checklist, 2) MIH call flow, and 3) MIH scope matrix according to templates provided in documents #21-05-199- 01, #21-05-216-02 for Phase I and Phase II presentations. 5.Proposals are required to provide draft text at Phase II and make it available for review two weeks prior to presentation time. 6.Presentation order is random as determined by the Chair 7.Time allocated to each presentation is evenly distributed among all contributors 8.Straw polls may be conducted at the discretion of the Chair at the end of an initial phase presentation in order to provide additional feedback on a proposal. 9.Working Group vote may be provided at the end of a Phase I presentation in order to provide feedback on a proposal. Presentation Procedures

5. 21-05-0215-03-00005 Timeline Initial Phase All proposals submitted in response to the Call for Proposal #21-04-0151-02 are presented Phase I Harmonized proposals are presented with more details/ explanatory text (available 1 wk prior to meeting) November 2004 Phase II Harmonized proposals are presented with Draft Text (available 2 weeks prior to meeting) Draft Standard Text is contributed to Draft IEEE 802.21 Standard Motion to be included in standard passes by 75% Motion fails to get 75% Proposal is no longer considered by the group Evaluation Guidelines #21-05-199-01, #21-05-216-02 Ad hoc group works on evaluation guidelines document Evaluation criteria used in Phase II down selection Harmonization March 2005 May 2005 Harmonization January 2005 Harmonization Harmonized proposals are presented (available 1 wk prior to meeting) Working group vote on proposal for feedback Straw poll vote on proposal for feedback

6. 21-05-0215-03-00006 1.The down selection is applied in Phase II 2.Authors provide text for review two weeks prior to presentation 3.A motion to approve draft text provided by the proposal and make it part of the IEEE 802.21 draft specification is brought forward to the Working Group at presentation time. 4.A proposal containing multiple components can lead to multiple motions. 5.Authors must indicate at presentation time how many motions they intend to bring forward to the working group. 6.All motions are carried out at the end of all presentations 7.Time allocated for motions is advertised in the opening meeting of each session. 8.A technical motion at Phase II selection requires 75% to pass 9.Written questions for clarifications to be submitted to groups one week in advance 1. Answers to these questions submitted within 3 days thereafter Down Selection Process

7. 21-05-0215-03-00007 9.In case no motion passes by 75%, the proposal receiving the most number of votes is selected for another round of confirmation vote by the Working Group. More than one proposal can be selected at this stage in case the most popular proposal does not cover all work items specified in the CFP. Proposals are selected in decreasing order of popularity (# votes) received. 10.In case multiple proposals are approved by more than 75% they are integrated into the draft text. Proposers work with the Editing Committee in order to combine proposals Conflict and overlaps are brought back to the WG to vote on. Failed proposals are eliminated from further consideration. 11.If no proposal is approved at the end of Phase II, the working group may need to regroup. The options include (1) refining the requirements document, (2) refining the evaluation and down- selection criteria, (3) reissuing a new call for proposals. Down Selection Process II

8. 21-05-0215-03-00008 802.21 Proposal Voting Process Vote on all proposals available Proposal(s)* getting highest votes are subject to confirmation vote Proposal(s) are broken up into several workitems; WG votes on each workitem Options are provided for each overlap area; WG votes on options available for overlap 75% Approval? Any proposal gets > 75%? Yes No Inclusion in draft specifications Authors work w/ Editing Committee to integrate text into draft specifications No Yes Any contentious overlap**? Option gets 75% Approval? Yes No Elimination from further consideration No *There could be several proposals under consideration in order to cover different work items **Overlap is identified by Editing Committee, WG members, and/or proposers; contention in resolving overlap is brought to WG for vote. Workitem gets 75% Approval? Yes No

9. 21-05-0215-03-00009 1)Following each presentation phase, a harmonization effort among proposals addressing similar issues is encouraged. 2)The evaluation guidelines documents # 21-05-199-01, #21-05-216- 02 contain information such as MIH call flow templates, MIH scope matrix, and proposal checklist that should assist in the understanding and the review of proposals. Harmonization Efforts and Evaluation Guidelines