Presented to IEEE Standards Education Committee 11 April 2014 NIST Grant Proposal Presented to IEEE Standards Education Committee 11 April 2014 Jennifer McClain and Susan Tatiner 11/18/2018

NIST Standards Services Curricula Development Cooperative Agreement Program Provides funding to support the integration of standards and standardization information and content into seminars, courses, and learning resources. To support curriculum development for undergraduate and/or graduate level. NIST anticipates funding between two and eight projects that are from 12 to 18 months each Each award is $25,000-75,000 Earliest expected start date for awards is July 1, 2014. 11/18/2018

NIST Grant Requirements Recipients of the awards will work to develop curricula for undergraduate or graduate students focusing on the significance, value, and benefits of standardization Will seek to identify sustainable approaches supporting the integration of standards-related content into existing curricula in U.S. colleges and universities. Participants must share project information with relevant stakeholders, publicly release the eventual results of the project. Due date for applications was 31 March 2014. 11/18/2018

IEEE’s Proposal… To create a Massive Open Online Course (MOOC) on Standards. Expect to deliver the IEEE course on an existing platform on Coursera.org or edX.org. Requested $75,000 for 18 month project. Project will be overseen by the SEC and managed by IEEE Professional Staff 11/18/2018

Standards: A Driving Force for Commerce The MOOC on Standards: A Driving Force for Commerce will offer a practitioners’ view of standards and standards development aimed at graduate-level students and educators in the fields of engineering, technology, and computing (ETC), business, economics, and law. The course is designed to provide a comprehensive understanding of the intersection of economics, technology, and politics that is integral to standardization. Delivered over the course of six weeks by a university professor (to be determined), the Standards MOOC will provide a full survey of fundamental standardization themes: Introduction to standards and history, basic concepts and classifications, along with crucial topics like innovation, global markets, trade, implementation, conformity assessment, regulation, intellectual property, motivating factors in standards development, etc. 11/18/2018

Standards: A Driving Force for Commerce This new method for delivering course content will be freely and widely available on mobile and non-mobile devices. Students can ‘audit’ the course at no charge or pursue a Certificate track for a reasonable fee. If a university would like to run the Standards MOOC as part of a course for paid college credit, the IEEE will offer a license to the university in order to make that possible. Content will be designed collaboratively by an instructional designer and a university professor with advisement from SEC and staff. Course will contain video, audio, animation, and printed elements. Course material will be delivered by the professor, along with guest lecturers who are experts in the fields of patents in standards and conformity, and assessment, among others. There will be an interactive user forum that supports a common MOOC goal of building an ongoing community. 11/18/2018

Student & Project Evaluations The goal of the Standards MOOC is to help students develop a skillset around technical standards that enables them to compete more effectively in the global economy. The objective of the program evaluation is to determine if this main purpose of the Standards MOOC has been achieved. Student Evaluations Students will be asked to take a mandatory pre-test at the beginning of the course. Mandatory quizzes will be built into each class in order to establish whether participants are learning the material. A final, multiple-choice test will be built into the course. There will also be a paper submission option in which the student may write a short paper on topics to be chosen by the professor. These papers will be evaluated via a peer-grading mechanism and the papers graded the highest may become eligible for publication in the IEEE Standards e-Magazine. Top-rated papers will be reviewed by the professor and the SEC. 11/18/2018

Evaluating Students & Project Project Evaluation will include: Pre-test designed to benchmark participating students’ understanding of standards-related concepts Quiz questions to determine if students are understanding the material as it is presented Note, because the final test is not mandatory, the quizzes will collectively be the primary means used to gather this data. Evaluators will also use the final multiple-choice exam, final papers, and the user forum as supplementary material for analysis. IEEE will contract with an independent evaluation consultant or learning assessment designer to prepare evaluation materials (pre-test, quizzes, final exam). These evaluation materials will be designed to provide accurate and objective data on the performance metrics. 11/18/2018

Performance Metrics Continued The number of students starting the course; The number of students participating to its conclusion, both in the certificate and non-certificate track; Assessment at entry and at conclusion of the course of the students’ understanding in the following three areas: the role that standards play in creating a competitive edge in a global market economy; the role that standards play in driving technology development and innovation for global markets; The organization of standards development activities and how practicing engineers like themselves are able to take part. 11/18/2018

Additional Metrics Students will be asked to evaluate the course content and delivery at the end of the course.  Staff will gather data on number of students who sign up, who actively participate, who complete the course, who pass the quizzes and final test, who submit a final paper, and how many students go on to complete the course under the IEEE certificate of completion process. Metrics on post-MOOC community will be maintained as part of project evaluation. Analysis of all the above results of the proposed MOOC project, including its sustainability, will be included in the final summary paper submitted to NIST. 11/18/2018

Thank you 11/18/2018