2014 NAEP Technology and Engineering Literacy Assessment Junichi Hara July 7, 2010

Overview of the situation  In accordance to the ‘No Child Left Behind Act’, NJDOE has created its own definition of technological literacy, which was to reference Standard 8.1.  However, due to the upcoming 2014 NAEP Technology and Engineering Literacy Assessment, we now adjusted the definition, in order to prepare students to meet the national standards and our state standards.  The definition of technological literacy in New Jersey is now Standard 8 which incorporates both Educational Technology (8.1), and Technology Education, Engineering, and Design (8.2). National Assessment of Educational Progress

NAEP’s definitions  Definition of Technology, Engineering, and Technological and Engineering Literacy according to NAEP.  Technology is any modification of the natural world done to fulfill human needs or desires. (xi)  Example: Printing press (technological artifact). Assembly plant (infrastructure to create technological artifacts). Source: Technology and Engineering Literacy Framework for the 2014 National Assessment of Educational Progress Pre-Publication Edition

NAEP’s definitions  Definition of Technology, Engineering, and Technological and Engineering Literacy according to NAEP.  Engineering is a systematic and often iterative approach to designing objects, processes, and systems to meet human needs and wants. (xi)  Example: Assembly line (process; plans and directions for how artifacts are to be constructed). Source: Technology and Engineering Literacy Framework for the 2014 National Assessment of Educational Progress Pre-Publication Edition

NAEP’s definitions  Definition of Technology, Engineering, and Technological and Engineering Literacy according to NAEP.  Technology and engineering literacy is the capacity to use, understand, and evaluate technology as well as to understand technological principles and strategies needed to develop solutions and achieve goals. (xi) Source: Technology and Engineering Literacy Framework for the 2014 National Assessment of Educational Progress Pre-Publication Edition

Areas of Technology and Engineering Literacy

Technology and Society Technology and Society deals with the effects that technology has on society and on the natural world and with the sorts of ethical questions that arise from those effects. Design and Systems Design and Systems covers the nature of technology, the engineering design process by which technologies are developed, and basic principles of dealing with everyday technologies, including maintenance and troubleshooting. Information and Communication Technology Information and Communication Technology includes computers and software learning tools, networking systems and protocols, hand-held digital devices, and other technologies for accessing, creating, and communicating information and for facilitating creative expression. (xii) Source: Technology and Engineering Literacy Framework for the 2014 National Assessment of Educational Progress Pre-Publication Edition

How does it all tie in? The three areas of technology and engineering literacy are closely interconnected. For example, in order to address an issue related to technology and society… it is important to have an understanding of technological systems and the design process. Similarly, one must also be able to use various information and communication technologies in order to research problems and to develop and communicate possible solutions and to achieve goals. (xii) Source: Technology and Engineering Literacy Framework for the 2014 National Assessment of Educational Progress Pre-Publication Edition

Break down of NAEP Assessment Areas Technological and Engineering Literacy Technology and Society Interaction of Technology and Humans Effects of Technology on the Natural World Effects of Technology on the World of Information and Knowledge Ethics, Equity, and Responsibility Design and Systems Nature of Technology Engineering Design Systems Thinking Maintenance and Troubleshooting Information and Communication Technology Construction and Exchange of Ideas and Solutions Information Research Investigation of Problems Acknowledgement of Ideas and Information Selection and Use of Digital Tools

Same topic, different perspectives  Technology and Society  C) Effects of Technology on the World of Information and Knowledge (T.8.8)  Information and Communication Technology  A) Construction and Exchange of Ideas and Solutions (I.8.1)  One can look at through the perspective of Technology and Society, focusing on:  The impact had on the postal service, or by looking at  The ever increasing data storage that services provide now.  One can also look at through the perspective of Information and Communication Technology, focusing on:  The advantages and disadvantages of , and how to use it effectively.  The advantages and disadvantages of comparable tools (Wikis)

Practices and Contexts  Practices: The kinds of thinking and application that will be expected of students across the three major assessment areas.  Contexts: Situations and types of problems, in which assessment tasks and items will be set.

Page 89 from Technology and Engineering Literacy Assessment and Item Specifications for the 2014 National Assessment of Educational Progress Pre- Publication Edition Context Practice

The Three Practices  Understanding Technological Principles  Focuses on students’ knowledge and understanding of technology and their capability to think and reason with that knowledge. (3-5)  In short: Foundational knowledge for…  Developing Solutions and Achieving Goals  Students’ systematic application of technological knowledge, tools, and skills to address problems and achieve goals presented in societal, design, curriculum, and realistic context. (3-5)  In short: Applying the understood technological principles to solve problems.  Communicating and Collaborating  Centers on students’ capabilities to use contemporary technologies to communicate for a variety of purposes and in a variety of ways, working individually or in teams. (3-5)  In short: Communicating information and possible solutions to find and execute a solution to a problem. Source: Technology and Engineering Literacy Assessment and Item Specifications for the 2014 National Assessment of Educational Progress Pre- Publication Edition

Page 89 from Technology and Engineering Literacy Assessment and Item Specifications for the 2014 National Assessment of Educational Progress Pre- Publication Edition Context Practice Context Practice Context Practice

What to do with NAEP  Using NAEP’s assessment targets, we can assess the status of our current technology standards, and modify our rubric.  Professional development program  NAEP has already given its own samples of practices and contexts in Technology and Engineering Literacy Assessment and Item Specifications for the 2014 National Assessment of Educational Progress Pre-Publication Edition.  NJDOE’s Classroom Application Documents (CADs) are also available online  Using the two as reference, we will construct the professional development program.

Links  Framework Pre-Publication Edition  _naep_tel_framework.pdf?x-r=pcfile_d  Assessment and Item Specifications Pre-Publication Edition  %20NAEP%20TEL%20Specs.pdf?x-r=pcfile_d

QUESTIONS?