Presentation on theme: "Your Institutional Report 2014 – Step by Step"— Presentation transcript:
1Your Institutional Report 2014 – Step by Step 9/6/2012Your Institutional Report 2014 – Step by StepWebinar will begin at 2 pm EST.Before we begin, please review the following:General advice:For best results, connect to this Webinar using a high- speed connection.Visit https://admin.acrobat.com/common/help/en/support/ meeting_test.htm for a comprehensive set of tests and troubleshooting solutions if you have issues with the Adobe Connect software.Have your Institutional Report 2014 binder on hand for reference or access your materials through the NSSE Institution Interface.Sound:Increase the volume on your computer speakers or plug in your headphones to listen to the Webinar.For best results, close ALL other applications as they can interfere with the audio feed.What to do if you don’t hear anything:If you cannot hear anything, click on “Meeting” at left of the grey tool bar at the top of the screen and select “Audio Setup Wizard.” Complete the first part of the Wizard, which ends with a speaker test, to ensure a proper Webinar audio connection. If you cannot hear anything after this, consult your technology support person.Using the Chat feature:The Chat window allows participants to interact with presenters and each other – ask questions of presenters and of other users!
3Your Institutional Report 2012 - Step by Step 9/6/2012Webinar GoalsQUICK Overview of the updated surveyGuided tour of your NSSE Institutional Report 2014Review reportsInterpreting resultsHighlight user resourcesTips for generating discussion and action on your campusQ & A
5An Updated NSSEHigher education is constantly changing, and it is important for NSSE to stay relevant to the most salient issues and priorities of institutional assessment and research.
6Design Principles Build on NSSE’s strengths New content must… Focus on behavior & effective practiceActionable informationNew content must…Inform engagementBe based in the literatureBe thoroughly tested
7Development Process Internal committee work started in 2009 Consultation with external advisorsFeedback from institutional usersExperimental item testing: 2006 to 2011Pilot testing: 2011 & 2012Extensive psychometric analysesFocus groups and cognitive interviews
8What are your questions/comments? NSSE at 13!What We’ve Learned… connect engagement data to indicators of success; student behaviors; institutional improvement is possibleUpdating NSSE… same focus; new & refined measures; updated terminologyEmerging areas of interest – HIPs, quantitative reasoning, effective teaching, deep approaches, topical modulesWhat are your questions/comments?
10Student EngagementStudent engagement is a domain of constructs representing two critical features of collegiate quality.The amount of time and effort students put into educationally purposeful activities, andHow the institution organizes the curriculum and other learning opportunities to get students to participate in such activities.
11Engagement Indicators more specific & actionable! The Updated NSSEEngagement Indicators more specific & actionable!From Benchmarks to Engagement Indicators and High-Impact Practices
12Your Institutional Report 2012 - Step by Step 9/6/2012The Updated NSSEEngagement Indicators more specific & actionable!From Benchmarks to Engagement Indicators and High-Impact Practices
13Engagement Indicators more specific & actionable! The Updated NSSEEngagement Indicators more specific & actionable!From Benchmarks to Engagement Indicators and High-Impact Practices
16Your NSSE binder experience… Your Institutional Report Step by Step9/6/2012Your NSSE binder experience…How many NSSE binders have you opened?This is my first!Only one otherAt least fiveA fair share (but I need a refresher)
17Updated NSSE Institution Interface Remember, electronic reports and data are available online
19Institutional Report Organization Your Institutional Report Step by Step9/6/2012Institutional Report OrganizationFour tabs, each begins with an Overview:Tab 1: NSSE – National Survey of Student EngagementTab 2: FSSE – Faculty Survey of Student EngagementTab 3: BCSSE – Beginning College Survey of Student EngagementTab 4: User Resources
20College of Saint Benedict Exploring Tab 1College of Saint Benedict
21Your Institutional Report 2012 - Step by Step 9/6/2012(in progress)SnapshotEngagement IndicatorsHigh-Impact PracticesFrequencies and Statistical ComparisonsTopical Module(s) and/or Consortium ReportsRespondent ProfileAdministration SummarySelected Comparison GroupsPocket Guide ReportMajor Field ReportStudent Comments
22Your Institutional Report 2012 - Step by Step 9/6/2012SnapshotThe Snapshot is designed to be shared on campus4-pages, folded pamphlet style
27Engagement Indicators Engagement Indicators are summary measures based on sets of NSSE questionsThe ten indicators are organized within four themes: Academic Challenge, Learning with Peers, Experiences with Faculty, and Campus Environment.Report contains: Overview (p. 3) Theme reports (pp. 4-13) Comparisons (p. 15) Detailed Statistics (pp )
36Your Institutional Report 2012 - Step by Step 9/6/2012High-Impact PracticesHigh-Impact PracticesParticipation by Student Characteristics
37Frequencies & Statistical Comparisons Your Institutional Report Step by Step9/6/2012Frequencies & Statistical ComparisonsDo you have specific questions about individual items?This report gives complete descriptives for all survey questions, count and weighted percentage of responses to all survey items for randomly selected studentsDetails on weighting can be found at
38Your Institutional Report 2012 - Step by Step 9/6/2012Frequencies & Statistical ComparisonsFrequencies and Statistical Comparisons
39Frequencies & Statistical Comparisons Your Institutional Report Step by Step9/6/2012Frequencies & Statistical ComparisonsStatistical ComparisonsProvide statistical significance and effect sizeEffect size: Are results different in a practical sense?
40Additional Questions Topical Modules for 2014 Academic Advising Civic EngagementDevelopment of Transferable SkillsExperiences with Diverse PerspectivesLearning with TechnologyExperiences with WritingGlobal PerspectivesInformation Literacy
45Your Institutional Report 2012 - Step by Step 9/6/2012Administration Details: Selected Comparison GroupsSelected Comparison Groups ReportTells how peer groups have been selectedconsortium participationcriteria selecteddefault groups, if no instructions givenLists schools included in each peer group
46Your Institutional Report 2012 - Step by Step 9/6/2012Tab I: NSSEHow to make productive use all these reports and the data file!??!Take advantage of dichotomized response presentation in reportsPresent % “never” to sharpen focusSyntax & other analytical resources available:nsse.iub.edu/html/analysis_resources.cfm
47Pocket Guide to Choosing a College Customizable template enables sharing with prospective students & families, admissions officers, and orientation staff
48Your Institutional Report 2012 - Step by Step 9/6/2012Major Field ReportGet More Traction with your NSSE Results!!Engagement Indicators, HIPs, Frequencies & Statistical Comparisons for up to ten customizable categories of related majorsPart I: “within-institution” report presents results within related-major categories side by side for first-year students and seniorsPart II: “between-institution” report compares your respondents with those of your comparison groups for up to ten related-major categoriesFor more information: nsse.iub.edu/html/major_field_report.cfm
49Questions About Reporting? Any challenges?What’s most useful?Your Questions/Concerns:Concerns about response ratesRelating NSSE 2014 results to past yearsAssessing engagement in multiple modalitiesBest practices in using NSSE data
50Your Institutional Report 2012 - Step by Step 9/6/2012Additional ResourcesNSSE Data FileDownloadable from the Institution InterfaceIncludes all data collected for your institutionMerge data with other student records
51Additional Resources Online Institutional Report Same reports, but easy access and sharing
52Your Institutional Report 2012 - Step by Step 9/6/2012Additional ResourcesNSSE Report Builder– Institution VersionA secure, interactive database for participating institutions that instantly generates reports of your choosing using student and institutional characteristics(A public version is also available)
54FSSE-NSSE Combined Report Presents faculty results side-by-side with student results allowing institutions to identify areas of correspondence as well as gapsItem FrequencyResponse percentages to each item broken down by the level of students taught by faculty respondents
55Administration Details Additional QuestionsFSSE participants can customize their survey with Topical Modules and/or Consortium ParticipationAdministration DetailsAdministrative Summary and Respondent Profiles are included in reportsDisciplinary Area ReportLook within your data by customized disciplines
56Ways Into NSSE – FSSE Data Review FSSE frequencies for items of interestHow do Lower Division vary from Upper Division?Review results for gaps and correspondence between student and faculty results – focus on items of interest to your faculty“Prompt feedback” – how wide is the gap?Rank FSSE “importance” items – are students doing the things faculty think are important?Involve faculty development, center for teaching and learning staff in interpreting results.Check out FSSE Webinars on FSSE website!
59BCSSE-NSSE Combined Report Part 1 uses crosstabs from all BCSSE 2013 and NSSE respondents to present side-by-side frequencies of items common to both instrumentsPart 2 uses matched data based on student ID to examine the relationship between BCSSE scales and NSSE Engagement Indicators
60Exploring Tab 4California State University, Los Angeles
61Overview of Activities of the NSSE Institute Outreach ServicesWebinarsNSSE Users Workshops – interest??ResourcesLessons from the FieldResearch InitiativesLearning to Improve: A Study of Evidence Based Improvement in Higher EducationEngaging Latino Student project
62Your Institutional Report 2012 - Step by Step 9/6/2012Online ResourcesGuide to Online ResourcesProvides a snapshot & active web links to resources on NSSE Web site.Resources include:Accreditation ToolkitsProject DEEP PublicationsRelated publications, conference papers, and presentations
63Access Toolkits on NSSE Web site – “Tools & Services” Online ResourcesAccreditation ToolkitsRegional & SpecializedNSSE Items mapped to standardsUpdated for 2014!Access Toolkits on NSSE Web site – “Tools & Services”
64Your Institutional Report 2012 - Step by Step 9/6/2012Online Resources: Using Your DataExamples of how NSSE, BCSSE, and FSSE data have been used to guide educational policy and practice on campusesSnapshots of practical applications of resultsOnline database to search for examples of how institutions are using NSSE, BCSSE, and FSSE dataAccess from NSSE homepage
65Making the Most of Data – Sharing Results and Taking Action Your Institutional Report Step by Step9/6/2012Making the Most of Data – Sharing Results and Taking ActionThink about potential audiences – find relevancyConsider various strategies for sharing results – deliver in small doses, add narrativeLink to other assessment data to tell a more comprehensive story.Teach small groups about the data, help them use it in program review, to assess the first year experience, to inform faculty development - and then share their use with others.Share lessons learned, and action taken with campus constituents – especially students.
66Collective Wisdom from Users: Moving from Data to Action Source: Kinzie, J. & Pennipede, B. (2009). Converting engagement results into action. New Directions for Institutional Research
67Institutional Example: Sharing Results Champlain College Report Create lists of Highs and Lows, in comparison to different groups
68Institutional Example: Sharing Results Miami University Reports Created awareness via short, Assessment Briefs. Explored degree to which first-years & seniors engaged in “learning activities outside the classroom” (4 items).Campus desired to stand out on these dimensions – Departments identified good practice and increased opportunities for students.
69Displaying Your Results “Guidelines for Display of NSSE Results on Institutional Web Sites” can help you determine how to display your resultsExamples of sites: nsse.iub.edu/links/website_displays
70Beyond Your Reports…. Use your data file for additional analyses Combine with other institutional data, combine 2 years of results to study seniors by majorTake advantage of NSSE Advanced Webinars “Digging Deeper” Series (see Webinar Archives)Some possible analyses:Disaggregate by race-ethnicity, first-generation statusUse “evaluate entire experience” (ENTIREEXP) and “start over” (SAMECOLL) as outcomesAdd retention results to explore factors related to first-year student persistence
71Ask us questions, let us know how things are going… For More Information... Jillian Kinzie ( ) Bob Gonyea ( )Ask us questions, let us know how things are going…Copies of papers and presentations as well as annual reports and other information are available through the Web site: nsse.iub.edu
72Registration Open for NSSE 2015 Invitation for 2015Deadline to register: September 25, 2014Register online: nsse.iub.edu