Presentation on theme: "Your Institutional Report 2014 – Step by Step"— Presentation transcript:
1 Your Institutional Report 2014 – Step by Step 9/6/2012Your Institutional Report 2014 – Step by StepWebinar will begin at 2 pm EST.Before we begin, please review the following:General advice:For best results, connect to this Webinar using a high- speed connection.Visit https://admin.acrobat.com/common/help/en/support/ meeting_test.htm for a comprehensive set of tests and troubleshooting solutions if you have issues with the Adobe Connect software.Have your Institutional Report 2014 binder on hand for reference or access your materials through the NSSE Institution Interface.Sound:Increase the volume on your computer speakers or plug in your headphones to listen to the Webinar.For best results, close ALL other applications as they can interfere with the audio feed.What to do if you don’t hear anything:If you cannot hear anything, click on “Meeting” at left of the grey tool bar at the top of the screen and select “Audio Setup Wizard.” Complete the first part of the Wizard, which ends with a speaker test, to ensure a proper Webinar audio connection. If you cannot hear anything after this, consult your technology support person.Using the Chat feature:The Chat window allows participants to interact with presenters and each other – ask questions of presenters and of other users!
2 Your Institutional Report 2012 - Step by Step 9/6/2012Your Institutional Report 2014 – Step by StepA NSSE Webinar Presented byJillian KinzieBob GonyeaAugust 27, 2014
3 Your Institutional Report 2012 - Step by Step 9/6/2012Webinar GoalsQUICK Overview of the updated surveyGuided tour of your NSSE Institutional Report 2014Review reportsInterpreting resultsHighlight user resourcesTips for generating discussion and action on your campusQ & A
5 An Updated NSSEHigher education is constantly changing, and it is important for NSSE to stay relevant to the most salient issues and priorities of institutional assessment and research.
6 Design Principles Build on NSSE’s strengths New content must… Focus on behavior & effective practiceActionable informationNew content must…Inform engagementBe based in the literatureBe thoroughly tested
7 Development Process Internal committee work started in 2009 Consultation with external advisorsFeedback from institutional usersExperimental item testing: 2006 to 2011Pilot testing: 2011 & 2012Extensive psychometric analysesFocus groups and cognitive interviews
8 What are your questions/comments? NSSE at 13!What We’ve Learned… connect engagement data to indicators of success; student behaviors; institutional improvement is possibleUpdating NSSE… same focus; new & refined measures; updated terminologyEmerging areas of interest – HIPs, quantitative reasoning, effective teaching, deep approaches, topical modulesWhat are your questions/comments?
10 Student EngagementStudent engagement is a domain of constructs representing two critical features of collegiate quality.The amount of time and effort students put into educationally purposeful activities, andHow the institution organizes the curriculum and other learning opportunities to get students to participate in such activities.
11 Engagement Indicators more specific & actionable! The Updated NSSEEngagement Indicators more specific & actionable!From Benchmarks to Engagement Indicators and High-Impact Practices
12 Your Institutional Report 2012 - Step by Step 9/6/2012The Updated NSSEEngagement Indicators more specific & actionable!From Benchmarks to Engagement Indicators and High-Impact Practices
13 Engagement Indicators more specific & actionable! The Updated NSSEEngagement Indicators more specific & actionable!From Benchmarks to Engagement Indicators and High-Impact Practices
16 Your NSSE binder experience… Your Institutional Report Step by Step9/6/2012Your NSSE binder experience…How many NSSE binders have you opened?This is my first!Only one otherAt least fiveA fair share (but I need a refresher)
17 Updated NSSE Institution Interface Remember, electronic reports and data are available online
19 Institutional Report Organization Your Institutional Report Step by Step9/6/2012Institutional Report OrganizationFour tabs, each begins with an Overview:Tab 1: NSSE – National Survey of Student EngagementTab 2: FSSE – Faculty Survey of Student EngagementTab 3: BCSSE – Beginning College Survey of Student EngagementTab 4: User Resources
20 College of Saint Benedict Exploring Tab 1College of Saint Benedict
21 Your Institutional Report 2012 - Step by Step 9/6/2012(in progress)SnapshotEngagement IndicatorsHigh-Impact PracticesFrequencies and Statistical ComparisonsTopical Module(s) and/or Consortium ReportsRespondent ProfileAdministration SummarySelected Comparison GroupsPocket Guide ReportMajor Field ReportStudent Comments
22 Your Institutional Report 2012 - Step by Step 9/6/2012SnapshotThe Snapshot is designed to be shared on campus4-pages, folded pamphlet style
23 Your Institutional Report 2012 - Step by Step 9/6/2012SnapshotSnapshot (p. 1)
24 Your Institutional Report 2012 - Step by Step 9/6/2012SnapshotSnapshot (p. 2)
25 Your Institutional Report 2012 - Step by Step 9/6/2012SnapshotSnapshot (p. 3)
26 Your Institutional Report 2012 - Step by Step 9/6/2012SnapshotSnapshot (p. 4)
27 Engagement Indicators Engagement Indicators are summary measures based on sets of NSSE questionsThe ten indicators are organized within four themes: Academic Challenge, Learning with Peers, Experiences with Faculty, and Campus Environment.Report contains: Overview (p. 3) Theme reports (pp. 4-13) Comparisons (p. 15) Detailed Statistics (pp )
28 Your Institutional Report 2012 - Step by Step 9/6/2012Engagement IndicatorsEngagement Indicators
29 Your Institutional Report 2012 - Step by Step 9/6/2012Engagement IndicatorsEngagement Indicators
30 Your Institutional Report 2012 - Step by Step 9/6/2012Engagement IndicatorsEngagement IndicatorsBox-and-whisker plots95th Percentile75th PercentileMedian (line)25th Percentile5th PercentileMean (dot)
31 Your Institutional Report 2012 - Step by Step 9/6/2012Engagement IndicatorsEngagement Indicators
32 Your Institutional Report 2012 - Step by Step 9/6/2012Engagement IndicatorsEngagement IndicatorsComparisons with High-Performing Institutions
33 Your Institutional Report 2012 - Step by Step 9/6/2012High-Impact PracticesHigh-Impact PracticesOverall HIP Participation
34 Your Institutional Report 2012 - Step by Step 9/6/2012High-Impact PracticesHigh-Impact PracticesStatistical Comparisons
35 Your Institutional Report 2012 - Step by Step 9/6/2012High-Impact PracticesHigh-Impact PracticesResponse Detail
36 Your Institutional Report 2012 - Step by Step 9/6/2012High-Impact PracticesHigh-Impact PracticesParticipation by Student Characteristics
37 Frequencies & Statistical Comparisons Your Institutional Report Step by Step9/6/2012Frequencies & Statistical ComparisonsDo you have specific questions about individual items?This report gives complete descriptives for all survey questions, count and weighted percentage of responses to all survey items for randomly selected studentsDetails on weighting can be found at
38 Your Institutional Report 2012 - Step by Step 9/6/2012Frequencies & Statistical ComparisonsFrequencies and Statistical Comparisons
39 Frequencies & Statistical Comparisons Your Institutional Report Step by Step9/6/2012Frequencies & Statistical ComparisonsStatistical ComparisonsProvide statistical significance and effect sizeEffect size: Are results different in a practical sense?
40 Additional Questions Topical Modules for 2014 Academic Advising Civic EngagementDevelopment of Transferable SkillsExperiences with Diverse PerspectivesLearning with TechnologyExperiences with WritingGlobal PerspectivesInformation Literacy
45 Your Institutional Report 2012 - Step by Step 9/6/2012Administration Details: Selected Comparison GroupsSelected Comparison Groups ReportTells how peer groups have been selectedconsortium participationcriteria selecteddefault groups, if no instructions givenLists schools included in each peer group
46 Your Institutional Report 2012 - Step by Step 9/6/2012Tab I: NSSEHow to make productive use all these reports and the data file!??!Take advantage of dichotomized response presentation in reportsPresent % “never” to sharpen focusSyntax & other analytical resources available:nsse.iub.edu/html/analysis_resources.cfm
47 Pocket Guide to Choosing a College Customizable template enables sharing with prospective students & families, admissions officers, and orientation staff
48 Your Institutional Report 2012 - Step by Step 9/6/2012Major Field ReportGet More Traction with your NSSE Results!!Engagement Indicators, HIPs, Frequencies & Statistical Comparisons for up to ten customizable categories of related majorsPart I: “within-institution” report presents results within related-major categories side by side for first-year students and seniorsPart II: “between-institution” report compares your respondents with those of your comparison groups for up to ten related-major categoriesFor more information: nsse.iub.edu/html/major_field_report.cfm
49 Questions About Reporting? Any challenges?What’s most useful?Your Questions/Concerns:Concerns about response ratesRelating NSSE 2014 results to past yearsAssessing engagement in multiple modalitiesBest practices in using NSSE data
50 Your Institutional Report 2012 - Step by Step 9/6/2012Additional ResourcesNSSE Data FileDownloadable from the Institution InterfaceIncludes all data collected for your institutionMerge data with other student records
51 Additional Resources Online Institutional Report Same reports, but easy access and sharing
52 Your Institutional Report 2012 - Step by Step 9/6/2012Additional ResourcesNSSE Report Builder– Institution VersionA secure, interactive database for participating institutions that instantly generates reports of your choosing using student and institutional characteristics(A public version is also available)
54 FSSE-NSSE Combined Report Presents faculty results side-by-side with student results allowing institutions to identify areas of correspondence as well as gapsItem FrequencyResponse percentages to each item broken down by the level of students taught by faculty respondents
55 Administration Details Additional QuestionsFSSE participants can customize their survey with Topical Modules and/or Consortium ParticipationAdministration DetailsAdministrative Summary and Respondent Profiles are included in reportsDisciplinary Area ReportLook within your data by customized disciplines
56 Ways Into NSSE – FSSE Data Review FSSE frequencies for items of interestHow do Lower Division vary from Upper Division?Review results for gaps and correspondence between student and faculty results – focus on items of interest to your faculty“Prompt feedback” – how wide is the gap?Rank FSSE “importance” items – are students doing the things faculty think are important?Involve faculty development, center for teaching and learning staff in interpreting results.Check out FSSE Webinars on FSSE website!
57 Your Institutional Report 2012 - Step by Step 9/6/2012Exploring Tab 3
58 Your Institutional Report 2012 - Step by Step 9/6/2012BCSSE/NSSE Combined ReportAdministration Details
59 BCSSE-NSSE Combined Report Part 1 uses crosstabs from all BCSSE 2013 and NSSE respondents to present side-by-side frequencies of items common to both instrumentsPart 2 uses matched data based on student ID to examine the relationship between BCSSE scales and NSSE Engagement Indicators
60 Exploring Tab 4California State University, Los Angeles
61 Overview of Activities of the NSSE Institute Outreach ServicesWebinarsNSSE Users Workshops – interest??ResourcesLessons from the FieldResearch InitiativesLearning to Improve: A Study of Evidence Based Improvement in Higher EducationEngaging Latino Student project
62 Your Institutional Report 2012 - Step by Step 9/6/2012Online ResourcesGuide to Online ResourcesProvides a snapshot & active web links to resources on NSSE Web site.Resources include:Accreditation ToolkitsProject DEEP PublicationsRelated publications, conference papers, and presentations
63 Access Toolkits on NSSE Web site – “Tools & Services” Online ResourcesAccreditation ToolkitsRegional & SpecializedNSSE Items mapped to standardsUpdated for 2014!Access Toolkits on NSSE Web site – “Tools & Services”
64 Your Institutional Report 2012 - Step by Step 9/6/2012Online Resources: Using Your DataExamples of how NSSE, BCSSE, and FSSE data have been used to guide educational policy and practice on campusesSnapshots of practical applications of resultsOnline database to search for examples of how institutions are using NSSE, BCSSE, and FSSE dataAccess from NSSE homepage
65 Making the Most of Data – Sharing Results and Taking Action Your Institutional Report Step by Step9/6/2012Making the Most of Data – Sharing Results and Taking ActionThink about potential audiences – find relevancyConsider various strategies for sharing results – deliver in small doses, add narrativeLink to other assessment data to tell a more comprehensive story.Teach small groups about the data, help them use it in program review, to assess the first year experience, to inform faculty development - and then share their use with others.Share lessons learned, and action taken with campus constituents – especially students.
66 Collective Wisdom from Users: Moving from Data to Action Source: Kinzie, J. & Pennipede, B. (2009). Converting engagement results into action. New Directions for Institutional Research
67 Institutional Example: Sharing Results Champlain College Report Create lists of Highs and Lows, in comparison to different groups
68 Institutional Example: Sharing Results Miami University Reports Created awareness via short, Assessment Briefs. Explored degree to which first-years & seniors engaged in “learning activities outside the classroom” (4 items).Campus desired to stand out on these dimensions – Departments identified good practice and increased opportunities for students.
69 Displaying Your Results “Guidelines for Display of NSSE Results on Institutional Web Sites” can help you determine how to display your resultsExamples of sites: nsse.iub.edu/links/website_displays
70 Beyond Your Reports…. Use your data file for additional analyses Combine with other institutional data, combine 2 years of results to study seniors by majorTake advantage of NSSE Advanced Webinars “Digging Deeper” Series (see Webinar Archives)Some possible analyses:Disaggregate by race-ethnicity, first-generation statusUse “evaluate entire experience” (ENTIREEXP) and “start over” (SAMECOLL) as outcomesAdd retention results to explore factors related to first-year student persistence
71 Ask us questions, let us know how things are going… For More Information... Jillian Kinzie ( ) Bob Gonyea ( )Ask us questions, let us know how things are going…Copies of papers and presentations as well as annual reports and other information are available through the Web site: nsse.iub.edu
72 Registration Open for NSSE 2015 Invitation for 2015Deadline to register: September 25, 2014Register online: nsse.iub.edu