1. Trevecca Nazarene University 2011-12

2.  Why have a General Education curriculum?  How is General Education assessed?  What were the results of last year’s assessment?

4.  General Education Curriculum ◦ Develop skills for life-long learning

5.  General Education Curriculum ◦ Develop skills for life-long learning ◦ Expand the learner’s worldview

6.  General Education Curriculum ◦ Develop skills for life-long learning ◦ Expand the learner’s worldview ◦ Locate the Major within human knowledge Major/Minor General Education Body of Knowledge

7. Institutional Educational Goals General Education Outcomes Institutional Educational Goals 1. Leadership, Service 2. Disciplined reflection 3. Factors shaping civilization 4. Appreciates global diversity 5. Write, speak, use technology 6. Think critically 7. Engenders wholeness 8. Productive influence General Education Outcomes 1. speak, write 2. Holy Bible 3. Wesleyan-Holiness tradition 4. Systematic problem-solver 5. Global civilization 6. Modes of thinking 7. Christian faith and knowledge 8. Cultural diversity 9. Stewards of resources

8.  Outcomes Assessment Cycle

9.  Third-party standardized test ◦ Norm-referenced: 32 doctoral/research universities ◦ Criterion-referenced: skills, content  Multiple and varied approaches ◦ Self-generated content questions ◦ Self-generated survey questions ◦ Samples of student work

10.  ETS-Proficiency Profile ◦ Measures 4 skills:  Critical Thinking  Reading  Writing  Mathematics ◦ In 3 contexts:  Humanities  Social Science  Natural Science Humanities Social Science Natural Science

11.  Norm-referenced: all grades; 365 institutions of all types ◦ TNU Total Score: 66 th percentile (n=148)

12.  Norm-referenced: Seniors; 32 doctoral/research univ. ◦ TNU Total Score: 42 nd percentile (n=148)

13. Met or exceeded the criterion for 5 of 9 assessment measures Complete report: http://gened.wiki.trevecca.edu

14.  3: …articulate parameters of the Wesleyan- Holiness tradition, doctrinal and moral convictions of the Church of the Nazarene and the connection with intellectual, emotional, spiritual, and physical life individually and collectively. ◦ Goal: correctly answer 70% of 5 questions ◦ Actual mean: 65%

15.  6: …demonstrate an understanding and practice of various intellectual modes of thinking. ◦ Goal: on PP Critical Thinking, 50% will score “marginally proficient” or “proficient” ◦ Actual: 32% (9% proficient, 23% marginally proficient) ◦ Affinity group: 32% (11% proficient, 21% marginally proficient)

16.  7: …value the general education curriculum of their degree program.  Two questions were asked ◦ #12 Trevecca’s General Education program enriched my understanding of my academic major. ◦ #13 Trevecca’s Christian emphasis enriched my understanding of my academic major. ◦ Goal: 80% will agree/strongly agree to each question ◦ Actual: #12, 54%; #13, 58%

17.  7: …value the general education curriculum of their degree program.  One question was asked ◦ #14 Trevecca’s General Education program prepared me for Christian leadership and service in a global community. ◦ Goal: 80% will agree/strongly agree ◦ Actual: #14, 54%

19. Criterion measures

20.  Norm-referenced: 32 doctoral/research universities ◦ Critical Thinking: 70 th (95% c.i.: 44-84) ◦ Reading: 37 th (95% c.i.: 28-58) ◦ Writing: 26 th (95% c.i.: 16-42) ◦ Mathematics: 33 rd (95% c.i.: 28-49)

21.  Norm-referenced: 32 doctoral/research universities ◦ Humanities: 44 th (95% c.i.: 30-72) ◦ Social Sciences: 53 rd (95% c.i.: 30-77) ◦ Natural Sciences: 44 th (95% c.i.: 26-60)

22.  Criterion –referenced classifications SkillClassification ProficientMarginalNot Proficient Reading 174%14%12% Reading 248%16%36% Critical Thinking9%23%68% Writing 165%25%10% Writing 228%34%38% Writing 313%27%60% Math 163%22%16% Math 232%31%37% Math 311%15%74%

23.  Criterion –referenced classifications SkillClassification ProficientMarginalNot Proficient Reading 174%71%14%17%12%13% Reading 248%43%16%18%36%38% Critical Thinking9%10%23%20%68%70% Writing 165%67%25%24%10% Writing 228%24%34%36%38%40% Writing 313%10%27%28%60%61% Math 163%61%22%21%16%19% Math 232%36%31%24%37%40% Math 311%12%15%19%74%68%

24. Composite Report September 2009 – February 2012 Trevecca Nazarene University (n = 365)

25. Skill Area/Proficiency LevelInstitution mean – National mean Reading I 3.98 Reading II 1.14 Critical Thinking 1.8 Writing I 3.09 Writing II 4.9 Writing III 3.23 Mathematics I 2.4 Mathematics II 0.06 Mathematics III 0.9 Composite 2.27

26. Item= Institution mean – National Discern facts from a passage4.26 Meaning in context3.85

27. Item= Institution mean – National Discern main idea 1.35 Discern primary purpose-0.43 Discern purpose of a reference 2.95 Recognize a valid inference 1.82 Synthesize material-0.25

28. Item= Institution mean – National Determine relevance of information 1.6 Evaluate an argument 4.0 Evaluate data for consistency 6.4 Evaluate explanations10.5 Evaluate hypotheses-4.5 Extrapolate from known facts 2.9 Recognize an assumption 2.82 Recognize flaws in argument 3.95 Recognize salient features-3.3

29. Item= Institution mean – National Incorrect word choice 7.5 Order sentences 4.5 Recognize agreement 1.8 Recognize appropriate transitions 4.4 Recognize incorrect punctuation-0.3

30. Item= Institution mean – National Combine simple clauses 2.0 Incorporate new material in paragraph 7.7 Recast an existing sentence 4.3 Recognize agreement 6.45

31. Item= Institution mean – National Recognize correct construction 3.8 Recognize incorrect construction-2.0 Recognize most effective revision 4.6

32. Item= Institution mean – National Algebraic expression-3.0 Arithmetic word problem 3.1 Arithmetic word problem - profit-3.3 Arithmetic word problem - rates 5.6 Arithmetic word problem - work units 3.7 Data interpretation - compare two charts 0.9 Data interpretation - percents 2.2 Data interpretation - range 3.3 Geometric word problem - lengths 7.0

33. Item= Institution mean – Ntl Arithmetic word problem - complex wording 2.8 Arithmetic word problem - embedded ratios-6.3 Arithmetic word problem - ratios, approximation 1.2 Arithmetic word problem - weighted mean 4.9 Draw conclusion from algebraic expression 3.0 Measurement conversion-6.8 Simplify algebraic expression 0.3 Translation to algebraic expression-4.6 Translation to algebraic expression 6.0

34. Item= Institution mean – National Data interpretation - percent change-1.1 Data interpretation - percent increase-1.5 Data interpretation - rate of change-0.9 Exponential growth 7.6 Percent change - ratio and proportion-1.7 Percent decrease 2.7 Solution is algebraic expression-1.2 Understanding of properties of integers 1.8 Word problem - algebraic expression 2.4

35.  We don’t live in Lake Wobegon, MN where ◦ the women are strong, ◦ the men are good looking, ◦ and, ALL the children are above average.

36. Discussion