1. Test Validity & Spirituality Steve Pawluk AACU Constituency Meeting May 17, 2004

2. Steve Pawluk, May 2004 Watches and Yardsticks ReliabilityValidity

3. Steve Pawluk, May 2004 Validity Does a test actually measure what it purports to measure? Are the interpretations of test results adequate and appropriate for our use? –Robert L. Linn & Norman E. Gronlund. (1995). Measurement and Assessment in Teaching.

4. Steve Pawluk, May 2004 3 Ways of Thinking About Validity Content Validity Criterion-Related Validity Construct Validity

5. Steve Pawluk, May 2004 Content Validity Linn & Gronlund: Determine the extent to which a set of assessment tasks provides a relevant and representative sample. Jesus: “Love the Lord... Love your neighbor... All the Law and the Prophets hang on these two commandments.” - Matt 22:37-40 “... All men will know you are my disciples, if you love one another.” - Jn 13:35

6. Steve Pawluk, May 2004 Content Validity Linn & Gronlund: Not all items actually measure what they appear to measure. Jesus: “Everything they do is done for men to see: They make their phylacteries wide... You... look beautiful on the outside... - Matt 23:5 & 27

7. Steve Pawluk, May 2004 Criterion-Related Validity Linn & Gronlund: Determine the extent to which test performance is related to some other valued measure of performance. “He has showed you, O man, what is good. And what does the Lord require of you? –Act justly –Love mercy –Walk humbly with your God - Micah 6:8

8. Steve Pawluk, May 2004 Criterion-Related Validity Linn & Gronlund: Determine the extent to which test performance is related to some other valued measure of performance. “Now the Bereans were of more noble character,... for they received the message... and examined the Scriptures... to see if what Paul said was true.” - Acts 17:11

9. Steve Pawluk, May 2004 Construct Validity Linn & Gronlund: “A construct is an individual characteristic that we assume exists in order to explain some aspect of behavior.” Jesus: “I am the vine; you are the branches. If a man remains in me and I in him, he will bear much fruit;... - Jn 15:5

10. Steve Pawluk, May 2004 Constructs are Complex Animal lover Spiritual person

11. Steve Pawluk, May 2004 Salvation is Simple, but Defining Spirituality May Be More Complex “Master,” said John, ‘we saw a man driving out demons in your name and we tried to stop him, because he is not one of us.” (RSV) “... because he does not follow with us.” (NIV) “Do not stop him,” Jesus said, “for whoever is not against you is for you.” ~ Luke 9:49, 50 (NIV) ~ Luke 9:49, 50 (NIV)

12. Steve Pawluk, May 2004 Postulate: Spirituality on our Campuses Content Validity Based on “confession of belief.” Evidenced by “others- focused” behavior. Absence of “phylacteriology.”

13. Steve Pawluk, May 2004 Postulate: Spirituality on our Campuses Criterion-Related Validity Spirituality is highly correlated with other Biblical indicators of character measurement: –Acts of Justice –Love of Mercy –Life of Humility –Open Inquiry

14. Steve Pawluk, May 2004 Postulate: Spirituality on our Campuses Construct Validity Based on observable, measurable, indicators that have consistently been associated with spirituality and that are consistently absent from non-spirituality.

15. Steve Pawluk, May 2004 Postulate: Spirituality on our Campuses But the fruit of the Spirit is: –Love –Joy –Peace –Patience –Kindness –Goodness –Faithfulness –Gentleness –Self-control Gal 5:22

16. Steve Pawluk, May 2004 Postulate: Spirituality on our Campuses The Spirit of the Lord is on me, because he has anointed me to: –Preach good news to the poor –Proclaim freedom for the prisoners –Recovery of sight for the blind –Release the oppressed –Proclaim the year of the Lord’s favor - Luke 4:18 & 19

17. Steve Pawluk, May 2004 Summary: Spirituality on our Campuses Assessment of the validity of spirituality might be based on these three general Biblical factors: 1. Are we and our students expressing an interest in enhancing our relationships with Jesus Christ? 2. Are we and our students demonstrating honest and open inquiry as we seek to understand and apply justice, mercy, & humility in “others-oriented” lives? 3. Are we and our students giving clear evidence of the fruit of the Spirit in our lives?

18. Steve Pawluk, May 2004 Spirituality on our Campuses Proposal: A valid working definition of observable spirituality: Grace-motivated, others-oriented, living