Handbook on Measurement, Assessment, and Evaluation in Higher Education/

Section 1 Assessment and Evaluation in Higher Education

Introduction to Section 1, Charles Secolsky and D. Brian Denison

1. Assessing the Quality of a University—Particularly its Teaching, Robert E. Stake, Gloria Contreras, and Isabel Arbesú

2. Classroom-Level Assessment: Aligning Pedagogical Practices to Enhance Student Learning, Kathryne Drezek McConnell and Peter E. Doolittle

3. Student Learning Outcomes Assessment at the Program and Institutional Levels, Thomas Judd and Bruce Keith

4. The Bottom Line: Will Faculty USE Assessment Findings?, Trudy W. Banta and Gary R. Pike

5. The Perennial Challenges of Accountability, James C. Palmer

6. Using National, State, and Local Data for Administrative Decision-Making, Sathasivam ‘Kris’ Krishnan, Chengbo Yin, William Mahler, Albertha Lawson, Michael Harris, and Karen Ruedinger

7. Empowerment Evaluation and Accreditation Case Examples: California Institute of Integral Studies and Stanford University, David Fetterman

8. Benchmarking in Higher Education, Jeffrey Seybert, Ellen Weed, and Trudy Bers

Questions and Exercises for Section 1

Section 2 Theories and Technical Aspects of Educational Measurement

Introduction to Section 2, Charles Secolsky and D. Brian Denison

9. Classical Test Theory and Higher Education: Five Questions, Elizabeth Schaughency, Jeffrey Smith, Jacques van der Meer, and David Berg

10. Generalizability Theory in Assessment Contexts, Noreen M. Webb, Richard Shavelson, and Jeffrey Steedle

11. Item Response Theory in Measurement, Assessment, And Evaluation for Higher Education, Steven J. Osterlind and Ze Wang

12. Scaling, Norming, and Equating, Michael J. Kolen and Amy B. Hendrickson

13. Reliability, Bruce Thompson and Tammi Vacha-Haase

14. The Validation of Tests in Higher Education, Kurt Geisinger, Leslie H. Shaw, and Carina McCormick

15. Statistical Modeling in Measurement, Assessment, and Evaluation for Higher Education, Steven J. Osterlind and Ze Wang

16. Issues in the Analysis of Change, D. Betsy McCoach, Karen Rambo, and Megan Welsh

Questions and Exercises for Section 2

Section 3 Test Construction and Development

Introduction to Section 3, Louise Yarnall

17. Building Content and Statistical Test Specifications, Tawnya Knupp and Deborah Harris

18. Evidence-Centered Design in Assessment Development, Geneva Haertel, Ellen Wentland, Louise Yarnall, and Robert J. Mislevy

19. The Assessment of 21st-Century Skills in Community College Career and Technician Education Programs, Louise Yarnall and Jane Ostrander

20. Item Analysis Procedures for Classroom Assessments in Higher Education, Jerome C. Clauser and Ronald K. Hambleton

21. Using Content Specialists for Detecting Item and Test Unfairness, Sydell Carlton

22. Computer-Based Testing in Higher Education, Robert Dolan and Kelly Burling

Questions and Exercises for Section 3

Section 4 Testing and Assessment for Decision-Making

Introduction to Section 4, Charles Secolsky and D. Brian Denison

23. Setting and Validating Cut Scores for Tests, Mary J. Pitoniak and Deanna L. Morgan

24. College Placement Testing of Entering Students, Deanna L. Morgan

25. Admissions Testing in Higher Education, Rebecca Zwick

26. Postsecondary Writing Assessment, Peggy O’Neill and Sandra Murphy

27. Authentic Assessment Validation: A Heuristic Rubrics Cube, Jion Liou Yen and Kevin Hynes

28. Cognitive Diagnostic Method: Rule Space, Q-Matrix Theory and Applications, Kikumi Tatsuoka, Anthony E. Kelly, Curtis Tatsuoka, and Michael Dean

Questions and Excercises for Section 4

Section 5 Approaches to Evaluation in Higher Education

Introduction to Section 5, Thomas E. Grayson

29. Program Evaluation in Higher Education, Thomas E. Grayson

30. Qualitative Evaluation, Christopher Pondish

31. Naturalistic Evaluation, David A. Erlandson

32. Responsive Evaluation, Kelly Godfrey and Doreen B. Finkelstein

33. Case Studies and Validity, Edith Cisneros-Cohernour

34. Mixed Methods Specialists in Action: Linking Mixed Methods Research to Learning and Classroom Assessment, Delwyn Harnisch, John Creswell, and Timothy Guetterman

35. Survey Use in Academic Contexts: Considerations and Guidelines, Ellen Wentland

Questions and Exercises for Section 5

Section 6 Issues in Assessment and Evaluation in Higher Education

Introduction to Section 6, April L. Zenisky

36. Using Data to Find Common Ground Between Secondary and Postsecondary Accommodations for Students with Disabilities, Manju Banerjee and Martha L. Thurlow

37. Testing and Evaluation of English-Language Learners in Higher Education, Young Yee Kim, James Hart, Jamal Abedi, and Alan Vanneman

38. Evaluation of Teacher Quality, Stephanie L. Knight

39. Reporting Assessment Results in Higher Education, April L. Zenisky and Jerold S. Laguilles

40. Presenting Learning Outcomes Assessment Results to Foster Use, Staci J. Provezis and Natasha A. Jankowski

41. Revisiting Reliability and Validity in Higher Education Research and Program Evaluation, Margaret D. LeCompte and Dorothy Aguilera-Black Bear

42. Ethical Assessment and Institutional Advancement: Connecting Good Practice with the Need to Move Campuses Forward, Ashley Finley

Questions and Exercises for Section 6

Concluding Remarks, Charles Secolsky and D. Brian Denison