An evidence-based approach to the design of a learning program: evaluating preliminary data sets

Andrea Rose Carr

Abstract


The Global Perspectives (GP) program is an evidence-based curriculum initiative that integrates the process of designing and implementing a learning program with a process for developing and implementing a plan to evaluate it for effectiveness and impact. The GP program educational evaluation and research (EER) plan was based on the framework for evaluating e-learning proposed by Phillips, McNaught, and Kennedy (2012), which includes the LEPO framework for learning. The focus is to evaluate learning design for ‘fit’ with achieving the learning objectives and, for the mature GP program design, research the effectiveness and impact of the GP program on students. This paper presents the method and results of a core activity of the EER plan: review data collected during Phases 1 and 2 (pilot and implementation) where the GP program was embedded into two first-year units in the Faculty of Health Science. We describe the method and discuss the results of our analysis in terms of a protocol for a systematic analysis of each data set in terms of ability to inform learning design, the impact and effectiveness of the GP program and usefulness of data in terms of contributing to the development of a diagnostic tool to measure cultural competence.

Keywords


Educational evaluation and research; cultural competence; graduate attribute

Full Text:

PDF

References


Anderson, L. & Krathwohl, D. A. (2001). Taxonomy for learning, teaching and assessing: A revision of Bloom's Taxonomy of Educational Objectives. New York: Longman.

Biggs, J. & Tang, C. (2007). Teaching for quality learning at university. Third edition. Berkshire, England: Open University Press.

Bloom, B.S., Engelhart, M. D., Furst, E. J., Hill, W. H., & Krathwohl, D. R. (1956). Taxonomy of educational objectives: The classification of educational goals; Handbook I: Cognitive Domain New York: Longman.

Crowne, D. P. & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24, 349-354.

Deardorff, D. (2009). The Sage handbook of intercultural competence. Thousand Oaks CA: Sage Publications

Janda, L. H. (1998). Psychological testing: Theory and applications. Massachusetts: Allyn & Bacon.

Kaplan, R. M. & Saccuzo, D. P. (2009). Psychological testing: Principles, applications, and issues. Seventh edition. Belmont CA: Wadsworth, Cengage Learning.

Author. (year) Designing evaluation and research into educational initiatives: The Global Perspectives Program. Ascilite 2012. Wellington, NZ.

Krentzman, A. R. & Townsend, A. L. (2008). Review of multidisciplinary measures of cultural competence for use in social work education. Journal of Social Work Education, 44, 7-31.

Phillips, R., McNaught, G., & Kennedy,C. (2012). Evaluating e-learning: guiding research and practice. New York: Routledge.

Ruhe, V. & Boudreau, J. D. (2011). The 2011 program evaluation standards: A framework for quality in medical education programme evaluations. Journal of Evaluation in Clinical Practice, 23, 187-200.

Sanders, J. R. & Nafziger, D. N. (2011[1976]). A basis for determining the adequacy of evaluation designs. Journal of Multidisciplinary Evaluation, 7, 44-78.

Author. (Year). Making nursing education culturally competent: moving beyond the deficit model. International Conference on Critical Discourse Analysis: Theory into Research, 669-676.

Student Evaluation, Review and Reporting Unit. Website available: http://www.utas.edu.au/student-evaluation-review-and-reporting-unit/our-serru-team Accessed 16th November 2012.

Tertiary Education Quality and Standards Agency. Website available: http://www.teqsa.gov.au Accessed 16 November 2012.


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493