Constructing a Teaching-Ability Evaluation System for Chinese Student Teachers using Delphi and Analytical Hierarchical Process Methods

Liyuan Chen, Qian Liu

Abstract


With the deepening of teacher educational reforms, increasing focus has been placed on the importance of evaluating student teachers’ teaching abilities in Chinese universities. The Delphi method and an Analytic Hierarchical Process were used to construct an evaluation system for student teachers’ teaching abilities. Delphi specialists included administrators, teachers and teacher educators working in primary, secondary and tertiary education. The evaluation items consisted of four dimensions, namely teacher ethics, teaching skills, educational ability, and developmental ability and a total of 31 indicators. Teaching skills were ranked highest, followed by teacher ethics, educational ability and developmental ability. The overall mean of the dimensions and components was rated as very important to important after three rounds of the Delphi process. Overall, the evaluation system demonstrated high reliability and validity; its’ entries were reasonably distributed indicating its evaluation potential and its’ weighting system denotes priorities for student teachers’ competencies’ evaluation.The evaluation system could help teachers identify key capacities in teacher training ,guide the development of talent nurturing programs, and provide developmental feedback for student teachers.

https://doi.org/10.26803/ijlter.22.11.9


Keywords


Delphi method; Analytic Hierarchy Process; teacher training students; teaching ability

Full Text:

PDF

References


Blömeke, S., Gustafsson, J.-E., & Shavelson, R. (2015). Beyond Dichotomies Competence Viewed as a Continuum. Zeitschrift für Psychologie, 223, 3-13. https://doi.org/10.1027/2151-2604/a000194

Boz, Y., & Cetin-Dindar, A. (2021). Teaching concerns, self-efficacy beliefs and constructivist learning environment of pre-service science teachers: a modelling study. European Journal of Teacher Education, 46, 1-19. https://doi.org/10.1080/02619768.2021.1919079

Buller, A. (2016). Exploring the Experiences of Award Winning Teachers in Counselor Education: A Qualitative Inquiry. Online Journal of Counseling & Education, 5(1). https://tinyurl.com/yncwh6zd

Chen, W., & Rovegno, I. (2000). Examination of expert and novice teachers' constructivist-oriented teaching practices using a movement approach to elementary physical education. Research Quarterly for Exercise and Sport, 71(4), 357-372. https://doi.org/10.3969/j.issn.2096-7853.2020.12.043

Dervenis, C., Fitsilis, P., & Iatrellis, O. (2022). A review of research on teacher competencies in higher education. Quality assurance in education, 30(2), 199-220. https://doi.org/10.1108/QAE-08-2021-0126

Gilis, A., Clement, M., Laga, L., & Pauwels, P. (2008). Establishing a competence profile for the role of student-centred teachers in higher education in Belgium. Research in higher education, 49, 531-554. https://doi.org/1029-1037.10.1044/1092-4388(2003/082)

Gillespie, K. H. (2010). A guide to faculty development (Second edition. ed.). Jossey-Bass.

Gopal, A. (2011). Internationalization of higher education: Preparing faculty to teach cross-culturally. International Journal of Teaching and Learning in Higher Education, 23(3), 373-381.http://www.isetl.org/ijtlhe/

Iqbal, A., Hussain, S., Parveen, S., & Javaid, Z. (2019). Effect of teachers’ competencies on scholars’ academic achievement and satisfaction. European Online Journal of Natural and Social Sciences, 8(1), pp. 9-16. https://european-science.com/eojnss/article/view/5484

Korthagen, F. A. J. (2001). Waar doen we het voor? Op zoek naar de essentie van goed leraarschap. IVLOS, Universiteit Utrecht, WCC.

Long, C. S., Ibrahim, Z., & Kowang, T. O. (2014). An Analysis on the Relationship between Lecturers' Competencies and Students' Satisfaction. International Education Studies, 7(1), 37-46. https://doi.org/37-46.10.5539/ies.v7n1p37

Lowyck, J. (1994). Teaching effectiveness: An overview of studies. Tijdschrift voor Onderwijsresearch. https://tinyurl.com/3f2szdxp

McQuiggan, C. A. (2012). Faculty development for online teaching as a catalyst for change. Journal of Asynchronous Learning Networks, 16(2), 27-61. https://files.eric.ed.gov/fulltext/EJ971044.pdf

Meng, L., Muñoz, M. A., & Wu, D. (2016). Teachers’ perceptions of effective teaching: a theory-based exploratory study of teachers from China. Educational Psychology, 36(3), 461-480. https://doi.org/10.1080/01443410.2015.1008402

Metzler, J., & Woessmann, L. (2012). The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation. Journal of development economics, 99(2), 486-496. https://doi.org/10.1016/j.jdeveco.2012.06.002

Mundial, G. B., & UNICEF. (2016). Education 2030: Incheon declaration and framework for action: towards inclusive and equitable quality education and lifelong learning for all. http://hdl.handle.net/11162/118764

Murry Jr, J. W., & Hammons, J. O. (1995). Delphi: A versatile methodology for conducting qualitative research. The review of higher education, 18(423-436). htpps://doi.org/423-436.10.1353/rhe.1995.0008

Peng, Y., & Liao, J. (2018). The structure and index system of educational practice ability of normal college students in the context of professional accreditation. 3, 72-79. https://doi.org/CNKI:SUN:GZJY.0.2018-03-015

Qin Z, & Chen L. (2021). Construction of the Evaluation of Normal University Students’ Educational Practice Ability. Journal of Mudanjiang University 7, 102-107. https://doi.org/10.3969/j.issn.2096-7853.2020.12.043

Ramsden, P. (2003). Learning to teach in higher education. Routledge.

Saaty, T. L. (2001). Fundamentals of the analytic hierarchy process. The analytic hierarchy process in natural resource and environmental decision making, 15-35. https://doi.org/10.1007/978-94-015-9799-9_2

Stoof, A., Martens, R. L., Van Merrienboer, J. J., & Bastiaens, T. J. (2002). The boundary approach of competence: A constructivist aid for understanding and using the concept of competence. Human resource development review, 1(3), 345-365. https://doi.org/10.1177/1534484302013005

Strear, M., Forbes, L., & Henninger, J. (2018). Procedures, pitfalls, and product: Delphi methodology in counseling research. Counseling Outcome Research and Evaluation, 9(1), 55-66. https://doi.org/10.1080/21501378.2017.1403847

Swank, J. M. (2014). Assessing counseling competencies: A comparison of supervisors’ ratings and student supervisees’ self-ratings. Counseling Outcome Research and Evaluation, 5(1), 17-27. https://doi.org/17-27.10.1177/2150137814529147

Swank, J. M., & Houseknecht, A. (2019). Teaching competencies in counselor education: A Delphi study. Counselor Education and Supervision, 58(3), 162-176.mhttps://doi.org/10.1002/ceas.12148

Swank, J. M., Houseknecht, A., & Liu, R. (2021). Development of the teaching competencies scale. Assessment & Evaluation in Higher Education, 46(3), 483-493.https://doi.org/10.1080/02602938.2020.1778634

Swank, J. M., Lambie, G. W., & Witta, E. L. (2012). An exploratory investigation of the Counseling Competencies Scale: A measure of counseling skills, dispositions, and behaviors. Counselor Education and Supervision, 51(3), 189-206. https://doi.org/10.1002/j.1556-6978.2012.00014.x

Tarango, J., & Machin-Mastromatteo, J. D. (2017). The role of information professionalsin the knowledge economy: skills, profile and a model for supporting scientific production and communication. Chandos Publishing. https://tinyurl.com/4an5ebvj

Theall, M., & Franklin, J. (2001). Looking for bias in all the wrong places: A search for truth or a witch hunt in student ratings of instruction? New directions for institutional research, 2001(109), 45-56. https://doi.org/10.1002/ir.3

Tigelaar, D. E., Dolmans, D. H., Wolfhagen, I. H., & Van Der Vleuten, C. P. (2004). The development and validation of a framework for teaching competencies in higher education. Higher education, 48, 253-268. https://tinyurl.com/38453n6s

Villar, L. M., & Alegre, O. M. (2008). Measuring faculty learning in curriculum and teaching competence online courses. Interactive Learning Environments, 16(2), 169-181. https://doi.org/10.1080/10494820701365937

Wu N, & Shi D. (2023). The Values, Dilemmas and Paths of Normal Students’ Practical Ability Evaluation under the “Plan to Strengthen Basic Education Teacher Force”. Journal of Chongqing Normal University (Edition of Social Sciences), 1, 25-32. https://doi.org/10.19742/j.cnki.50-1164/C.230103


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493