Assessment Literacy, Current Assessment Practices and Future Training: Reflections of Teachers in Higher Education

Sophia Gaikwad, Ashwini Wadegaonkar, Gargee Mitra, Devjani Chakravarty

Abstract


The aim of this study is to explore assessment literacy, to analyse the current assessment practices of teachers in Higher Education (HE) and to understand the need for alternative assessment practices in light of teachers’ reflections. The research employed incidental sampling to select (n=58) HE teachers from a single multidisciplinary university in Maharashtra State, India. A comprehensive literature review on assessment literacy provided the theoretical foundation, and a specialized assessment tool was developed to assess the teachers' assessment literacy level, perspectives, and practices in assessment. Data were collected through voluntary participation and analysed using quantitative and qualitative techniques. The findings revealed that the majority of HE teachers (79%) demonstrated a moderate level of assessment literacy, while 16% exhibited low levels and only 5% showed high levels. Additionally, a discrepancy was observed between the preferred assessment types of teachers and learners, with learners emphasizing active participation and real-world applications, while teachers leaned toward traditional evaluation methods. Participants were found to be literate only in specific aspects such as meaning, basic forms of assessments, and the purpose of educational assessments. Furthermore, teachers minimally acknowledge and have a lesser preference for alternative assessment methods, such as article analysis, team projects, case studies, and discussions. Overall findings indicate teachers' lack of knowledge about assessment practices that involve evaluating student performance, fostering collaboration, assessing higher-order thinking skills, and utilizing assessment as a tool for learning and improvement. This research confirms the need for training to enhance teachers' assessment literacy, promoting the adoption of alternative assessment practices in higher education to optimize student learning experiences.

https://doi.org/10.26803/ijlter.22.7.1


Keywords


Assessment literacy; Current assessment practices; Alternative assessments; Higher education teachers

Full Text:

PDF

References


Adama, E. A., Graf, A., Adusei-Asante, K., & Afrifa-Yamoah, E. (2023). COVID-19 and alternative assessments in higher education: Implications for academic integrity among nursing and social science students. International Journal for Educational Integrity, 19(1). https://doi.org/10.1007/s40979-023-00129-0

Areekkuzhiyil, S. (2019). Assessment Practices in Higher Education: Myths and Realities. Online Submission.

Bayat, K., & Rezaei, A. (2015). Importance of Teachers’ Assessment Literacy. International Journal of English Language Education, 3, 139-148. https://doi.org/10.5296/ijele.v3i1.6887

Al-Thani, S. J., Abdelmoneim, A., Daoud, K., Cherif, A., & Moukarzel, D. (2021). Assessment of student learning outcomes for assurance of learning at Qatar University. Journal of Assessment and Institutional Effectiveness, 4(2), 116-135. https://doi.org/10.5325/jasseinsteffe.4.2.0116

Atjonen, P., Pöntinen, S., Kontkanen, S., & Ruotsalainen, P. (2022). Enhancing preservice teachers' assessment literacy: Focus on knowledge base, conceptions of assessment, and teacher learning. Frontiers in Education, 7, 891391. https://doi.org/10.3389/feduc.2022.891391

Bennett, R. E. (2011). Formative assessment: a critical review. Assessment in Education: Principles, Policy & Practice, 18(1), 5–25. https://doi.org/10.1080/0969594x.2010.513678

Can, E., Aktas, F., & Arpacioglu, I. (2017). The reasons of school dropouts in higher education: Babaeski Vocational College case. Universal Journal of Educational Research, 5(12A), 84-88.

Chatterjee, S., & Bhattacharjee, K. K. (2020). Adoption of artificial intelligence in higher education: a quantitative analysis using structural equation modelling. Education and Information Technologies, 25(5), 3443–3463. https://doi.org/10.1007/s10639-020-10159-7

Cohen, L., Manion, L., & Morrison, K. (2018). Research methods in education (8th ed.). Routledge.

Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). Sage Publications.

Dang, B. Y., Ho, E., & Tsang, A. (2022). Learner’s assessment preferences in higher education: A comparison study of high-achievers and low-achievers. Asia-Pacific Education Researcher. https://doi.org/10.1007/s40299-022-00679-w

DeLuca, C., Coombs, A., MacGregor, S., & Rasooli, A. (2019). Toward a differential and situated view of assessment literacy: Studying teachers' responses to classroom assessment scenarios. Frontiers in Education, 4. https://doi.org/10.3389/feduc.2019.00094

Deneen, C. C., & Brown, G. T. L. (2016). The impact of conceptions of assessment on assessment literacy in a teacher education program. Cogent Education, 3(1).

DePascale, C., Sharp A., Ryan K., Damian Betebenner, D. (2018). Building a Conceptual Framework for Assessment Literacy. Assessment Literacy Framework.

Dikli, S. (2003). Assessment at a distance: Traditional vs. alternative assessments. Turkish Online Journal of Educational Technology-TOJET, 2(3), 13-19.

Dutta, A. (2020). Impact of Digital Social Media on Indian Higher Education: Alternative Approaches of Online Learning during COVID-19 Pandemic Crisis. International Journal of Scientific and Research Publications, 10(5), 604. http://dx.doi.org/10.29322/IJSRP.10.05.2020.p10169

Gallego, M. G., Perez de los Cobos, A. P., & Gallego, J. C. G. (2021). Identifying students at risk to academic dropout in higher education. Education Sciences, 11, 427. https://doi.org/10.3390/educsci11090427

Government of India. (2020). National Education Policy 2020. Ministry of Education.

Government of India, Ministry of Education. (2020). All India survey on higher education.

Govindarajan, V., & Srivastava, A. (2020). What the Shift to Virtual Learning Could Mean for the Future of Higher Ed. Harvard Business Review. Retrieved from https://hbr.org/2020/03/what-the-shift-to-virtual-learning-could-mean-for-the-future-of-higher-ed

Hannigan, C., Alonzo, D., & Oo, C. Z. (2022). Student assessment literacy: Indicators and domains from the literature. Assessment in Education: Principles, Policy & Practice, 29(4), 482-504. https://doi.org/10.1080/0969594X.2022.2121911

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81-112. https://doi.org/10.3102/003465430298487

Hidri, S. (2020). Language assessment literacy: Where to go? In S. Hidri (Ed.), Perspectives on Language Assessment Literacy: Challenges for Improved Student Learning (pp. 10). Routledge. https://doi.org/10.4324/9781003016083

Holzinger, A., Lettner, S., Steiner-Hofbauer, V., & Capan-Melser, M. (2020). How to assess? Perceptions and preferences of undergraduate medical students concerning traditional assessment methods. BMC Medical Education, 20(1), 1-9. https://doi.org/10.1186/s12909-020-02239-6

Janisch, C., Liu, X., & Akrofi, A. (2007). Implementing alternative assessment: opportunities and obstacles. The Educational Forum, 71(3), 221-230. https://doi.org/10.1080/00131720709336947

Joshi, A., Vinay, M., & Bhaskar, P. (2021). Impact of coronavirus pandemic on the Indian education sector: Perspectives of teachers on online teaching and assessments. Interactive Technology and Smart Education, 18(2), 205-226. https://doi.org/10.1108/ITSE-06-2020-0087

Knight, P. T. (2002). Summative assessment in higher education: Practices in disarray. Studies in Higher Education, 27(3), 275-286. https://doi.org/10.1080/03075070220000721

Kremmel, B., & Harding, L. (2019). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey. Language Assessment Quarterly, 16(3), 315-335. https://doi.org/10.1080/15434303.2019.1612823

Latif, M. W., & Wasim, A. (2022). Teacher beliefs, personal theories and conceptions of assessment literacy - A tertiary EFL perspective. Language Testing in Asia, 12(1), 1-22. https://doi.org/10.1186/s40468-022-00158-5

Maclellan, E. (2004). How convincing is alternative assessment for use in higher education? Assessment & Evaluation in Higher Education, 29(3), 311-321. https://doi.org/10.1080/0260293042000200497

Mellati, M., & Khademi, M. (2018). Exploring teachers’ assessment literacy: Impact on learners’ writing achievements and implications for teacher development. Australian Journal of Teacher Education, 43(6), 1-18. https://doi.org/10.14221/ajte.2018v43n6.2

Ministry of Human Resource Development. (2016). All India survey on higher education 2015-16. Department of Higher Education, Government of India, New Delhi. https://www.education.gov.in/sites/upload_files/mhrd/files/statistics-new/AISHE2015-16.pdf

Michigan Assessment Consortium. (2015). Assessment Literacy Standards: A National Imperative, Version 5.0 (2015). www.michiganassessmentconsortium.org

Michigan Assessment Consortium. (2020). Assessment Literacy Standards: A National Imperative. Assessment Literacy Standards // VERSION 6.0. https://www.michiganassessmentconsortium.org/assessment-literacy-standards/

NAAC. (2017). Assessment and accreditation standards for quality assurance in higher education institutions. National Assessment and Accreditation Council, India.

National Statistical Office, Ministry of Statistics and Programme Implementation, Government of India. (2022). Youth of India 2022

Newfields, T. (2006). Teacher development and assessment literacy. In Authentic Communication: Proceedings of the 5th Annual JALT Pan-SIG Conference.

Nieminen, J. H., Bearman, M., & Tai, J. (2023). How is theory used in assessment and feedback research? A critical review. Assessment & Evaluation in Higher Education, 48(1), 77–94.

Nurdiana. (2020). Language Teacher Assessment Literacy: A Current Review. Journal of English Language and Culture, 11(1).

Oo, C. Z., Alonzo, D., & Davison, C. (2023). Using a Needs-Based Professional Development Program to Enhance Pre-Service Teacher Assessment for Learning Literacy. International Journal of Instruction, 16(1), 781-800–800. https://doi.org/10.29333/iji.2023.16144a

Paura, L., & Arhipova, I. (2014). Cause Analysis of Students’ Dropout Rate in Higher Education Study Program. Procedia - Social and Behavioral Sciences, 109, 1282–1286.

Pereira, D. R., & Flores, M. A. (2016). Conceptions and practices of assessment in higher education: A study of Portuguese university teachers. Revista Iberoamericana de Evaluación Educativa, 9(1), 9-29.

Pereira, D., Flores, M. A., & Niklasson, L. (2015). Assessment revisited: A review of research in Assessment and Evaluation in Higher Education. Assessment & Evaluation in Higher Education, 41(7), 1008–1032.

Popham, W. J. (2009). Assessment Literacy for Teachers: Faddish or Fundamental? Theory Into Practice, 48(1), 4-11. https://doi.org/10.1080/00405840802577536

Popham, J. (2011). Assessment literacy overlooked: A teacher educator’s confession. The Teacher Educator, 46, 265-273.

Segers, M., & Dochy, F. (2001). New Assessment Forms in Problem-based Learning: The value-added of the students’ perspective. Studies in Higher Education, 26(3), 327–343. https://doi.org/10.1080/03075070120076291

Sun, H., & Zhang, J. (2022). Assessment literacy of college EFL teachers in China: Status quo and mediating factors. Studies in Educational Evaluation, 74, 101157. https://doi.org/10.1016/j.stueduc.2022.101157

Tomas, C., & Jessop, T. (2018). Struggling and juggling: A comparison of student assessment loads across research and teaching-intensive universities. Assessment & Evaluation in Higher Education, 1–10.

UGC. (2019). Assessment and accreditation norms in higher educational institutions. University Grants Commission, India.

Wadhwa, S. (2021). Ensuring integrity and security in digital assessments: Challenges and solutions for higher education in India. The International Review of Research in Open and Distributed Learning, 22(2), 80-98. https://doi.org/10.19173/irrodl.v22i2.5629

Wang, H., Sun, W., Zhou, Y., Li, T., & Zhou, P. (2022). Teachers’ assessment literacy improves teaching efficacy: A view from conservation of resources theory. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.1007830

Webber, C. (2012). Standardized examination and higher education in India: Evaluating the influence of the AIEEE on engineering education. Asia Pacific Education Review, 13(2), 205-215. https://doi.org/10.1007/s12564-011-9182-0

Webber, K. (2012). The use of learner-centered assessment in US colleges and universities. Research in Higher Education, 53(2), 201-228.

Xu, Y., & Brown, G. T. L. (2017). University English teacher assessment literacy: A survey-test report from China. Papers in Language Testing and Assessment, 6(1).

Yan, Z., & Pastore, S. (2022). Are teachers literate in formative assessment? The development and validation of the Teacher Formative Assessment Literacy Scale. Studies in Educational Evaluation, 74. https://doi.org/10.1016/j.stueduc.2022.101183

Youngjoon, K., & Okseon, L. (2021). Autoethnography of a Novice Teacher’s Assessment Literacy in Elementary Physical Education. International Journal of Qualitative Studies on Health and Well-being, 16(1). https://doi.org/10.1080/17482631.2021.1882066

Zulaiha, S., Mulyono, H., & Ambarsari, L. (2020). An Investigation into EFL Teachers’ Assessment Literacy: Indonesian Teachers’ Perceptions and Classroom Practice. European Journal of Contemporary Education, 9(1), 189-199. https://doi.org/10.13187/ejced.2020.1.189

Zulaiha, S., Suryanti, E., & Pramudya, I. (2020). Issues and challenges in assessment of diverse students in higher education: A study in Indonesian context. Journal of Educational Science and Technology, 6(1), 91-101. https://doi.org/10.26858/est.v6i1.12696


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493