A Competence Model to Assess and Develop Designing Competence Assessment Tool
Abstract
Studies showed that competency-based assessment improvement had generated a much greater impact on students’ achievements on standardized tests than other forms of educational activities. However, studies also indicated a number of challenges for teachers when designing competence assessment tools (CAT), especially in building assessment tasks that replicate real-life practice. There have been many different models for teachers’ assessment competencies, but the competency of designing competence assessment tools (CDCAT) was not paid much attention. In hope to develop a competency model that would serve as a supporting role in developing the CDCAT for pre-service teachers and teachers, this study used a multi-step development process to construct a teachable model that reflectived the complexity of designing assessment tools. The model consisted of 12 behavioural indicators spreading across four dimensions informed by the existing literature and empirical findings in particular contexts. To guarantee the content value of the proposed model, the research twice used the expert method by two panels. The reliability of the model was tested by analyzing the data collected from the survey with students. Interesting findings were met, and the outlined CDCAT model assisted pre-service teachers in solving issues related to their assessment competence. The model was intended for educational researchers, educators, teachers, and policy makers to support teachers’ assessment competence concerning the current accountability model across educational systems. Specific implications for developing pre-service teachers' CDCAT were discussed, followed by suggestions for future studies.
https://doi.org/10.26803/ijlter.20.2.5
Keywords
Full Text:
PDFReferences
Alonzo, D. A. (2016). Development and application of a teacher assessment for learning literacy tool [Doctoral dissertation, University of New South Wales].
American Federation of Teachers, National Council on Measurement in Education, & National Education Association. (1990). Standards for teacher competence in educational assessment of students. Washington: National Council on Measurement in Education.
Ananiadou, K., & Claro, M. (2009). 21st Century skills and competences for new millennium learners in OECD countries. https://doi.org/10.1787/218525261154
Assessment Reform Group. (2008). Changing assessment practices: Process, principles and standards. http://www.aaia.org.uk/content/uploads/2010/06/ARIA-Changing-Assessment-Practice-Pamphlet-Final.pdf
Association for Educational Assessment-Europe. (2012). European framework of standards for educational assessment 1.0. Rome: Edizioni Nuova Cultura.
Australia Goverment Department of Education, Employment and workplace Relations. (2012). TAEASS502B Design and develop assessment tools. https://training.gov.au/TrainingComponentFiles/TAE10/TAEASS502B_R1.pdf
Biggs, J. B., & Collis, K. F. (1982). Evaluating the quality of learning: The SOLO taxonomy. New York: Academic Press.
Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy, and Practice, 5, 7–74.
Bol, L., Stephenson, P. L., O'connell, A. A., & Nunnery, J. A. (1998). Influence of experience, grade level, and subject area on teachers’ assessment practices. The Journal of Educational Research, 91(6), 323–330. http://doi.org/10.1080/00220679809597562.
Boone, W. J. (2016). Rasch analysis for instrument development: Why, when, and how?. CBE Life Sci Education, 15(4). http://doi.org/10.1187/cbe.16-04-0148
Brookhart, S. M. (2011). Educational assessment knowledge and skills for teachers. Educational Measurement: Issues and Practices, 30(1), 3-12.
Brookhart, S. M. (2010). How to assess higher-order thinking skills in your classroom. ASCD Alexandria, Virginia USA.
Caena, F. (2011). Literature review teachers’ core competences: requirements and development. https://www.researchgate.net/publication/344906332_Literature_review_Teachers'_core_competences_requirements_and_development
DeLuca, C., & Klinger, D. A. (2010). Assessment literacy development: Identifying gaps in teacher candidates’ learning. Assessment in Education: Principles, Policy & Practice,17, 419–438. http://doi.org/10.1080/0969594X.2010.516643
DeLuca, C., LaPointe, D. M., & Luhanga, U. (2016). Approaches to classroom assessment inventory: A new instrument to support teacher assessment literacy. Educational Assessment, 21(4), 248-266. http://doi.org/10.1080/10627197.2016.1236677.
Department for Education-United Kingdom. (2012). Teachers’ standards. http://www.education.gov.uk/schools/teachingandlearning/reviewofstandards/a00205581/teachers-standards1-sep-2012.
Department of Education-Australia. (2012). Australian professional standards for teachers. http://www.teacherstandards.aitsl.edu.au/OrganisationStandards/Organisation
DeVellis, R. F. (2003). Scale development: Theory and applications (2nd ed.). Thousand Oaks, CA: Sage Publications.
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113-132. http://doi.org/10.1080/15434303.2011.642041
Gardner, J. (2006). Assessment for learning: a compelling conceptualization. In J. Gardner (Ed.), Assessment and learning (pp197–204). Sage.
González, E. F. (2018). The impact of assessment training on English as a foreign language [Doctoral dissertation, University of Southampton].
Griffins, P. (2015). Assessment for teaching. Cambridge University Press.
Gulikers, J. T. M., Bastiaens, T. J., & Martens, R. L. (2005). The surplus value of an authentic learning environment.Computers in Human Behavior, 21(3), 509–521. http://doi.org/10.1016/j.chb.2004.10.028
Gutierrez, S. L. (2014). From national standards to classrooms: A case study of middle level teachers’ assessment knowledge and practice [Doctoral disseration, Western Michigan University].
Hammami, A. (2016). ESL teacher profiles of ICT integration in their classroom practices and assessment activities: A portrait viewed through the lens of some Quebec teachers’ social representations [Doctoral dissertation, Université de Sherbrooke].
Herppich, S., Praetorius, A. K., Foster, N., Glogger-frey, I., Karst, K., Leutner, D., Behrmann, L., Bohmer, M., Ufer, S., Klug, G., Hetmanek, A., Ohle, A., Bohmer, I., Karing, C., Kaiser, J., & Sudkamp, A. (2017). Teachers' assessment competence: Integrating knowledge-, process-, and product-oriented approaches into a competence-oriented conceptual model. Teaching and Teacher Education, 76, 181-193. http://doi.org/10.1016/j.tate.2017.12.001
Huba, M. E., & Freed, J. E. (2000). Learner-centered cssessment on college campuses: Shifting the focus from teaching to learning. Pearson.
Jarr, K. A. (2012). Education practitioners’ interpretation and use of assessment results [Doctoral dissertation, University of Iowa]. http://ir.uiowa.edu/etd/3317
Leighton, J. P. (2004). Avoiding misconception, misuse, and missed opportunities: The collection of verbal reports in educational achievement testing. Educational Measurement: Issues and Practice, 23(4), 6–15. http://doi.org/10.1111/j.1745-3992.2004.tb00164.x
Linh, N., & Tra, D. (2016). From surveying reality to proposing some solutions to develop competence of designing assessment tool in training and improving physics teacher. HNUE journal of science, 8, 213-225.
McGee, J. R. (2012). Developing and validating a new instrument to measure the self-efficacy of elementary mathematics teachers [Doctoral dissertation, University of North Carolina].
Mertler, C. A., & Campbell, C. (2005). Measuring teachers’ knowledge and application of classroom assessment concepts: Development of the Assessment Literacy Inventory [Paper presentation at meeting]. American Educational Research Association, Montreal, Canada.
Moskal, B. M., & Leydens, J. A. (2000). Scoring rubric development: validity and reliability. Practical Assessment, Research, and Evaluation, 10(7), 71-81. http://doi.org/10.7275/q7rm-gg74
Nary, T. (2014). Development and validation of classroom assessment literacy scales: English as a foreign language (EFL) instructors in a Cambodian higher education setting [Doctoral dissertation, College of Education Victoria University Melbourne, Australia].
National Register on Vocational Education and Training in Australia. (2012). Design and develop assessment tools. TAE10 Training and Education Training Package version 2.0. Commonwealth of Australia.
North Central Regional Educational Laboratory. (2016). Indicator: Assessment. http://www.ncrel.org/engauge/framewk/pro/literacy/prolitin.htm
Organisation for Economic Co-operation and Development (OECD). (2018). Teaching and learning international survey. http://www.oecd.org/education/school/TALIS-2018-MS-Teacher-Questionnaire-ENG.pdf
Okoli, C., & Pawlowski, S.D. (2004). The Delphi method as a research tool: An example, design considerations and applications. Information & Management, 42, 15–29. http://doi.org/10.1016/j.im.2003.11.002
Perry, M. L. (2013). Teacher and principal assessment literacy [Doctoral Dissertation, University of Montana].
Popham, W. J. (2013). Classroom assessment: What teachers need to know (7th ed.). Boston: Pearson.
Randall, J., & Engelhard, Jr. G. (2010). Using confirmatory factor analysis and the Rasch model to assess measurement invariance in a high stakes reading assessmen., Applied Measurement in Education, 23(3), 286-306. http://doi.org/10.1080/08957347.2010.486289
Reddy, Y. M. (2011). Design and development of rubrics to improve assessment outcomes. Quality Assurance in Education, 19(1), 84-104. http://doi.org/10.1108/09684881111107771
Shavelson, R. R. (2013). An approach to testing and modeling competences. In S. Blömeke, O. Zlatkin-Troitschanskaia, C. Kuhn & J. Fege (Eds.), Modeling and measuring competencies in higher education: Tasks and challenges (pp. 29-43).
Sick, J. (2011). Rasch measurement and factor analysis. SHIKEN: ALT Testing and Evaluation SIG Newsletter, 15(1), 15-17.
Stiggins, R. (1987). Design and development of performance asessment. Educational Measurement: Issues and Practice, 6(3), 33-42. http://doi.org/10.1111/j.1745-3992.1987.tb00507.x
Stiggins, R. (2002). Assessment crisis: The absence of assessment for learning. Phi Delta Kappan, 83(10), 758–765.
Stiggins, R. J. (1999b). Evaluating classroom assessment training in teacher education programs. Educational Measurement: Issues and Practice, 18(1), 23-27. http://doi.org/10.1111/j.1745-3992.1999.tb00004.x
Stiggins, R. J., Conklin,N. F. (1992). In teachers’ hands: Investigating the practices of classroom assessment. Albany: State University of New York Press.
Suskie, L. (2004), Assessing student learning: A common sense guide. Anker Publishing Company, Bolton, MA.
Tierney, R., & Simon, M. (2004). What’s still wrong with rubrics: focusing on the consistency ofperformance criteria across scale levels. Practical Assessment, Research and Evaluation, 9(2). http://doi.org/10.7275/jtvt-wg68
Tillema, H., Leenknecht, M., & Segers, M. (2011). Assessing assessment quality: Criteria for quality assurance in design of (peer) assessment for learning – A review of research studies. Studies in Educational Evaluation, 37, 25–34. http://doi.org/10.1016/j.stueduc.2011.03.004
Vidacovich, C. (2015). Measuring teachers' knowledge and use of data and assessments: Creating a measure as a first step toward effective professional development [Doctoral dissertation, University of Denver].
Volante, L., & Fazio, X. (2007). Exploring teacher candidates’ assessment literacy: Implications for teacher education reform and professional development. Canadian Journal of Education, 30, 751–772. http://doi.org/10.2307/20466661
Wiggins, G., & McTighe, J. (2005). Understanding by design. Association for Supervision and Curriculum Development.
Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149-162. http://doi.org/10.1016/j.tate.2016.05.010
Zhang, Z., & Burry-stock, J. A. (1997). Assessment practices inventory: A multivariate analysis of teachers’ perceived assessment competency. https://www.semanticscholar.org/paper/Assessment-Practices-Inventory%3A-A-Multivariate-of-Zhang-Burry Stock/2ade782d7f56a4143f74985e87ef786d90c9eeb3
Refbacks
- There are currently no refbacks.
e-ISSN: 1694-2116
p-ISSN: 1694-2493