Diagnostic and Developmental Potentials of Computerized Dynamic Assessment (C-DA) for L2 Vocabulary

Document Type : Original Article

Author

English department, Allameh Mohaddes Nouri University, Nour, Mazandaran, Iran

Abstract

Computerized form of dynamic assessment (C-DA) has recently gained a foothold in second/foreign language (L2/FL) context. Inspired by Vygotskian socio-cultural epistemology, C-DA integrates assessment and instruction through providing learners with attuned electronic mediations. This study applied C-DA to assess and instruct L2 learners’ vocabulary knowledge in reading comprehension tasks. Following a pretest–posttest control group design, the study included 70 participants who were randomly selected based on non-probability sample design from 125 students at the outset of the study. The experimental group (N=35) received the C-DA mediation and the control group (N=35) underwent a traditional, unmediated instruction. To be able to simultaneously assess and promote the learners' knowledge of vocabulary, a software program was designed, which could present a number of reading passages and offer strategically a wide range of hierarchically-based electronic mediations. The results of paired and independent samples t-test revealed significant improvement of the DA group. The information obtained from the learners’ learning potential score (LPS) helped diagnose their emerging abilities, which evidenced that learners with equal actual scores in their independent performance had different mediated scores, gained score, and LPS. Moreover, the comparison of learners’ non-dynamic assessment (NDA) and DA scores through both paired and independent samples t-test attested to the diagnostic function of C-DA in surfacing learners’ underlying potential, a finding which has direct implications for L2 vocabulary assessment and development in EFL context.

Keywords

References

Alderson, J. C. (2005). Diagnosing foreign language proficiency: The interface between learning and assessment. Continuum.
Alderson, J. C., Brunfaut, T., & Harding, L. (2014). Towards a theory of diagnosis in second and foreign language assessment: Insights from professional practice across diverse fields. Applied Linguistics, 36(2), 236-260. https://doi.org/10.1093/applin/amt046
Aljaafreh, A., & Lantolf, J. P. (1994). Negative feedback as regulation and second language learning in the zone of proximal development. Modern Language Review, 78, 465-483. https://doi.org/10.2307/328585.
Antón, M. (2009). Dynamic assessment of advanced language learners. Foreign Language Annals, 42(3), 576–598. https://doi.org/10.1111/j.1944-9720.2009.01030.x
Bakhoda, I., & Shabani, K. (2016). Response latency as a tool to study L2 learners’ ZPD, ZAD and ongoing information processing. Asian-Pacific Journal of Second and Foreign Language Education, 1(2). https://doi.org/10.1186/s40862-016-0009-4.
Bakhoda, I., & Shabani, K. (2017). Enhancing L2 learners’ ZPD modification through computerized-group dynamic assessment of reading comprehension. Innovation in Language Learning and Teaching, 13(1), 52-69. https://doi.org/10.1080/17501229.2017.1286350
Bakhoda, I., & Shabani, K. (2019). Bringing L2 learners’ learning preferences in the mediating process through computerized dynamic assessment. Computer Assisted Language Learning, 32(3), 210-236. https://doi.org/10.1080/09588221.2018.1504225
Best, J. W., & Kahn, J. V. (2006). Research in education (10th ed.). Pearson Education.
Bisson, M., van Heuven, W. J. B., Conklin, K., & Tunney, R. J. (2014). The role of repeated exposure to multimodal input in incidental acquisition of foreign language vocabulary. Language Learning, 64, 855–877. https://doi.org/10.1111/lang.12085
Budoff, M. (1987). The validity of learning potential. In C. S. Lidz (Ed.), Dynamic assessment: An interactional approach to evaluating learning potential (pp. 52-81). Guilford Press.
Chun, D. M., & Plass, J. L. (1996). Effects of multimedia annotations on vocabulary acquisition. Modern Language Journal, 80, 183–198. https://doi.org/10.1111/j.1540-4781.1996.tb01159.x
Crook, C. (1991). Computers in the zone of proximal development: Implications for evaluation. Computers & Education, 17(1), 81-91. https://doi.org/10.1016/0360-1315(91)90075-3
Cummins, J. (1979). Linguistic interdependence and the educational development of bilingual children. Review of Educational Research, 49, 222–251. https://doi.org/10.3102/00346543049002222
Dixon-Krauss, L. (1996). Vygotsky in the classroom: Mediated literacy instruction and assessment. Addison Wesley Longman.
Ebadi, S., & Bashir, S. (2021). An exploration into EFL learners’ writing skills via mobile-based dynamic assessment. Education and Information Technologies, 26(2), 1995-2016. https://doi.org/10.1007/s10639-020-10349-3
Ebadi, S., & Ebadijalal, M. (2020). The effect of Google Expeditions virtual reality on EFL learners’ willingness to communicate and oral proficiency. Computer Assisted Language Learning, 1-25. https://doi.org/10.1080/09588221.2020.1854311
Ebadi, S., & Saeedian, A. (2016). Planning future instructional programs through computerized L2 dynamic assessment. Teaching English with Technology, 16(4), 12-32.
Ebadi, S., & Saeedian, A. (2019). Exploring L2 learning potential through computerized dynamic assessment. Teaching English Language, 13(2), 51-78. https://doi.org/10.22132/TEL.2019.95883
Estaji, M., & Saeedian, A. (2020). Developing EFL learners’ reading comprehension through computerized dynamic assessment. Reading Psychology, 41(4), 347-368. https://doi.org/10.1080/02702711.2020.1768988.
Feuerstein, R., Rand, Y., & Hoffman, M. B. (1979). The dynamic assessment of retarded performers: The learning potential assessment device, theory, instruments, and techniques. University Park Press.
Grabe, W., & Stoller, F. (1997). Reading and vocabulary development in a second language: A case study. In J. Coady & T. Huckin (Eds.), Second language vocabulary acquisition: A rationale for pedagogy (pp. 98–122). Cambridge University Press.
Grigorenko, E. L., Sternberg, R. J., & Ehrman, M. E. (2000). A theory-based approach to the measurement of foreign language learning ability: The CANAL-FT theory and test. The Modern Language Journal, 84, 390-405. https://doi.org/10.1111/0026-7902.00076
Hasson, N., & Botting, N. (2010). Dynamic assessment of children with language impairments: A pilot study. Child Language Teaching and Therapy, 26(3), 249-272. https://doi.org/10.1177/0265659009349982
Hidri, S., & Roud, L. F. P. (2020). Developing and using hints in computerized dynamic assessment of a TOEFL iBT reading exam. Heliyon, 6(9), e04985. https://doi.org/10.1016/j.heliyon.2020.e04985
Hulstijn, J. H. (1993). When do foreign-language readers look up the meaning of unfamiliar words? The influence of task and learner variables. Modern Language Journal, 77, 139–147. https://doi.org/10.1111/j.1540-4781.1993.tb01957.x.
Hulstijn, J. H. (1997). Second language acquisition research in the laboratory: Possibilities and limitations. Studies in Second Language Acquisition, 19, 131–143. https://doi.org/10.1017/S0272263197002015
Joshi, R. M., & Aaron, P. G. (2000). The component model of reading: Simple view of reading made a little more complex. Reading Psychology, 21, 85–97. https://doi.org/10.1080/02702710050084428
Kao, Y. T., & Kuo, H. C. (2021). Diagnosing L2 English learners’ listening difficulties and learning needs through computerized dynamic assessment. Interactive Learning Environments, 1-25. https://doi.org/10.1080/10494820.2021.1876733
Knight, S. (1994). Dictionary use while reading: The effects on comprehension and vocabulary acquisition for students of different verbal abilities. Modern Language Journal, 78, 285–299. https://doi.org/10.1111/j.1540-4781.1994.tb02043.x
Kozulin, A. (2003). Psychological tools and mediated learning. In A. E. Kozulin, B. E. Gindis, V. S. E. Ageyev, & S. M. E. Miller (Eds.), Vygotsky’s educational theory in cultural context (pp. 83-98). Cambridge University Press.
Kozulin, A., & Garb, E. (2002). Dynamic assessment of EFL text comprehension of at-risk students. School Psychology International, 23, 112–127. https://doi.org/10.1177/0143034302023001733
Kunnan, A. J., & Jang, E. E. (2009). Diagnostic feedback in language assessment. In M. H. Long & C. J. Doughty (Eds.), The handbook of language teaching (pp. 610–627). Wiley-Blackwell.
Laufer, B., & Hill, M. (2000). What lexical information do L2 learners select in a CALL dictionary and how does it affect word retention? Language Learning & Technology, 3(2), 58–76.
Li, J. (2010). Learning vocabulary via computer-assisted scaffolding for text processing. Computer Assisted Language Learning, 23, 253-275. https://doi.org/10.1080/09588221.2010.483678
Lidz, C. S. (1991). Practitioner’s guide to dynamic assessment. Guilford Press.
Mallahi, O., & Saadat, M. (2020). Effects of feedback on Iranian EFL learners’ writing development: Group dynamic assessment vs. formative assessment. Iranian Evolutionary and Educational Psychology Journal, 2(4), 258-277. https://doi.org/10.52547/ieepj.2.4.258
Martin-Chang, S. L., & Gould, O. N. (2008). Revisiting print exposure: Exploring differential links to vocabulary, comprehension and reading rate. Journal of Research in Reading, 31(3), 273-284. https://doi.org/10.1111/j.1467-9817.2008.00371.x.
Mehri Kamroud, A., Davoudi, M., Ghaniabadi, S., & Amirian, S. M. R. (2019). Diagnosing L2 learners’ development through online computerized dynamic assessment. Computer Assisted Language Learning, 1-30. https://doi.org/10.1080/09588221.2019.1645181
Mohammad Beigi, A., Molaei, A., & Yazdani, S. (2020). Effect of interventionist computerized dynamic assessment on learners’ grammatical English tenses: Analysis of cake and sandwich formats. International Journal of Foreign Language Teaching and Research, 8(32), 79-91.
Philips, D. (2001). Longman preparation course for the TOEFL test. Longman.
Pishghadam, R., & Barabadi, E. (2012). Constructing and validating computerized dynamic assessment of L2 reading comprehension. Iranian Journal of Applied Linguistics (IJAL), 15(1), 73-95.
Poehner, M. E. (2008). Dynamic assessment: A Vygotskian approach to understanding and promoting second language development. Springer Publishing.
Poehner, M. E., & Lantolf, J. P. (2005). Dynamic assessment in the language classroom. Language Teaching Research, 9(3), 233-265. https://doi.org/10.1191/1362168805lr166oa
Poehner, M. E., & Lantolf, J. P. (2013). Bringing the ZPD into the equation: Capturing L2 development during computerized dynamic assessment. Language Teaching Research, 17(3), 323–342. https://doi.org/10.1177/1362168813482935
Poehner, M. E., Zhang, J., & Lu, X. (2015). Computerized dynamic assessment (C-DA): Diagnosing L2 development according to learner responsiveness to mediation. Language Testing, 32(3), 337-357. https://doi.org/10.1177/0265532214560390
Roud, L. F. P., & Hidri, S. (2021). Toward a sociocultural approach to computerized dynamic assessment of the TOEFL iBT listening comprehension test. Education and Information Technologies, 26, 7059-7084. https://doi.org/10.1007/s10639-021-10607-y
Shabani, K. (2014). Dynamic assessment of L2 listening comprehension in transcendence tasks. Procedia - Social and Behavioral Sciences, 98, 1729-1737. https://doi.org/10.1016/j.sbspro.2014.03.600
Sternberg, R. J., & Grigorenko, E. L. (2002). Dynamic testing: The nature and measurement of learning potential. Cambridge University Press.
Tzuriel, D., & Shamir, A. (2002). The effects of mediation in computer assisted dynamic assessment. Journal of Computer Assisted Learning, 18(1), 21-32. https://doi.org/10.1046/j.0266-4909.2001.00204.x
Vakili, S., & Ebadi, S. (2019). Exploring EFL learners’ developmental errors in academic writing through face-to-face and computer-mediated dynamic assessment. Computer Assisted Language Learning, 1-36. https://doi.org/10.1080/09588221.2019.1698616.
Van der Veen, C., Dobber, M., & van Oers, B. (2016). Implementing dynamic assessment of vocabulary development as a trialogical learning process: A practice of teacher support in primary education schools. Language Assessment Quarterly, 13(4), 329-340. https://doi.org/10.1080/15434303.2016.1235577
Van der Veer, R., & Valsiner, J. (1991). Understanding Vygotsky: A quest for synthesis. Blackwell Publishing.
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.
Vygotsky, L. S. (1986). Thought and language (A. Kozulin, Ed.). MIT Press.
Yaghoobi, M., & Razmjoo, A. (2020). Dynamic assessment, computerized dynamic assessment, static assessment and reading comprehension: Effects and percepts. Journal of Research in Educational Systems, 14(49), 25-39.
Yang, Y., & Qian, D. D. (2020). Promoting L2 English learners’ reading proficiency through computerized dynamic assessment. Computer Assisted Language Learning, 33(5-6), 628-652. https://doi.org/10.1080/09588221.2019.1585882
Yim, S., & Warschauer, M. (2017). Web-based collaborative writing in L2 contexts: Methodological insights from text mining. Language Learning & Technology, 21(1), 146-165.
Zangoei, A., Zareian, G., Adel, S. M. R., & Amirian, S. M. R. (2019). The impact of computerized dynamic assessment on Iranian EFL learners’ interlanguage pragmatic development. Journal of Modern Research in English Language Studies, 6(4), 165-139.
Zhang, J., & Lu, X. (2019). Measuring and supporting second language development using computerized dynamic assessment. Language and Sociocultural Theory, 6(1), 92-115. https://doi.org/10.1558/lst.37783
Zhang, L. J., & Annual, S. B. (2008). The role of vocabulary in reading comprehension. RELC Journal, 39, 51-76. https://doi.org/10.1177/0033688208091140
Zhang, R., & Zou, D. (2021). Types, features, and effectiveness of technologies in collaborative writing for second language learning. Computer Assisted Language Learning, 1-31. https://doi.org/10.1080/09588221.2020.1863239
Zheng, B., & Warschauer, M. (2015). Participation, interaction, and academic achievement in an online discussion environment. Computers & Education, 84, 78-89. https://doi.org/10.1016/j.compedu.2015.01.008.

Files

History

  • Receive Date: 19 October 2023
  • Revise Date: 08 November 2023
  • Accept Date: 24 December 2023
  • First Publish Date: 24 December 2023
  • Publish Date: 28 December 2023

Share

How to cite

Statistics