Questioning and Responding in Target Language Use Situation tasks: A Think-aloud Study

Document Type : Original Article

Authors

1 Department of English Language and Literature, Faculty of Humanities, Yasouj University, Yasouj, Iran

2 Associate professor, Department of English Language and Literature, Faculty of Humanities, Yasouj University, Yasouj, Iran

Abstract

The present study reports a qualitative study aiming to explore whether cognitive processes underlying responding and questioning in English are cognitively analogous. It further sought to discover the latent differences between responding and questioning cognitive processes in Target Language Use Situation tasks. To this end, 20 Iranian general IELTS applicants from two different institutes in Shiraz, with two different language proficiency levels (intermediate and advanced) participated in the study. They were administered a normal oral IELTS responding and a reverse questioning task. Articulated Thoughts in a Simulated Situation (ATSS) paradigm as a think-aloud approach was used to collect qualitative data during task completion. The applicants' recorded voices during task completion were transcribed and analyzed to examine the potential differences between responding and questioning cognitive processes. The analysis of the qualitative data through ATSS paradigm, in general, indicated that the cognitive processes underlying these two processes are not exactly parallel. The applicants tended to be more accurate and fluent during responding tasks. More specifically, they had fewer and shorter pauses and generated more intelligible and comprehensible productions by committing fewer grammatical errors in both proficiency levels. The paper discusses the findings and the implications for second language learners, teachers, and test developers.

Keywords

References

American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (1999). Standards for educational and psychological testing. American Educational Research Association.
Alderson, C. J., Alderson, J. C., Clapham, C., Wall, D., & Swan, M. (1995). Language test construction and evaluation. Cambridge University Press. https://doi.org/10.1017/CBO9780511732980
Alderson, J. C., & Wall, D. (1993). Does washback exist? Applied Linguistics, 14(2), 115-129. https://doi.org/10.1093/applin/14.2.115.
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford University Press.
Brown, J. D., & Bailey, K. M. (1995). Language testing courses: What are they in 2007? Language Testing, 25(3), 349-383. https://doi.org/10.1177/0265532208090157
Bock, J. K. (1982). Toward a cognitive psychology of syntax: Information processing contributions to sentence formulation. Psychological Review, 89(1), 1-30. https://doi.org/10.1037/0033-295X.89.1.1
Brown, J. D., & Hudson, T. (1998). The alternatives in language assessment. TESOL Quarterly, 32(4), 653-675. https://doi.org/10.2307/3587999
Cenoz, J., & Gorter, D. (2014). Focus on multilingualism as an approach in educational contexts. Springer. https://doi.org/10.1007/978-3-319-02261-6
Cenoz, J., & Gorter, D. (2017). Minority languages and sustainable translanguaging: Threat or opportunity? Journal of Multilingual and Multicultural Development, 38(10), 901-912. https://doi.org/10.1080/01434632.2016.1263162.
Chalhoub-Deville, M., & Turner, C. E. (2000). What to look for in ESL admission tests: Cambridge certificate exams, IELTS, and TOEFL. System, 28(4), 523-539. https://doi.org/10.1016/S0346-251X(00)00033-5
Chamot, A. U. (2005). Language learning strategy instruction: Current issues and research. Annual Review of Applied Linguistics, 25(1), 112-130. https://doi.org/10.1017/S0267190505000061
Cheng, L., Sun, Y., & Ma, J. (2015). Review of washback research literature within Kane’s argument-based validation framework. Language Teaching, 48(4), 436-470. https://doi.org/10.1017/S0261444815000233.
Cohen, S. G., Ledford Jr, G. E., & Spreitzer, G. M. (1996). A predictive model of self-managing work team effectiveness. Human Relations, 49(5), 643-676. https://doi.org/10.1177/001872679604900506
Davison, G. C., Robins, C., & Johnson, M. K. (1983). Articulated thoughts during simulated situations: A paradigm for studying cognition in emotion and behavior. Cognitive Therapy and Research, 7(1), 17-39. https://doi.org/10.1007/BF01173421
Davison, G. C., Vogel, R. S., & Coffman, S. G. (1997). Think-aloud approaches to cognitive assessment and the articulated thoughts in simulated situations paradigm. Journal of Consulting and Clinical Psychology, 65(6), 950-958. https://doi.org/10.1037/0022-006X.65.6.950.
Douglas, D. (2014). Understanding language testing. Routledge. https://doi.org/10.4324/9781315889771
Ellis, R. (2004). The definition and measurement of L2 explicit knowledge. Language Learning, 54(2), 227-275. https://doi.org/10.1111/j.1467-9922.2004.00255.x.
Ericsson, K. A., & Simon, H. A. (Eds.). (1993). Protocol analysis: Verbal reports as data. Cambridge University Press.
Fox, J. (2008). Alternative assessment. In E. Shohamy & N. Hornberger (Eds.), Encyclopedia of language and education. Language testing and assessment (pp. 97-109). Springer. https://doi.org/10.1007/978-3-319-02261-6_8
García, O., & Wei, L. (2014). Language, bilingualism, and education. In Translanguaging: Language, bilingualism, and education (pp. 46-62). Palgrave Pivot. https://doi.org/10.1057/9781137385765
Gibbons, P. (2003). Mediating language learning: Teacher interactions with ESL students in a content-based classroom. TESOL Quarterly, 37(2), 247-273. https://doi.org/10.2307/3588502
Glaser, B. G. (1978). Theoretical sensitivity: Advances in the methodology of grounded theory. University of California.
Graesser, A. C., Baggett, W., & Williams, K. (1996). Question-driven explanatory reasoning. Applied Cognitive Psychology, 10(7), 17-31. https://doi.org/10.1002/(SICI)1099-0720(199603)10:1<17::AID-ACP368>3.0.CO;2-V
Graesser, A., & Person, N. K. (1994). Question asking during tutoring. American Educational Research Journal, 31(1), 104-137. https://doi.org/10.3102/00028312031001104
Green, A. (1998). Verbal protocol analysis in language testing research: A handbook. Cambridge University Press. https://doi.org/10.1017/CBO9780511667329
Hughes, A. (2003). Testing for language teachers. Cambridge University Press.
Jackson, G. A. (1982). Public efficiency and private choice in higher education. Educational Evaluation and Policy Analysis, 4(2), 237-247. https://doi.org/10.3102/01623737004002237
Karim, S., & Haq, N. (2014). An assessment of IELTS speaking test. International Journal of Evaluation and Research in Education, 3(3), 152-157.
Kleinsasser, R. C. (2005). Transforming a postgraduate level assessment course: A second language teacher educator’s narrative. Prospect, 20(1), 77-102.
Kormos, J. (2011). Speech production and the Cognition Hypothesis. In P. Robinson (Ed.), Second language task complexity: Researching the cognition hypothesis of language learning and performance (pp. 39-60). John Benjamins Publishing Company. https://doi.org/10.1075/tblt.2.04kor.
Krivokapić, J. (2007). Prosodic planning: Effects of phrasal length and complexity on pause duration. Journal of Phonetics, 35(2), 162-179. https://doi.org/10.1016/j.wocn.2006.01.002
Kunnan, A. J. (2004). Regarding language assessment. Language Assessment Quarterly, 1(1), 1-4. https://doi.org/10.1207/s15434311laq0101_1
Kunnan, A. J. (2009). Testing for citizenship: The US naturalization test. Language Assessment Quarterly, 6(1), 89-97. https://doi.org/10.1080/15434300802606897.
Landis, J. R., & Koch, G. G. (1977). An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics, 33(1), 363-374. https://doi.org/10.2307/2529786
Lennon, P. (1990). Investigating fluency in EFL: A quantitative approach. Language Learning, 40(3), 387-417. https://doi.org/10.1111/j.1467-1770.1990.tb00669.x
Leung, C. (2004). Developing formative teacher assessment: Knowledge, practice, and change. Language Assessment Quarterly, 1(1), 19-41. https://doi.org/10.1207/s15434311laq0101_3
Levelt, W. J. M. (1989). Speaking: From intention to articulation. Cambridge University Press. https://doi.org/10.1017/CBO9781139524605.
Ling, H. (2006). Long pauses in Chinese EFL learners’ speech production. Interlingüística, 17(1), 606-616.
Luoma, S. (2004). Assessing speaking. Cambridge University Press.
Lynch, B. K. (2001). Rethinking assessment from a critical perspective. Language Testing, 18(4), 351-372. https://doi.org/10.1177/026553220101800402
Lynch, B., & Shaw, P. (2005). Portfolios, power, and ethics. TESOL Quarterly, 39(2), 263-297. https://doi.org/10.2307/3588311
Lynch, B. K., & Davidson, F. (1994). Criterion-referenced language test development: Linking curricula, teachers, and tests. TESOL Quarterly, 28(4), 727-743. https://doi.org/10.2307/3587553
Madadi, M., & Rezvani, R. (2019). Trodden and untrodden paths: A study of cognitive processes in oral responding and questioning. Journal of Teaching Language Skills, 38(3), 159-187.
Mandler, J. M., & Day, J. (1975). Memory for orientation of forms as a function of their meaningfulness and complexity. Journal of Experimental Child Psychology, 20(3), 430-443. https://doi.org/10.1016/0022-0965(75)90088-6
McNamara, T. F. (1997). Interaction in second language performance assessment: Whose performance? Applied Linguistics, 18(4), 446-466. https://doi.org/10.1093/applin/18.4.446.
McNamara, T., & Roever, C. (2006). Language testing: The social dimension. Oxford University Press.
Meichenbaum, D. (1985). Teaching thinking: A cognitive-behavioral perspective. In J. W. Segal, S. F. Chipman, & R. Glaser (Eds.), Thinking and learning skills (Vol. 2, pp. 407-426). Routledge.
Michel, M., Kuiken, F., & Vedder, I. (2007). The interaction of task condition and task complexity in the oral performance of Turkish and Moroccan learners of Dutch. In 2nd International Conference on Task-based Language Teaching, Hawaii, USA. https://doi.org/10.1075/tblt.2.09mic
Moehle, J. P. (1984). Seismic response of vertically irregular structures. Journal of Structural Engineering, 110(9), 2002-2014. https://doi.org/10.1061/(ASCE)0733-9445(1984)110:9(2002)(
Ockey, G. J., & Gokturk, N. (2019). Standardized language proficiency tests in higher education. In X. Gao (Ed.), Second handbook of English language teaching (pp. 1-16). Springer. https://doi.org/10.1007/978-3-030-02899-2.
O’Loughlin, K., & Arkoudis, S. (2009). Investigating IELTS exit score gains in higher education. International English Language Testing System (IELTS), 10(1), 1-86.
Park, J. H., & De Costa, P. (2015). Reframing graduate student writing strategies from an activity theory perspective. Language and Sociocultural Theory, 2(1), 25-50. https://doi.org/10.1558/lst.v2i1.26546
Pianta, R. C., Hamre, B. K., & Allen, J. P. (2012). Teacher-student relationships and engagement: Conceptualizing, measuring, and improving the capacity of classroom interactions. In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 365-386). Springer. https://doi.org/10.1007/978-1-4614-2018-7_17
Pickering, M. J., & Garrod, S. (2004). Toward a mechanistic psychology of dialogue. Behavioral and Brain Sciences, 27(2), 169-190. https://doi.org/10.1017/S0140525X04000056
Pufahl, I., & Rhodes, N. C. (2011). Foreign language instruction in US schools: Results of a national survey of elementary and secondary schools. Foreign Language Annals, 44(2), 258-288. https://doi.org/10.1111/j.1944-9720.2011.01130.x.
Rabbitt, P. M. (1968). Channel-capacity, intelligibility, and immediate memory. The Quarterly Journal of Experimental Psychology, 20(3), 241-248. https://doi.org/10.1080/14640746808400158
Read, J. (2009). Identifying academic language needs through diagnostic assessment. Journal of English for Academic Purposes, 8(1), 180-190. https://doi.org/10.1016/j.jeap.2008.10.002.
Rezvani, R., & Sayyadi, A. (2015). Instructors and learners’ questioning: A case of EFL classroom discourse in Iran. Journal of Teaching Language Skills, 34(3), 141-164.
Rezvani, R., & Sayyadi, A. (2016). Washback effects of the new Iranian TEFL Ph.D. program entrance exam on EFL instructors’ teaching methodology, class assessment, and syllabus design: A qualitative scrutiny. Journal of Instruction and Evaluation, 9(33), 155-176.
Robinson, P. (2001). Task complexity, cognitive resources, and syllabus design: A triadic framework for examining task influences on SLA. In P. Robinson (Ed.), Cognition and second language instruction (pp. 287-318). Cambridge University Press. https://doi.org/10.1017/CBO9781139524780.012
Seedhouse, P., & Egbert, M. (2006). The interactional organization of the IELTS speaking test. International English Language Testing System (IELTS), 6(1), 35-52. https://doi.org/10.1016/j.specom.2007.12.012.
Segalowitz, N., & Hulstijn, J. (2005). Automaticity in bilingualism and second language learning. In J. F. Kroll & A. M. B. de Groot (Eds.), Handbook of bilingualism: Psycholinguistic approaches (pp. 371-388). Oxford University Press.
Simon, M., Ercikan, K., & Rousseau, M. (Eds.). (2012). Improving large-scale assessment in education: Theory, issues, and practice. Routledge. https://doi.org/10.4324/9780203801006
Skehan, P. (1998). A cognitive approach to language learning. Oxford University Press. https://doi.org/10.1017/CBO9780511734953
Song, D., Oh, E. Y., & Glazewski, K. (2017). Student-generated questioning activity in second language courses using a customized personal response system: A case study. Educational Technology Research and Development, 65(6), 1425-1449. https://doi.org/10.1007/s11423-017-9536-1
Tan, Z. (2007). Questioning in Chinese university EL classrooms: What lies beyond it? RELC Journal, 38(1), 87-103. https://doi.org/10.1177/0033688206076169
Taylor, L. (2005). Washback and impact. ELT Journal, 59(2), 154-155. https://doi.org/10.1093/eltj/cci030
Tocalli‐Beller, A., & Swain, M. (2005). Reformulation: The cognitive conflict and L2 learning it generates. International Journal of Applied Linguistics, 15(1), 5-28. https://doi.org/10.1111/j.1473-4192.2005.00079.x
Towell, R., Hawkins, R., & Bazergui, N. (1996). The development of fluency in advanced learners of French. Applied Linguistics, 17(1), 84-119. https://doi.org/10.1093/applin/17.1.84.
Weir, C. J., & Milanovic, M. (Eds.). (2003). Continuity and innovation: Revising the Cambridge Proficiency in English Examination. Cambridge University Press. https://doi.org/10.1017/CBO9780511667398
Wendler, C. L., & Walker, M. E. (2006). Practical issues in designing and maintaining multiple test forms for large-scale programs. In S. M. Downing & T. M. Haladyna (Eds.), Handbook of test development (pp. 445-467). Routledge. https://doi.org/10.4324/9780203874772
Willis, D., & Willis, J. (2007). Doing task-based teaching. Oxford University Press.
Zanov, M. V., & Davison, G. C. (2010). A conceptual and empirical review of 25 years of cognitive assessment using the articulated thoughts in simulated situations (ATSS) think-aloud paradigm. Cognitive Therapy and Research, 34(3), 282-291. https://doi.org/10.1007/s10608-009-9255-9
Interdisciplinary Studies in English Language Teaching
Volume 01, Issue 01 - Serial Number 1
January 2023
Pages 146-162

Files

History

  • Receive Date: 23 April 2023
  • Revise Date: 13 June 2021
  • Accept Date: 25 July 2023
  • First Publish Date: 25 July 2023
  • Publish Date: 25 August 2023

Share

How to cite

Statistics