Evaluation of L2 Listening Comprehension: In Pursuit of New Measurement Units

Keywords: listening comprehension, psycholinguistic measurement, idea unit, structural-ontological approach, semantic role, subject, actualizer, specification, localization

Abstract

Purpose. Second language (L2) listening comprehension remains one of the most under researched problems in field largely due to the corresponding methodological difficulties. This study focuses on the development of such a measurement unit that considers the actual grammatical completeness and does not distort the factual semantics of the perceived text – listening comprehension unit.

Methods and procedure of research. The concept of listening comprehension unit is developed based on a structural-ontological approach, which is a tool for systemic description of the multidisciplinary subject matter fields. To validate listening comprehension units, a study was carried out on a sample of 38 English L2 learners. Study participants were grouped according to their IELTS results, and listening comprehension unit scores were compared with idea unit ones.

Results. The obtained empirical data were processed with One-way ANOVA test and proper results support the following conclusions. First, listening comprehension units can be used to measure and differentiate levels of L2 listening comprehension of short texts. Secondly, the study demonstrates a higher differential sensitivity of listening comprehension units compared to idea units in L2 listening comprehension levels diagnostics.

Conclusions. First, listening comprehension units can be used to measure and differentiate levels of L2 listening comprehension of short texts. Secondly, our study demonstrates a higher differential sensitivity of listening comprehension units compared to idea units in L2 listening comprehension levels diagnostics. In our opinion, another advantage of using listening comprehension units is that this tool also allows one to look differently at the semantic structure of the listening comprehension process. In turn, this might open new psycholinguistic, pedagogical and didactic perspectives in the field.

Downloads

Download data is not yet available.

References

Bardovi-Harlig, K. (1992). A Second Look at T-Unit Analysis: Reconsidering the Sentence. TESOL Quarterly, 26(2), 390. https://doi.org/10.2307/3587016

Chang, S. (2012). Approaching L2 Listening Comprehension for Advanced Learners: Using Reading as a Pre-Listening Task. The Korean Language in America, 17, 166–186. https://www.jstor.org/stable/42922364

Cocklin, T.G., Ward, N.J., Chen, H.C., & Juola, J.F. (1984). Factors influencing readability of rapidly presented text segments. Memory & Cognition, 12(5), 431–442. https://doi.org/10.3758/BF03198304

Donohue, M., & Wichmann, S. (Eds.). (2008). The Typology of Semantic Alignment. Oxford University Press. https://doi.org/10.1093/ACPROF:OSO/9780199238385.001.0001

Dunlosky, J., Hartwig, M.K., Rawson, K.A., & Lipko, A.R. (2011). Improving college students’ evaluation of text learning using idea-unit standards. Quarterly Journal of Experimental Psychology, 64(3), 467–484. https://doi.org/10.1080/17470218.2010.502239

El-Dali, M. (2017). L2 Listening Comprehension: Is it a Language Problem or Listening Problem? English Linguistics Research, 6(1), 14–37. https://doi.org/10.5430/ELR.V6N1P14

Field, A. (2013). Discovering Statistics using IBM SPSS Statistics. Sage Publications Ltd. SAGE. https://books.google.com/books/about/Discovering_Statistics_Using_IBM_SPSS_St.html?id=c0Wk9IuBmAoC

Field, J. (2009). Listening in the Language Classroom. In Listening in the Language Classroom. Cambridge University Press. https://doi.org/10.1017/CBO9780511575945

Foster, P., Tonkyn, A., & Wigglesworth, G. (2000). Measuring spoken language: a unit for all reasons. Applied Linguistics, 21(3), 354–375. https://doi.org/10.1093/APPLIN/21.3.354

Gaies, S.J. (1980). T-Unit Analysis in Second Language Research: Applications, Problems and Limitations. TESOL Quarterly, 14(1), 50–60. https://doi.org/10.2307/3586808

Goh, C. (2016). Cognition, Metacognition, and L2 Listening. In E. Hinkel (Ed.), Handbook of Research in Second Language Teaching and Learning (1st ed., pp. 214–228). Routledge. https://doi.org/10.4324/9781315716893-16

Graham, S., Santos, D., & Vanderplank, R. (2011). Exploring the relationship between listening development and strategy use. Language Teaching Research, 15(4), 435–456. https://doi.org/10.1177/1362168811412026

Granaas, M.M. (1985). Simple, applied text parsing. Behavior Research Methods, Instruments, & Computers, 17(2), 209–216. https://doi.org/10.3758/BF03214385

Hansen, C., & Jensen, C. (1994). Evaluating lecture comprehension. In J. Flowerdew (Ed.), Academic listening (pp. 241–268). Cambridge University Press. https://doi.org/10.1017/CBO9781139524612.019

Hidri, S. (2020). The IELCA and IELTS Exams: A Benchmark Report. The Journal of Asia TEFL, 17(2), 742–749. https://doi.org/10.18823/ASIATEFL.2020.17.2.33.742

Houtkoop, H., & Mazeland, H. (1985). TURNS AND DISCOURSE UNITS IN EVERYDAY CONVERSATION. Journal of Pragmatics, 9, 595–619. https://doi.org/10.1016/0378-2166(85)90055-4

Hunt, K.W. (1977). Early Blooming and Late Blooming Syntactic Structures. In C. L. Cooper, & L. Odell (Eds.), Evaluating Writing: Describing, Measuring, Judging (pp. 100–114). National Council of Teachers of English.

Izre’el, S., Mello, H., Panunzi, A., & Raso, T. (Eds.). (2020). In Search of Basic Units of Spoken Language. John Benjamins Publishing Company. https://doi.org/10.1075/SCL.94

Joyce, P. (2019). The Relationship between L2 Listening Proficiency and L2 Aural Language Processing. Journal of Language Teaching and Learning in Thailand, 57, 9–32. https://files.eric.ed.gov/fulltext/EJ1224420.pdf

Kroll, B. (1977). Combining ideas in written and spoken English: A look at subordination and coordination. In E.O. Keenan, & T.L. Bennett (Eds.), Discourse across time and space (pp. 69–108). University of Southern California.

Liddicoat, A.J. (2004). The projectability of turn constructional units and the role of prediction in listening. Discourse Studies, 6(4), 449–469. https://doi.org/10.1177/1461445604046589

Long, M. (1985). Input and Second Language Acquisition Theory. In S. Gass, & C. Madden (Eds.), Input in Second Language Acquisition (pp. 377–393). Newbury House. https://www.scribd.com/doc/179333902/Long-1985-Input-and-Second-Language-Acquisition-Theory-pdf

Miles, N. (host). (2021). Putin and Biden hold talks in Geneva [Audio podcast episode]. In Global News Podcast. BBC World Service. https://www.bbc.co.uk/programmes/p09lnjvh

Ockey, G.J., & Wagner, E. (2018). Assessing L2 listening: Moving towards authenticity. John Benjamins Publishing Company. https://books.google.com/books/about/Assessing_L2_Listening.html?id=rDtlDwAAQBAJ

Pica, T., Holliday, L., Lewis, N., & Morgenthaler, L. (1989). Comprehensible Output as an Outcome of Linguistic Demands on the Learner. Studies in Second Language Acquisition, 11(1), 63–90. https://doi.org/10.1017/S027226310000783X

Richards, T., Peverly, S., Wolf, A., Abbott, R., Tanimoto, S., Thompson, R., Nagy, W., & Berninger, V. (2016). Idea units in notes and summaries for read texts by keyboard and pencil in middle childhood students with specific learning disabilities: Cognitive and brain findings. Trends in Neuroscience and Education, 5(3), 146–155. https://doi.org/10.1016/J.TINE.2016.07.005

Sato, C. J. (1988). Origins of Complex Syntax in Interlanguage Development. Studies in Second Language Acquisition, 10(3), 371–395. https://doi.org/10.1017/S027226310000749X

Shymko, V. (2018). Object field of organizational culture: methodological conceptualization. International Journal of Organizational Analysis, 26(4), 602–613. https://doi.org/10.1108/ijoa-03-2017-1135

Shymko, V. (2019a). Natural Language Understanding: Methodological Conceptualization. Psycholinguistics, 25(1), 431–443. https://doi.org/10.31470/2309-1797-2019-25-1-431-443

Shymko, V. (2019b). Introduction to Structural-Ontological Methodology: Analysis of the Subject Matter Field of Personality Socialization). SSRN Electronic Journal. https://doi.org/10.2139/SSRN.3575800

Shymko, V. (2019c). On the Question of the Place and Role of Language in the Process of Personality Socialization: Structural-Ontological Sketch. Psycholinguistics, 26(1), 385–400. https://doi.org/10.31470/2309-1797-2019-26-1-385-400

Shymko, V., & Babadzhanova, A. (2020). Space as a Semantic Unit of a Language Consciousness. Psycholinguistics, 27(1), 335–350. https://doi.org/10.31470/2309-1797-2020-27-1-335-350

Sotillo, S. M. (2000). Discourse functions and syntactic complexity in synchronous and asynchronous communication. Language Learning & Technology, 4(1), 77–110. http://llt.msu.edu/vol4num1/sotillo/default.html

Taboada, M., & Zabala, L.H. (2008). Deciding on units of analysis within Centering Theory. Corpus Linguistics and Linguistic Theory, 4(1), 63–108. https://doi.org/10.1515/CLLT.2008.003

Vandergrift, L., & Goh, C.C.M. (2011). Teaching and learning second language listening: Metacognition in action (1st ed.). Routledge. https://doi.org/10.4324/9780203843376

Wang, Y., & Treffers-Daller, J. (2017). Explaining listening comprehension among L2 learners of English: The contribution of general language proficiency, vocabulary knowledge and metacognitive awareness. System, 65, 139–150. https://doi.org/10.1016/J.SYSTEM.2016.12.013

Yang, J., Cai, Q., & Tian, X. (2020). How Do We Segment Text? Two-Stage Chunking Operation in Reading. ENeuro, 7(3), 1–14. https://doi.org/10.1523/ENEURO.0425-19.2020

Yeldham, M. (2017). Techniques for researching L2 listeners. System, 66(December), 13–26. https://doi.org/10.1016/j.system.2017.03.001

Yeldham, M., & Gruba, P. (2016). The development of individual learners in an L2 listening strategies course. Language Teaching Research, 20(1), 9–34. https://doi.org/10.1177/1362168814541723


Abstract views: 209
PDF Downloads: 139
Published
2023-04-24
How to Cite
Shymko, V. (2023). Evaluation of L2 Listening Comprehension: In Pursuit of New Measurement Units. PSYCHOLINGUISTICS, 33(1), 212-229. https://doi.org/10.31470/2309-1797-2023-33-1-212-229