The russian language test: towards assessing text comprehension

The russian language test: towards assessing text comprehension

Автор: Mccarthy Kathryn Soo, Mcnamara Danielle Siobhan, Solnyshkina Marina I., Tarasova Fanuza Kh., Kupriyanov Roman V.

Журнал: Вестник Волгоградского государственного университета. Серия 2: Языкознание @jvolsu-linguistics

Рубрика: Дискуссии

Статья в выпуске: 4 т.18, 2019 года.

Бесплатный доступ

Reading comprehension relies on a variety of complex skills that are not effectively assessed by existing Russian language tests. At the same time, Russian textbooks are criticized both for their low text quality and high text complexity. This study addresses issues of Russian language proficiency and comprehension assessment with the development of the Russian Language Test (RLT) . The RLT was constructed to measure proficiency relevant to textbook comprehension, such as grammar and vocabulary knowledge, establishing propositional meaning and inferencing. Results from this initial study including 81 fifth-grade and 94 ninth-grade students confirm that students struggle with grammatical inferences and identifying the main idea in a text. Additionally, three standardized Russian exams, VPR, OGE, EGE are analyzed, affording an overview of the testing system for the Russian language from the elementary through high school education levels. This study demonstrates promise for the use of the RLT as a language proficiency assessment and provides a broad context for understanding the current state of Russian language tests for native speakers.

Еще

Russian language test, comprehension skills, grammar, vocabulary knowledge, gender, age, general knowledge

Короткий адрес: https://sciup.org/149130013

IDR: 149130013   |   DOI: 10.15688/jvolsu2.2019.4.18

Список литературы The russian language test: towards assessing text comprehension

  • Alderson J.C., 2005. The vocabulary size placement test. Diagnosing foreign language proficiency. London, Continuum, pp. 79-96.
  • Bowles M., 2008. Standards-Based Assessment in the Native Language: A Practical Guide to the Issues. URL: https://www.edweek.org/media/maz-guide%20to%20native%20language%20 assessment%20v15-blog.pdf (accessed 1 September 2019).
  • Demoversii, specifikacii, kodifikatory [Demoversions, Specifications, Codifiers].URL: http://fipi.ru/oge-i-gve-9/demoversii-specifikacii-kodifikatory (accessed 1 September 2019).
  • Education in the Russian Federation. URL: https://wenr.wes.org/2017/06/education-in-the-russian-federation (accessed 1 September 2019).
  • Farhady H., Jafarpur A., Birjandi P., 1994. Test language Skills. From Theory to Practice. Tehran, SAMT Publ.
  • Field J., 2004. Psycholinguistics: The Key Concepts. London, Routledge (in preparation). Cognitive Validity. Taylor L. ed. Examining Speaking: (Studies in Language Testing). Cambridge, Cambridge University Press / Cambridge ESOL.
  • Filimonenko Yu., Timofeev V., 1994. Rukovodstvo k metodike issledovaniya intellekta u detey D. Vekslera. Adaptirovannyy variant [Guide to the Methodology of the Study of Intelligence in Children by D. Veksler (WISC). Adapted version]. Saint Petersburg, IMATON Publ. 94 p.
  • FIPI [FIPM].URL: http://www.fipi.ru (accessed 1 September 2019).
  • Harsch C., Hartig J., 2016. Comparing C-tests and Yes/No Vocabulary Size Tests as Predictors of Receptive Language Skills. Language testing, vol. 33, no. 4, pp. 555-575. URL: https://pdfs. semanticscholar.org/bf8e/da858e81a93990c 450f5b0ccd661da6d5dac.pdf (accessed 1 September 2019).
  • Harsch C., Schrцder K., 2007. Text rekonstruktion: C-Test. Beck B., Klieme K., eds. Sprachliche Kompetenzen: Konzepte und Messungen. DESI-Studie. Weinheim, Beltz, pp. 212-225.
  • Integratsiya obrazovaniya [Integration of Education]. URL: http://edumag.mrsu.ru/content/pdf/18-2.pdf (accessed 1 September 2019).
  • Ivanov V.V., Solnyshkina M.I., Solovyev V.D., 2018. Efficiency of Text Readability Features in Russian Academic Texts. Computational Linguistics and Intellectual Technologies, vol. 17, pp. 277-287.
  • Ivanova V.P., 2013. Razvitie intellekta kak osnovanie lichnostno-professionalnogo stanovleniya studentov: dis.... d-ra psihol. nauk [Development of Intelligence as the Basis of Personal-Professional Formation of Students. Cand. Psychol. sci. diss.]. Moscow. 430 p.
  • Khoutyz I., 2013. Engagement Features in Russian & English: A Cross-Cultural Analysis of Academic Written Discourse Teachers College, Columbia University Working Papers in TESOL & Applied Linguistics, no. 13 (1), pp. 1-20.
  • Kintsch W., van Dijk T.A., 1978. Toward a Model of Text Comprehension and Production. Psychological Review, no. 85, pp. 363-394.
  • Kuchma V.R., Tkachuk E.A., 2015. Gigienicheskaya otsenka uchebnykh tekstov: metodicheskie podkhody i otsenka trudnosti dlya detey obshcheobrazovatelnykh uchebnikov [Hygienic Assessment of Educational Texts: Methodological Approaches and Assessment of Difficulty for Children in Comprehensive Textbooks]. Vestnik RAMN, vol. 70, no. 2, pp. 214-221.
  • DOI: 10.15690/vramn.v70i2.1315
  • Manual for Language Test Development and Examining. URL: https://rm.coe.int/manual-for-language-test-development-and-examining-for-use-with-the-ce/1680667a2b (accessed 1 September 2019).
  • Meyer R.V., 2016. Ob izmerenii slozhnosti uchebnogo teksta po estestvenno-nauchnym distsiplinam [On the Measurement of the Complexity of the Text in Natural Science Disciplines]. Sovremennoe obrazovanie, no. 4, pp. 56-64.
  • DOI: 10.7256/2409-8736.2016.4.19501
  • Milton J. Measuring Second Language Vocabulary Acquisition. Bristol, UK, Multilingual Matters, 2009. 228 p.
  • Opisanie kontrolnykh izmeritelnykh materialov dlya provedeniya v 2019 godu proverochnoy raboty po RUSSKOMU YAZYKU 4 klass [Description of Russian Language Assessment Materials of 2019 ]. URL: https://fioco.ru/Media/Default/Documents/%D0%92%D0%9F%D0%A0/VPR_RU-4_Opisanie_2019.pdf (accessed 1 September 2019).
  • Otsenka didakticheskoy slozhnosti shkolnykh uchebnikov fiziki [Assessment of Complexity of School Physics Textbooks]. URL: https://top-technologies.ru/ru/article/view?id=35582 (accessed 1 September 2019).
  • Panasyuk A.Yu. 1973. Adaptirovannyy variant metodiki Vekslera (WISC) [Adapted Version of the Methodology of D. Veksler (WISC)]. Moscow, Institute of Hygiene of Children and Adolescents of the Ministry of Health of the USSR. 80 p.
  • Petrova А.А., Solnyshkina М.I., 2019. Pismennaya kommunikatsiya: tekstovyy i lingvisticheskiy podkhody k teorii i empirii [Writing Communication: Textual and Linguistic Approaches to Theory and Empirism]. Science Journal of Volgograd State University. Linguistics, vol. 18, no. 3, pp. 276-281.
  • Pinskaya M.A., 2009. An Analysis of Elementary School Textbooks. Journal of Educational Studies, no. 1, pp. 137-161.
  • Ponimanie shkolnikami uchebnogo materiala [Comprehension of Learning Material by Students]. URL: http://www.voppsy.ru/issues/1986/861/861087.htm (accessed 1 September 2019).
  • Research Notes. URL: https://www.cambridgeenglish. org/Images/23150-research-notes-31.pdf (accessed 1 September 2019).
  • Sigott G., 2004. Towards Identifying the C-Test Construct. Frankfurt am Main, Lang.
  • Solovyev V., Ivanov V., Solnyshkina M., 2018. Assessment of Reading Difficulty Levels in Russian Academic Texts: Approaches and Metrics. Journal of Intelligent & Fuzzy Systems, vol. 34, no. 5, pp. 3049-3058.
  • Solovyev V., Solnyshkina M., Gafiyatova E., McNamara D., Ivanov V., 2019a. Sentiment in Academic Texts. 24th Conference of Open Innovations Association FRUCT, vol. 2019-April, pp. 408-414.
  • Solovyev V., Solnyshkina M., Ivanov V., Batyrshin I., 2019b. Prediction of Reading Difficulty in Russian Academic Texts. Journal of Intelligent & Fuzzy Systems, vol. 36, iss. 3, pp. 1-11.
  • Weir C.J., 1993. Understanding and Developing Language Tests. London, Prentice Hall. 341 p.
  • Weir C.J., Khalifa H., 2008. A Cognitive Processing Approach Towards Defining Reading Comprehension. Research Notes, Cambridge ESOL, no. 31, pp. 2-10.
  • Zuckerman G.A., Kovaleva G.S., Kuznetsova M.I., 2013. Between PIRLS and PISA: The Advancement of Reading Literacy in a 10-15-Year-Old Cohort. Learning and Individual Differences, no. 26, pp. 64-73.
Еще
Статья научная
QR-код для установки приложения SciUp Наведите камеру и скачайте бесплатное приложение SciUp