Assessing the teaching quality of economics programme: instructor course evaluations

Автор: Hysa Eglantina, Ur Rehman Naqeeb

Журнал: Интеграция образования @edumag-mrsu

Рубрика: Модернизация образования

Статья в выпуске: 4 (97), 2019 года.

Бесплатный доступ

Introduction. In recent years, measuring the efficiency and effectiveness of higher education has become a major issue. Most developed countries are using national surveys to measure teaching and assessment as key determinants of students' approaches to learning which have direct effect on the quality of their learning outcomes. In less developed countries, there does not exist a national survey. This paper aims to propose an original questionnaire assessing the teaching quality. The specifics of this questionnaire, termed as the Instructor Course Evaluation Survey, is that it addresses three main dimensions, such as: Learning Resources, Teaching Effectiveness, and Student Support. Materials and Methods. The paper opted for an analytic study using 3,776 completed questionnaires. This is a case study applied to the students enrolled in economics program in a private university in Albania. The Instructor Course Evaluation Survey design was supported by the literature review, identifying the three main dimensions included in the questionnaire. The reliability was tested with Cronbach's alpha and with Confirmatory Factor Analysis. The use of Confirmatory Factor Analysis helps in identifying issues of multi-dimensionality in scales. Results. The paper provides empirical insights into the assessing methodology and brings a new model of it. The finding suggests that Learning Resources, Teaching Effectiveness and Student Support increase the quality of teaching. Because of the chosen research target group, students from economics program, the research results may not be generalizable. Therefore, researchers are encouraged to test the proposed statements further. Discussion and Conclussion. The paper includes implications for the development of a simple and useful questionnaire assessing the quality of teaching. Although Instructor Course Evaluation Survey was applied specifically to economics program, the proposed questionnaire can be broadly applied. This paper fulfills an identified need to propose an original and simple questionnaire to be used from different universities and programs to measure the quality of teaching.

Еще

Course evaluation, higher education, quality of teaching, economics program, confirmatory factor analysis

Короткий адрес: https://sciup.org/147220726

IDR: 147220726   |   DOI: 10.15507/1991-9468.097.023.201904.556-567

Список литературы Assessing the teaching quality of economics programme: instructor course evaluations

  • Hysa E. Defining a 21st Century Education: Case Study of Development and Growth Course. Mediterranean Journal of Social Sciences. 2014; 5(2):41-46. (In Eng.) DOI: 10.5901/mjss.2014.v5n2p41
  • Stergiou D.P., Airey D. Using the Course Experience Questionnaire for Evaluating Undergraduate Tourism Management Courses in Greece. Journal of Hospitality, Leisure, Sport & Tourism Education. 2012; 11(1):41-49. (In Eng.) DOI: 10.1016/j.jhlste.2012.02.002
  • Darwin S. Moving Beyond Face Value: Re-Envisioning Higher Education Evaluation as a Generator of Professional Knowledge. Assessment & Evaluation in Higher Education. 2012; 37(6):733-745. (In Eng.) DOI: 10.1080/02602938.2011.565114
  • Clayson D.E., Haley D.A. Are Students Telling Us the Truth? A Critical Look at the Student Evaluation of Teaching. Marketing Education Review. 2011; 21(2):101-112. (In Eng.) 10.2753/ MER1052-8008210201 DOI: 10.2753/MER1052-8008210201
  • Kuzmanovic M., Savic G., Gusavac B.A., Makajic-Nikolic D., Panic B. A Conjoint-Based Approach to Student Evaluations of Teaching Performance. Expert Systems with Applications. 2013; 40(10):4083-4089. (In Eng.) DOI: 10.1016/j.eswa.2013.01.039
  • Surgenor P.W. Obstacles and Opportunities: Addressing the Growing Pains of Summative Student Evaluation of Teaching. Assessment & Evaluation in Higher Education. 2013; 38(3):363-376. (In Eng.)
  • DOI: 10.1080/02602938.2011.635247
  • Shevlin M., Banyard P., Davies M., Griffiths M. The Validity of Student Evaluation of Teaching in Higher Education: Love Me, Love My Lectures? Assessment & Evaluation in Higher Education. 2000; 25(4):397-405. (In Eng.)
  • DOI: 10.1080/713611436
  • Oon P.T., Spencer B., Kam C.C.S. Psychometric Quality of a Student Evaluation of Teaching Survey in Higher Education. Assessment & Evaluation in Higher Education. 2017; 42(5):788-800. (In Eng.)
  • DOI: 10.1080/02602938.2016.1193119
  • Nasser F., Fresko B. Faculty Views of Student Evaluation of College Teaching. Assessment & Evaluation in Higher Education. 2002; 27(2):187-198. (In Eng.)
  • DOI: 10.1080/02602930220128751
  • Hammonds F., Mariano G.J., Ammons G., Chambers S. Student Evaluations of Teaching: Improving Teaching Quality in Higher Education. Perspectives: Policy and Practice in Higher Education. 2017; 21(1):26-33. (In Eng.)
  • DOI: 10.1080/13603108.2016.1227388
  • Marsh H.W. Students' Evaluations of University Teaching: Research Findings, Methodological Issues, and Directions for Future Research. International Journal of Educational Research. 1987; 11(3):253-388. (In Eng.)
  • DOI: 10.1016/0883-0355(87)90001-2
  • Paulsen M.B. Evaluating Teaching Performance. New Directions for Institutional Research. Special Issue: Evaluating Faculty Performance. 2002; (114):5-18. (In Eng.)
  • DOI: 10.1002/ir.42
  • Richardson J.T. Instruments for Obtaining Student Feedback: A Review of the Literature. Assessment & Evaluation in Higher Education. 2005; 30(4):387-415. (In Eng.) https://doi. org/
  • DOI: 10.1080/02602930500099193
  • Hoxhaj J., Hysa E. Comparing ENQA, British, German & Albanian Standards of Quality in Higher Education. European Journal of Sustainable Development. 2015; 4(2):243-258. (In Eng.) http://dx.doi. org/
  • DOI: 10.14207/ejsd.2015.v4n2p243
  • Bassi F., Clerici R., Aquario D. Students' Evaluation of Teaching at a Large Italian University: Validation of Measurement Scale. Electronic Journal of Applied Statistical Analysis. 2017; 10(1):93-117. (In Eng.)
  • DOI: 10.1285/i20705948v10n1p93
  • Newton J. What is Quality? In: Embedding Quality Culture in Higher Education. A Selection of Papers from the 1st European Forum for Quality Assurance (23-25 November 2006, Germany) / L. Bollaert, S. Brus, B. Curvale, et al. (Eds.). 2007. p. 14-24. Avaiable at: https://enqa.eu/indirme/papers-and-reports/associated-reports/EUA_QA_Forum_publication.pdf (accessed 11.10.2019). (In Eng.)
  • Spooren P., Brockx B., Mortelmans D. On the Validity of Student Evaluation of Teaching: The State of the Art. Review of Educational Research. 2013; 83(4):598-642. (In Eng.)
  • DOI: 10.3102/0034654313496870
  • Marsh H.W. SEEQ: A Reliable, Valid, and Useful Instrument for Collecting Students' Evaluations of University Teaching. British Journal of Educational Psychology. 1982; 52(1):77-95. (In Eng.) https://
  • DOI: 10.1111/j.2044-8279.1982.tb02505.x
  • Marsh H.W., Muthen B., Asparouhov T., Liidtke O., Robitzsch A., Morin A.J. et al. Exploratory Structural Equation Modeling, Integrating CFA and EFA: Application to Students' Evaluations of University Teaching. Structural Equation Modeling: A Multidisciplinary Journal. 2009; 16(3):439-476. (In Eng.)
  • DOI: 10.1080/10705510903008220
  • Coffey M., Gibbs G. The Evaluation of the Student Evaluation of Educational Quality Questionnaire (SEEQ) in UK Higher Education. Assessment & Evaluation in Higher Education. 2001; 26(1):89-93. (In Eng.)
  • DOI: 10.1080/02602930020022318
  • Kember D., Leung D.Y. Establishing the Validity and Reliability of Course Evaluation Questionnaires. Assessment & Evaluation in Higher Education. 2008; 33(4):341-353. (In Eng.)
  • DOI: 10.1080/02602930701563070
  • Barth M.M. Deciphering Student Evaluations of Teaching: A Factor Analysis Approach. Journal of Education for Business. 2008; 84(1):40-46. (In Eng.)
  • DOI: 10.3200/JOEB.84.L40-46
  • Ginns P., Prosser M., Barrie S. Students' Perceptions of Teaching Quality in Higher Education: The Perspective of Currently Enrolled Students. Studies in Higher Education. 2007; 32(5):603-615. (In Eng.)
  • DOI: 10.1080/03075070701573773
  • Entwistle N. Promoting Deep Learning Through Teaching and Assessment: Conceptual Frameworks and Educational Contexts. [Electronic resource]. 2003. Available at: http://www.leeds.ac.uk/educol/docu-ments/00003220.htm (accessed 11.10.2019). (In Eng.)
  • Entwistle N., McCune V., Hounsell J. Approaches to Studying and Perceptions of University Teaching-Learning Environments: Concepts, Measures and Preliminary Findings. In: Occasional Report, 1. Evaluating faculty performance [Electronic resource]. 2002. Available at: https://www.semanticscholar.org/paper/Approaches-to-Studying-and-Perceptions-of-%3A-%2C-and-Entwistle-McCune/e371ce75da787bb4d-fe1c03c9917213d43ad6d36 (accessed 11.10.2019). (In Eng.)
  • McCune V. Final Year Biosciences Students' Willingness to Engage: Teaching-Learning Environments, Authentic Learning Experiences and Identities. Studies in Higher Education. 2009; 34(3):347-361. (In Eng.)
  • DOI: 10.1080/03075070802597127
  • Hativa N., Stanley C. Student Ratings of Instruction: Recognizing Effective Teaching. CreateSpace Independent Publishing Platform; 2013. (In Eng.)
  • Hinkin T.R. A Review of Scale Development Practices in the Study of Organizations. Journal of Management. 1995; 21(5):967-988. (In Eng.)
  • DOI: 10.1016/0149-2063(95)90050-0
  • Beran T., Violato C., Kline D., Frideres J. What Do Students Consider Useful about Student Ratings? Assessment & Evaluation in Higher Education. 2009; 34(5):519-527. (In Eng.) https://doi. org/
  • DOI: 10.1080/02602930802082228
  • Lemos M.S., Queiros C., Teixeira P.M., Menezes I. Development and Validation of a Theoretically Based, Multidimensional Questionnaire of Student Evaluation of University Teaching. Assessment & Evaluation in Higher Education. 2011; 36(7):843-864. (In Eng.)
  • DOI: 10.1080/02602938.2010.493969
  • Zhao J., Gallant D.J. Student Evaluation of Instruction in Higher Education: Exploring Issues of Validity and Reliability. Assessment & Evaluation in Higher Education. 2012; 37(2):227-235. (In Eng.)
  • DOI: 10.1080/02602938.2010.523819
  • Utriainen J., Tynjala P., Kallio E., Marttunen M. Validation of a Modified Version of the Experiences of Teaching and Learning Questionnaire. Studies in Educational Evaluation. 2018; 56:133-143. (In Eng.)
Еще
Статья научная