Assessing the teaching quality of economics programme: instructor course evaluations
Автор: Hysa Eglantina, Ur Rehman Naqeeb
Журнал: Интеграция образования @edumag-mrsu
Рубрика: Модернизация образования
Статья в выпуске: 4 (97), 2019 года.
Бесплатный доступ
Introduction. In recent years, measuring the efficiency and effectiveness of higher education has become a major issue. Most developed countries are using national surveys to measure teaching and assessment as key determinants of students' approaches to learning which have direct effect on the quality of their learning outcomes. In less developed countries, there does not exist a national survey. This paper aims to propose an original questionnaire assessing the teaching quality. The specifics of this questionnaire, termed as the Instructor Course Evaluation Survey, is that it addresses three main dimensions, such as: Learning Resources, Teaching Effectiveness, and Student Support. Materials and Methods. The paper opted for an analytic study using 3,776 completed questionnaires. This is a case study applied to the students enrolled in economics program in a private university in Albania. The Instructor Course Evaluation Survey design was supported by the literature review, identifying the three main dimensions included in the questionnaire. The reliability was tested with Cronbach's alpha and with Confirmatory Factor Analysis. The use of Confirmatory Factor Analysis helps in identifying issues of multi-dimensionality in scales. Results. The paper provides empirical insights into the assessing methodology and brings a new model of it. The finding suggests that Learning Resources, Teaching Effectiveness and Student Support increase the quality of teaching. Because of the chosen research target group, students from economics program, the research results may not be generalizable. Therefore, researchers are encouraged to test the proposed statements further. Discussion and Conclussion. The paper includes implications for the development of a simple and useful questionnaire assessing the quality of teaching. Although Instructor Course Evaluation Survey was applied specifically to economics program, the proposed questionnaire can be broadly applied. This paper fulfills an identified need to propose an original and simple questionnaire to be used from different universities and programs to measure the quality of teaching.
Course evaluation, higher education, quality of teaching, economics program, confirmatory factor analysis
Короткий адрес: https://sciup.org/147220726
IDR: 147220726 | DOI: 10.15507/1991-9468.097.023.201904.556-567
Текст научной статьи Assessing the teaching quality of economics programme: instructor course evaluations
According to the Standards and Guidelines for Quality Assurance in the European Higher Education Area1, ‘universities have to review their programs on a regular basis ensuring their compliance with international aims meeting learners’ and social needs, especially on quality assurance’. The academic knowledge and skills followed by concrete examples directly linked to the real world persist to be crucial issues to be absorbed and transmitted to students as learning tools and added value [1].
Stergiou and Airey and Darwin state that ‘the systems for the evaluation of teaching and course quality in higher education in-

ity [10]. They are often an important part of accreditation processes too. Marsh, Paulsen and Richardson suggest that ‘student ratings demonstrate acceptable psychometric properties which can provide important evidence for educational research’ [11–13].
The Law no. 9741, dated 21.05.2007 for the higher education made some new establishments with respect to administration, organization and financial aspect to improve quality of Albanian HEIs in alignment with the European Standards2. Even though further amendments to this were carried out, Law no. 9832, dated 12.11.2007 and Law no. 10 307, dated 22.07.2010, again there were concerns related to quality weaknesses in the HEIs3.
The new Law No. 80, dated 17.09.2015, “On Higher Education and Scientific Research in Higher Education Institutions of the Republic of Albania”, would enforce the establishment of the internal and external mechanisms on quality control in each institution4. Article 103/3 of this law states that each institution must spread and collect questionnaires before the final exams of each semester in order to track data regarding quality of teaching within the programs.
In 2014, the Ministry of Education and Sport of Albania and the Quality Assurance Agency for Higher Education (QAA) in the UK signed a Memorandum of Understanding and during 2016–2017, all the 35 HEIs in Albania, both public and private, entered the process of institutional accreditation5. One of the standards that the HEI has to fulfill is the “Study programmes are subject to their continuous improvement to increase quality”, and the concrete examples of this standard are as following:
-
1. Lecturers are regularly assessed by institution structures that pursue qualitative implementation of study programmes.
-
2. Students are involved in evaluation of lecturers and study programme implementation.
-
3. Outcomes of examinations and competitions are published.
-
4. Study programmes are improved by taking into account the outcomes of their evaluation by academic staff and students.
-
5. Study programmes quality is evaluated also by statistics of employment of graduates in the relevant study programme6.
Even though the evaluation of study programs is a requirement, systematic data collection and evaluation process is not well established in most of the Albanian universities. Hoxhaj and Hysa in 2015 stated that the main and the most difficult challenge for the HEIs in Albania is the improvement of controlling, monitoring and reviewing quality assurance in universities. Many public and private universities are not accomplishing the standards of existence and are still operating in educative market [14].

Motivated from the requirements to measure the teaching and course quality and a lack of instructor evaluation survey analysis in the Albanian higher education system, this study provides a useful starting point for the purpose of the present investigation. This is the first study of this kind conducted for any Albanian university. Epoka University (EU) is one of the leading universities in Albania, which is often included in the list of top three universities of this country7. This is the main reason for selecting EU as a case study. Secondly, this study can serve as a good practice, and the survey can be proposed as a quality measurement tool to the other higher education institutions of this region.
More specifically, this study is conducted for the economics program of the first cycle of study. The research focuses on a general literature review regarding the usage of different surveys and the variety of dimensions they include. A special part of the literature covers some previous studies that have used similar methods of analyzing the students’ surveys. The second part is devoted to the methodology used and data collection for our survey. The next session includes the descriptive statistics, which help to measure the reliability and internal consistency by using Cronbach’s alpha, and the Confirmatory Factor Analysis (CFA) to investigate the correlation between dimensions of the survey. Finally, the conclusions, discussions and study limitation takes place.
Список литературы Assessing the teaching quality of economics programme: instructor course evaluations
- Hysa E. Defining a 21st Century Education: Case Study of Development and Growth Course. Mediterranean Journal of Social Sciences. 2014; 5(2):41-46. (In Eng.) DOI: 10.5901/mjss.2014.v5n2p41
- Stergiou D.P., Airey D. Using the Course Experience Questionnaire for Evaluating Undergraduate Tourism Management Courses in Greece. Journal of Hospitality, Leisure, Sport & Tourism Education. 2012; 11(1):41-49. (In Eng.) DOI: 10.1016/j.jhlste.2012.02.002
- Darwin S. Moving Beyond Face Value: Re-Envisioning Higher Education Evaluation as a Generator of Professional Knowledge. Assessment & Evaluation in Higher Education. 2012; 37(6):733-745. (In Eng.) DOI: 10.1080/02602938.2011.565114
- Clayson D.E., Haley D.A. Are Students Telling Us the Truth? A Critical Look at the Student Evaluation of Teaching. Marketing Education Review. 2011; 21(2):101-112. (In Eng.) 10.2753/ MER1052-8008210201 DOI: 10.2753/MER1052-8008210201
- Kuzmanovic M., Savic G., Gusavac B.A., Makajic-Nikolic D., Panic B. A Conjoint-Based Approach to Student Evaluations of Teaching Performance. Expert Systems with Applications. 2013; 40(10):4083-4089. (In Eng.) DOI: 10.1016/j.eswa.2013.01.039
- Surgenor P.W. Obstacles and Opportunities: Addressing the Growing Pains of Summative Student Evaluation of Teaching. Assessment & Evaluation in Higher Education. 2013; 38(3):363-376. (In Eng.)
- DOI: 10.1080/02602938.2011.635247
- Shevlin M., Banyard P., Davies M., Griffiths M. The Validity of Student Evaluation of Teaching in Higher Education: Love Me, Love My Lectures? Assessment & Evaluation in Higher Education. 2000; 25(4):397-405. (In Eng.)
- DOI: 10.1080/713611436
- Oon P.T., Spencer B., Kam C.C.S. Psychometric Quality of a Student Evaluation of Teaching Survey in Higher Education. Assessment & Evaluation in Higher Education. 2017; 42(5):788-800. (In Eng.)
- DOI: 10.1080/02602938.2016.1193119
- Nasser F., Fresko B. Faculty Views of Student Evaluation of College Teaching. Assessment & Evaluation in Higher Education. 2002; 27(2):187-198. (In Eng.)
- DOI: 10.1080/02602930220128751
- Hammonds F., Mariano G.J., Ammons G., Chambers S. Student Evaluations of Teaching: Improving Teaching Quality in Higher Education. Perspectives: Policy and Practice in Higher Education. 2017; 21(1):26-33. (In Eng.)
- DOI: 10.1080/13603108.2016.1227388
- Marsh H.W. Students' Evaluations of University Teaching: Research Findings, Methodological Issues, and Directions for Future Research. International Journal of Educational Research. 1987; 11(3):253-388. (In Eng.)
- DOI: 10.1016/0883-0355(87)90001-2
- Paulsen M.B. Evaluating Teaching Performance. New Directions for Institutional Research. Special Issue: Evaluating Faculty Performance. 2002; (114):5-18. (In Eng.)
- DOI: 10.1002/ir.42
- Richardson J.T. Instruments for Obtaining Student Feedback: A Review of the Literature. Assessment & Evaluation in Higher Education. 2005; 30(4):387-415. (In Eng.) https://doi. org/
- DOI: 10.1080/02602930500099193
- Hoxhaj J., Hysa E. Comparing ENQA, British, German & Albanian Standards of Quality in Higher Education. European Journal of Sustainable Development. 2015; 4(2):243-258. (In Eng.) http://dx.doi. org/
- DOI: 10.14207/ejsd.2015.v4n2p243
- Bassi F., Clerici R., Aquario D. Students' Evaluation of Teaching at a Large Italian University: Validation of Measurement Scale. Electronic Journal of Applied Statistical Analysis. 2017; 10(1):93-117. (In Eng.)
- DOI: 10.1285/i20705948v10n1p93
- Newton J. What is Quality? In: Embedding Quality Culture in Higher Education. A Selection of Papers from the 1st European Forum for Quality Assurance (23-25 November 2006, Germany) / L. Bollaert, S. Brus, B. Curvale, et al. (Eds.). 2007. p. 14-24. Avaiable at: https://enqa.eu/indirme/papers-and-reports/associated-reports/EUA_QA_Forum_publication.pdf (accessed 11.10.2019). (In Eng.)
- Spooren P., Brockx B., Mortelmans D. On the Validity of Student Evaluation of Teaching: The State of the Art. Review of Educational Research. 2013; 83(4):598-642. (In Eng.)
- DOI: 10.3102/0034654313496870
- Marsh H.W. SEEQ: A Reliable, Valid, and Useful Instrument for Collecting Students' Evaluations of University Teaching. British Journal of Educational Psychology. 1982; 52(1):77-95. (In Eng.) https://
- DOI: 10.1111/j.2044-8279.1982.tb02505.x
- Marsh H.W., Muthen B., Asparouhov T., Liidtke O., Robitzsch A., Morin A.J. et al. Exploratory Structural Equation Modeling, Integrating CFA and EFA: Application to Students' Evaluations of University Teaching. Structural Equation Modeling: A Multidisciplinary Journal. 2009; 16(3):439-476. (In Eng.)
- DOI: 10.1080/10705510903008220
- Coffey M., Gibbs G. The Evaluation of the Student Evaluation of Educational Quality Questionnaire (SEEQ) in UK Higher Education. Assessment & Evaluation in Higher Education. 2001; 26(1):89-93. (In Eng.)
- DOI: 10.1080/02602930020022318
- Kember D., Leung D.Y. Establishing the Validity and Reliability of Course Evaluation Questionnaires. Assessment & Evaluation in Higher Education. 2008; 33(4):341-353. (In Eng.)
- DOI: 10.1080/02602930701563070
- Barth M.M. Deciphering Student Evaluations of Teaching: A Factor Analysis Approach. Journal of Education for Business. 2008; 84(1):40-46. (In Eng.)
- DOI: 10.3200/JOEB.84.L40-46
- Ginns P., Prosser M., Barrie S. Students' Perceptions of Teaching Quality in Higher Education: The Perspective of Currently Enrolled Students. Studies in Higher Education. 2007; 32(5):603-615. (In Eng.)
- DOI: 10.1080/03075070701573773
- Entwistle N. Promoting Deep Learning Through Teaching and Assessment: Conceptual Frameworks and Educational Contexts. [Electronic resource]. 2003. Available at: http://www.leeds.ac.uk/educol/docu-ments/00003220.htm (accessed 11.10.2019). (In Eng.)
- Entwistle N., McCune V., Hounsell J. Approaches to Studying and Perceptions of University Teaching-Learning Environments: Concepts, Measures and Preliminary Findings. In: Occasional Report, 1. Evaluating faculty performance [Electronic resource]. 2002. Available at: https://www.semanticscholar.org/paper/Approaches-to-Studying-and-Perceptions-of-%3A-%2C-and-Entwistle-McCune/e371ce75da787bb4d-fe1c03c9917213d43ad6d36 (accessed 11.10.2019). (In Eng.)
- McCune V. Final Year Biosciences Students' Willingness to Engage: Teaching-Learning Environments, Authentic Learning Experiences and Identities. Studies in Higher Education. 2009; 34(3):347-361. (In Eng.)
- DOI: 10.1080/03075070802597127
- Hativa N., Stanley C. Student Ratings of Instruction: Recognizing Effective Teaching. CreateSpace Independent Publishing Platform; 2013. (In Eng.)
- Hinkin T.R. A Review of Scale Development Practices in the Study of Organizations. Journal of Management. 1995; 21(5):967-988. (In Eng.)
- DOI: 10.1016/0149-2063(95)90050-0
- Beran T., Violato C., Kline D., Frideres J. What Do Students Consider Useful about Student Ratings? Assessment & Evaluation in Higher Education. 2009; 34(5):519-527. (In Eng.) https://doi. org/
- DOI: 10.1080/02602930802082228
- Lemos M.S., Queiros C., Teixeira P.M., Menezes I. Development and Validation of a Theoretically Based, Multidimensional Questionnaire of Student Evaluation of University Teaching. Assessment & Evaluation in Higher Education. 2011; 36(7):843-864. (In Eng.)
- DOI: 10.1080/02602938.2010.493969
- Zhao J., Gallant D.J. Student Evaluation of Instruction in Higher Education: Exploring Issues of Validity and Reliability. Assessment & Evaluation in Higher Education. 2012; 37(2):227-235. (In Eng.)
- DOI: 10.1080/02602938.2010.523819
- Utriainen J., Tynjala P., Kallio E., Marttunen M. Validation of a Modified Version of the Experiences of Teaching and Learning Questionnaire. Studies in Educational Evaluation. 2018; 56:133-143. (In Eng.)