The impact rating of academic journals in economics: ranking criteria and methodology

The impact rating of academic journals in economics: ranking criteria and methodology

Автор: Tretyakova Olga V.

Журнал: Economic and Social Changes: Facts, Trends, Forecast @volnc-esc-en

Рубрика: Discussion platform

Статья в выпуске: 3 (57) т.11, 2018 года.

Бесплатный доступ

The rapid growth of the number of academic journals has brought to the fore the issue of choosing the leading ones among them. In this paper, we summarize current methodological approaches to the evaluation of scientific journals and substantiate the applicability of bibliometric indicators for assessing the impact of publications in the scientific community. The results of comparative assessment of economic journals affiliated with RAS institutions are presented in the form of impact rating based on the analysis of bibliometric data of the Russian Science Citation Index (RSCI) and reflecting the level of impact of publications included in the RSCI. We substantiate the composition of indicators that enable us to make a comprehensive assessment of journals and that are available to be used to verify the results. We prove that the composition of the criteria and the method of their aggregation are suitable for ranking scientific journals; this is confirmed by the fact that the results correlate with the data of other ratings...

Еще

Impact rating of scientific journals, economic journal, russian academy of sciences, bibliometric index, journal impact factor, authority of the journal, russian science citation index (rsci)

Короткий адрес: https://sciup.org/147224054

IDR: 147224054   |   DOI: 10.15838/esc.2018.3.57.12

Список литературы The impact rating of academic journals in economics: ranking criteria and methodology

  • Balatsky E.V., Ekimova N.A. Opportunities for the consolidation of rating products in the Internet environment. Ekonomicheskie i sotsial'nye peremeny: fakty, tendentsii, prognoz=Economic and Social Changes: Facts, Trends, Forecast, 2018, vol. 11, no. 2, pp. 37-51. DOI: 10.15838/esc.2018.2.56.3
  • Kotlyarov I.D. Principles of evaluating the quality of scientific journals. Obrazovanie i nauka= Education and science, 2010, no. 8 (76), p. 419..
  • Tret'yakova O.V. Ranking of scholarly journals of economic institutes of the Russian Academy of Sciences. Ekonomicheskie i sotsial'nye peremeny: fakty, tendentsii, prognoz=Economic and Social Changes: Facts, Trends, Forecast, 2015, no. 5 (41), pp. 159-172. DOI: 10.15838/esc/2015.5.41.11
  • Liner G. H., Amin M. Methods of ranking economics journals. Atlantic Economic Journal, 2004, vol. 32, no. 2, pp. 140-149 DOI: 10.1007/BF02298831
  • Hawkins R.G., Ritter L.S., Walter I. What economists think of their journals. The Journal of Political Economy, 1973, vol. 81, no. 4, pp. 1017-1032.
  • Bush W.C., Hamelman P.W., Staaf R.J. A quality index for economics journals. The Review of Economics and Statistics, 1974, vol. 51, no. 1, pp. 123-125.
  • Liebowitz S.J., Palmer J.P. Assessing the relative impacts of economics journals. Journal of Economic Literature, 1984, no. 32, pp. 77-88.
  • Laband D., Piette M. The relative impacts of economics journals: 1970-1990. Journal of Economic Literature, 1994, no. 32, pp. 640-666.
  • Stigler G.J., Stigler S.M., Friedland C. The journals of economics. Journal of Political Economy, 1995, vol. 103, no. 2, pp. 331-359.
  • Liner G.H. Core journals in economics. Economic Inquiry, 2002, vol. 40, no. 1, pp. 138-145.
  • Bornmann L., Haunschild R. Plots for visualizing paper impact and journal. Scientometrics, 2018, vol. 115, no. 1, pp. 385-394 DOI: 10.1007/s11192-018-2658-1
  • Glänzel W., Moed H.F. Journal impact measures in bibliometric research. Scientometrics, 2002, vol. 53, no. 2, pp. 171-193 DOI: 10.1023/A:1014848323806
  • Aukutsionek S., Churkina G. Economic journals during the period of market reforms. Voprosy ekonomiki=Economics Issues, 2002, no. 2, pp.130-145..
  • Dezhina I.G., Dashkeev V.V. Est' li v Rossii vedushchie ekonomisty i kto oni? Moscow: IEPP, 2008. 21 p.
  • Murav'ev A.A. On the scientific impact of Russian journals in economics and related disciplines. Voprosy ekonomiki=Economics Issues, 2013. № 4. S. 130-151..
  • Proekt NIU VShE po ekspertnomu ranzhirovaniyu rossiiskikh nauchnykh zhurnalov . Moscow: Upravlenie akademicheskoi ekspertizy NIU VShE. 2015. Available at: http://www.hse.ru/academexpert/journals.
  • Rubinshtein A.Ya. Russian economic journals: the table of ranks. Ekonomicheskaya nauka sovremennoi Rossii=Economics of Contemporary Russia, 2018, no. 1, pp. 108-130..
  • Balatsky E.V., Ekimova N.A. Experience in rating Russian economic journals. Voprosy ekonomiki=Economics Issues, 2015, no. 8, pp. 99-115..
  • Aleskerov F.T., Badgaeva D.N., Pislyakov V.V., Strerligov I.A., Shvydun S.V. An importance of Russian and international economic journals: a network approach. Zhurnal novoi ekonomicheskoi assotsiatsii=The Journal of the New Economic Association, 2016, no. 2 (30), pp. 193-205..
  • Subochev A.N. How different are the existing ratings of Russian economic journals and how to unify them? Zhurnal novoi ekonomicheskoi assotsiatsii=The Journal of the New Economic Association, 2016, no. 2 (30), pp. 181-192..
  • Balatsky E.V., Ekimova N.A. Russian economic journal consensus ranking: ideology and experience of making up. Zhurnal institutsional'nykh issledovanii=Journal of Institutional Studies, 2018, vol. 10, no. 1, pp. 93-106. DOI: 10.17835/2076-6297.2018.10.1.093-106
  • Rubinshtein A.Ya. Ranking of Russian economic journals: the scientific method or "numbers game"? Zhurnal novoi ekonomicheskoi assotsiatsii=The Journal of the New Economic Association, 2016, no. 2 (30), pp. 162-175..
  • Gumerov R.R. Again about the scientific significance of Russian economic journals, or what is behind the attempts to rank them. EKO=ECO Journal, 2017, no. 7, pp. 146-161..
  • Merton R.K. The sociology of science: an episodic memoir. In: Merton R., Gaston J. (Eds.). The Sociology of Science in Europe. Carbondale: Southern Illinois University Press, 1977. Pp. 3-141.
  • Garfield E. Citation indexing. Its Theory and Application in Science, Technology and Humanities. New York: Wiley, 1979. 274 p.
  • Gilbert G.N. Referencing as persuasion. Social Studies of Science, 1977, vol. 7, no. 1, pp. 113-122.
  • Martin B.R., Irvine J. Assessing basic research: some partial indicators of scientific progress in radio astronomy. Research Policy, 1983, vol. 12, no. 2, pp. 61-90.
  • Zuckerman H. Citation analysis and the complex problem of intellectual influence. Scientometrics, 1987, vol. 12, no. 56, pp. 329-338.
  • Cole S., Cole J.R. Scientific output and recognition. A study in the operation of the reward system in science. American Sociological Review, 1967, vol. 32, pp. 377-390.
  • Moed H.F. Citation analysis in recourse evaluation. In: Information Science and Knowledge Management. Springer, 2005. Vol. 9. 346 p.
  • Garfield E., Sher I.H. New factors in the evaluation of scientific literature through citation indexing. American Documentation, 1963, vol. 14, no. 3, pp. 195-201.
  • Bornmann L., Marx W., Gasparyan A.Y., Kitas G.D. Diversity, value and limitations of the journal impact factor and alternative metrics. Rheumatology International, 2012, vol. 32, no. 7, pp. 1861-1867.
  • Bornmann L. Scientific peer review. Annual Review of Information Science and Technology, 2011, vol. 45, no. 1, pp. 199-245 DOI: 10.1002/aris.2011.1440450112
  • Garfield E. Citation indexes to science: a new dimension in documentation through association of ideas. Science, 1955, vol. 122, pp. 108-111.
  • Bornmann L., Haunschild R. Plots for visualizing paper impact and journal impact of single researchers in a single graph. Scientometrics, 2018, vol. 115, no. 1, pp. 385-394 DOI: 10.1007/s11192-018-2658-1
  • Hoeffel C. Journal impact factors (letter). Allergy, 1998, vol. 53, no. 12, p. 1225.
  • Rousseau R.L. Journal evaluation: technical and practical issues. Library Trends, 2002, vol. 50, no. 3, pp. 418-439.
  • Aksnes D.W., Sivertsen G. The effect of highly cited papers on national citation indicators. Scientometrics, 2004, vol. 59, no. 2, pp. 213-224.
  • Garfield E. The 100 most-cited papers ever and how we select citation classics. Current Contents, 1984, no. 27, pp. 3-9.
  • Glänzel W., Schubert A. Some facts and figures on highly cited papers in the sciences, 1981-1985. Scientometrics, 1992, vol. 25, no. 3, pp. 373-380 DOI: 10.1007/BF02016926
  • Tijssen R.J.W., Visser M.S., van Leeuwen T.N. Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? Scientometrics, 2002, vol. 54, no. 3, pp. 381-397 DOI: 10.1023/A:1016082432660
  • Kotsemir M.N. Dynamics of Russian and world science through the prism of international publications. Forsait=Foresight, 2012, vol. 6, no. 1, pp. 38-59..
  • Pislyakov V.V. Bibliometric indicators in resources of Thomson Reuters. Rukovodstvo po naukometrii: indikatory razvitiya nauki i tekhnologii . Yekaterinburg, 2014. Pp. 75-109.
  • Tret'yakova O.V. Economic journal in Russia: quality assessment issues. Ekonomicheskie i sotsial'nye peremeny: fakty, tendentsii, prognoz=Economic and Social Changes: Facts, Trends, Forecast, 2016, no. 2 (44), pp. 211-224. DOI: 10.15838/esc.2016.2.44.13
Еще
Статья научная
QR-код для установки приложения SciUp Наведите камеру и скачайте бесплатное приложение SciUp