Opportunities for the consolidation of rating products in the internet environment

Автор: Balatsky Evgenii V., Ekimova Natalya A.

Журнал: Economic and Social Changes: Facts, Trends, Forecast @volnc-esc-en

Статья в выпуске: 2 (56) т.11, 2018 года.

Бесплатный доступ

The article reveals the experience of a project on consolidation of rating products within the single portal with related services for users. We describe the ideology of an open Internet platform, its structure and navigation, and specially designed analytical tools. We focus on the developed and tested trust index in relation to all the ratings on the website, which helps approach a possible solution to the problem of rating verification. We point out the fact that the proposed analytical verification tools are vulnerable to manipulation that is manifested in users' hostile attacks on selective ratings by giving the ratings deliberately low trust scores. The paper shows the relevance of the portal designed, which is manifested not only in the number of views of its content, but also in the public reaction to various ratings of both individuals and organizations. In addition, we disclose the experience of using academic ratings over the period of several years to reveal undesirable trends and emerging threats in the market of economic research...

Еще

Ratings, databases, modeling, verification

Короткий адрес: https://sciup.org/147224044

IDR: 147224044 | DOI: 10.15838/esc.2018.2.56.3

Список литературы Opportunities for the consolidation of rating products in the internet environment

Baty Ph. Measured, and found wanting more. Times Higher Education, 2010, July, 8. Available at: http://www.timeshighereducation.co.uk/story.asp?storycode=412341 (accessed: 21.02.2018).
Jobbins D. GLOBAL: First shots fired in ranking war. University World News, 2010, March 7. Available at: http://www.universityworldnews.com/article.php?story=20100305112613216 (accessed: 21.02.2018).
Borgans L., Covers F. The americanization of European higher education and research. Voprosy obrazovaniya=Educational Studies (Moscow), 2010, no. 2, pp. 5-44..
Parijs Ph. European higher education under the spell of university rankings. Ethical Perspectives, 2009, vol. 16, no. 2, pp. 189-206. Available at: http://cdn.uclouvain.be/public/Exports%20reddot/etes/documents/2009u.Rankings.pdf (accessed: 21.02.2018) DOI: 10.2143/EP.16.2.2041651
Smith D.N. The history behind universities, league tables and the brand. Global Opinion Survey. New Outlooks on Institutional Profiles, 2010, February. Available at: http://science.thomsonreuters.com/m/pdfs/Global_Opinion_Survey.pdf (accessed: 21.02.2018).
Aguillo I.F., Bar-Ilan J., Levene M., Ortega J.L. Comparing university rankings. Scientometrics, 2010, vol. 85, no. 1, pp. 243-256 DOI: 10.1007/s11192-010-0190-z
Van de Walle S. Publishing in Public administration: issues with defining, comparing and ranking the output of universities. International Public Management Journal, 2015, vol. 18, no. 1, pp. 87-107.
Gertler E., Mackin E., Magdon-Ismail M., Yi Y. Computing Manipulation of Ranking System. Istanbul, 2015. Available at: http://www.cs.rpi.edu/~xial/Files/GMMXYAAMAS15.pdf (accessed: 21.02.2018).
Arnold D.N., Fowler K.K. Nefarious numbers. Notices of the AMS, 2011, vol. 58, no. 3, pp. 434-437. Available at: http://www-users.math.umn.edu/~arnold/papers/impact-factors.pdf (accessed: 21.02.2018).
Alves A.D., Yanasse H.H., Soma N.Y. An analysis of bibliometric indicators to JCR according to Benford's law. Scientometrics, 2016, vol. 107, no. 3, pp.1489-1499 DOI: 10.1007/s11192-016-1908-3
Hammarfelt B., Rushforth A.D. Indicators as judgment devices: An empirical study of citizen bibliometrics in Research Evaluation. Research Evaluation, 2017, vol. 26, no. 3, pp.169-180 DOI: 10.1093/reseval/rvx018
Sverdlov E.D. Citation mirages. Bibliometric assessment of the impact of scientific publications of individual researchers. Vestnik Rossiiskoi akademii nauk=Herald of the Russian Academy of Sciences, 2006. vol. 76, no. 12, pp. 1073-1085..
Arskii Yu.M., Markusova V.A., Chumakova N.F. Earth sciences: volumes and ratings of Russian publications. Vestnik Rossiiskoi akademii nauk=Herald of the Russian Academy of Sciences. 2007, vol. 77, no. 10, pp. 887-895..
Donetskaya S.S. Analyzing the competitiveness of Russian universities in global ratings. Vysshee obrazovanie v Rossii=Higher education in Russia, 2014, no. 1, pp. 20-31..
Karminskii A.M., Polozov A.A. Entsiklopediya reitingov. Ekonomika, obshchestvo, sport . Moscow: Forum, 2016. 448 p.
Murav'ev A.A. On scientific value of Russian journals in economics and related disciplines. Voprosy ekonomiki=Issues of economics, 2013, no. 4, pp. 130-151..
Pislyakov V.V. Russian journals on social sciences in foreign databases. Ekonomicheskii zhurnal Vysshei shkoly ekonomiki=Higher School of Economics Economic Journal, 2011, vol. 15, no. 2, pp. 268-269..
Tret'yakova O.V. Ranking of scholarly journals of economic institutes of the Russian Academy of Sciences. Ekonomicheskie i sotsial'nye peremeny: fakty, tendentsii, prognoz=Economic and Social Changes: Facts, Trends, Forecast, 2015, no. 5, pp. 159-172. DOI: 10.15838/esc/2015.5.41.11
Rubinshtein A.Ya. Ranking of Russian economic journals: the scientific method or "numbers game"? Zhurnal Novoi ekonomicheskoi assotsiatsii=Journal of the New Economic Association, 2016, no. 2 (30), pp.162-175..
Burakov N.A., Slavinskaya O.A. Ranking of economic journals: sociological measurement. Vestnik Instituta ekonomiki Rossiiskoi akademii nauk=Bulletin of the Institute of Economics of the Russian Academy of Sciences, 2017, no. 1, pp.151-169..
Aleskerov F.T., Badgaeva D.N., Pislyakov V.V., Sterligov I.A., Shvydun S.V. An importance of Russian and international economic journals: a network approach. Zhurnal Novoi ekonomicheskoi assotsiatsii=Journal of the New Economic Association, 2016, no. 2 (30), pp.193-205..
Balatsky E.V., Ekimova N.A. The concentric model of Russian market for economic research. Mir novoi ekonomiki=The World of New Economy, 2017, vol. 11, no. 2, pp. 82-92..
Balatsky E.V., Ekimova N.A. Competition of economic journals in Russia: results of the three waves of ranking. Ekonomicheskaya politika=Economic Policy, 2017, vol. 12, no. 6, pp.178-201..
Balatsky E.V., Ekimova N.A. Russian model of pairing academic performance and educational potential of regions. Izvestiya UrGEU= Journal of the Ural State University of Economics, 2017, no. 5 (73), pp.109-127..
Moskovkin V.M., Sun Xingyuan. Economist rankings: modern state and prospects for future studies. Nauchnaya periodika: problemy i resheniya=Scholarly Communication Review, 2017, vol. 7, no. 1, pp. 20-45. DOI: 10.18334/nppir.7.1.38336..
Moskovkin V.M., Sun Xingyuan. Development of methods for determining the rankings of scientists based on the Russian Science Citation Index. Nauchno-tekhnicheskaya informatsiya. Seriya 1: Organizatsiya i metodika informatsionnoi raboty= Scientific and Technical Information Processing, 2017, no. 8, pp.23-28..
Sterligov I.A. Pilot project on evaluation of Russian scientific journals. Moscow: NIU VShE, 2014. Available at: http://slidegur.com/doc/225135/pilotnyj-proekt-vshe-po-e-kspertnoj-ocenke-rossijskih (accessed: 21.02.2018)..
Rubinshtein A.Ya., Burakov N.A., Slavinskaya O.A. Soobshchestvo ekonomistov i ekonomicheskie zhurnaly (sotsiologicheskie izmereniya VS bibliometrii): nauchnyi doklad . Moscow: Institut ekonomiki RAN, 2017. 83 p.
Murav'ev A.A. Ratings of Russian journals in economics: comparative analysis. 2015. Available at: http://studydoc. ru/download/4796527 (accessed: 21.02.2018)..
Subochev A.N. How different are the existing ratings of Russian economic journals and how to unify them? Zhurnal Novoi ekonomicheskoi assotsiatsii=Journal of the New Economic Association, 2016, no. 2 (30), pp. 181-192..
Balatsky E.V., Ekimova N.A. The problem of manipulation in the RSCI system. Vestnik UrFU. Seriya: Ekonomika i upravlenie=Bulletin of Ural Federal University. Series Economics and Management, 2015, no. 2, pp. 166-178..
Balatsky E.V., Yurevich M.A. The misalignment of Russian Economists' scientometric indicators in RISC. Zhurnal Novoi ekonomicheskoi assotsiatsii=Journal of the New Economic Association, 2016, no. 2 (30), pp. 176-180..

Еще

Статья научная