Efficiency of state policy in the field of science and technology in the Russian Federation: assessment methodology and approbation results
Автор: Vasilyeva I.N., Rozova O.I., Korneeva N.D., Bogatova R.S.
Журнал: Economic and Social Changes: Facts, Trends, Forecast @volnc-esc-en
Рубрика: Theoretical and methodological issues
Статья в выпуске: 6 т.16, 2023 года.
Бесплатный доступ
The article presents a methodology for evaluating the efficiency of measures and tools of state policy in the field of science and technology. The approach was developed and tested in order to improve the mechanism for monitoring the achievement of strategic goals of Russia’s scientific and technological development discussed at the meeting of the Presidential Council for Science and Education on February 8, 2023. The implementation of this direction is of great importance for ensuring technological sovereignty of the country. In the course of the research we used general scientific methods: analysis, synthesis and generalization, observation, comparison, measurement, grouping. Statistical methods such as correspondence analysis and cluster analysis were also used to implement the main task. The assessment was carried out in three directions: effectiveness assessment, assessment of the growth rate of targets, and assessment of the relevance of measures and tools of state policy in the field of science and technology by the scientific community. Based on these criteria, a set of data and a conclusion on the efficiency of public policy tools and measures were formed. The results obtained indicate the average efficiency of the tools and measures of state policy in terms of their effectiveness and relevance. The growth rates of most indicators are characterized by negative dynamics. This is primarily due to the fact that during the second stage of the implementation of the scientific and technological development strategy, restrictions caused by coronavirus infection were introduced, and we should also point out an increase in sanctions pressure.
Efficiency assessment, state policy in the field of science and technology, state policy measures, target indicators, effectiveness, scientific and technological development
Короткий адрес: https://sciup.org/147242464
IDR: 147242464 | DOI: 10.15838/esc.2023.6.90.9
Текст научной статьи Efficiency of state policy in the field of science and technology in the Russian Federation: assessment methodology and approbation results
In the context of Russia’s sharply increased isolation from global markets, it is important to evaluate the effectiveness of existing tools and mechanisms implemented by the state and aimed at ensuring the country’s technological sovereignty. Do the tools applied meet current challenges facing Russia? To what extent are the projects attractive to potential participants and sources of extrabudgetary funding? Are these tools and mechanisms effective in terms of socio-economic impact and for society as a whole?
In 2016, the Russian Government took steps to implement the instruction of the RF President regarding the formation of the country’s sovereignty:
the Russian Federation must be ready to compete with leading countries in the development of science and technology, as it is a matter of its sovereignty1. The Strategy for Scientific and Technological Development of the Russian Federation (hereinafter – the Strategy)2 was developed and approved, defining priority directions, for the implementation of which a set of support measures was adopted to strengthen and promote the development of Russian scientific and engineering research groups working at the forefront of science. The effectiveness of the proposed support measures and the development of evaluation methods became an immediate concern due to the lack of relevant measures to support scientific schools and developments in the new economic environment during the Strategy’s development.
The Strategy is being implemented in stages that correspond to the development of the Russian Federation’s economy and budgetary system. Indicators have been established for each stage to reflect progress and results. Starting in 2020, the second stage is being implemented (2020–2025). This stage will assess the measures implemented to stimulate the transition to the stage of active commercialization of the results of intellectual activity and the large-scale creation of new products and services based on technologies that meet significant challenges.
The purpose of the study is to develop a methodology for assessing the effectiveness of measures and instruments of the state science and technology policy outlined in the Strategy, as well as to test the methodology proposed, considering the degree of implementation of measures by the co-implementers of the Strategy and the applicability of specific results. The ultimate goal is to ensure the independence and competitiveness of the Russian Federation.
The methodology for assessing the effectiveness of measures and instruments of the state policy in the field of science and technology in the Russian Federation (hereinafter – the Methodology) was developed in 2023, when it became possible to analyze the results of the application of support measures proposed in 2016 and later. The assessment of the effectiveness of measures covers several years, during which project support measures were implemented and dynamics in each direction were analyzed.
The Methodology includes the assessment of state policy directions (measures) and expected results based on the monitoring data of the implementation of the action plan for the Strategy realization (hereinafter – the Plan) of the first stage (2017–2019), as well as the transition period of 2020–2022, including the relevant instructions of the RF President and Government. Currently, the Plan is not used to monitor the implementation of scientific and technological development activities.
The calculation also includes target indicators of scientific and technological development, the dynamics of which are subject to monitoring3. The results of the analysis of achievement of the Strategy target indicators, along with other resulting indicators, reflect the effectiveness of measures and instruments of the state policy in the field of science and technology4.
The assessment considered the scientific community’s opinion based on the use of the Strategy’s tools and activities by the university and scientific community. In 2021–2022, the Russian Research Institute of Economics, Politics and Law in Science and Technology (RIEPL) conducted a sociological survey commissioned by the Ministry of Education and Science of Russia. The survey aimed to investigate the scientific and university community’s attitude toward the implementation of science and technology policy mechanisms and tools that received funding from the federal budget as part of the Strategy (Vasilyeva et al., 2022).
Thus, the results of the analysis of the effectiveness of measures to support scientific and technological development, outlined in the Strategy, based on the proposed Methodology will allow identifying the trends of accelerated/delayed development of a particular technological area. This information can be used to develop sustainable state policy approaches, taking into account the effectiveness of their activities in the context of global challenges and ongoing economic and foreign policy changes.
Список литературы Efficiency of state policy in the field of science and technology in the Russian Federation: assessment methodology and approbation results
- Bach L. et al. (1995). Evaluation of the economic effects of Brite-Euram programmes on the European industry. Scientometrics. DOI: 10.1007/BF02018003
- Barré R. (2001). Policy-making processes and evaluation tools: S&T indicators. In: Science and Technology Policy. Vol. II. Policy-Making Processes and Evaluation Tools: S&T Indicators. Available at: http://eolss.net/Sample-Chapters/C15/E1-30-04-01.pdf (accessed: September 14, 2023).
- Bloch C. (2007). Assessing recent developments in innovation measurement: The third edition of the Oslo Manual. Science and Public Policy, 34(1), 23–34. DOI: https://doi.org/10.3152/030234207X190487
- Breusova A.G. (2015). Evaluation of the effectiveness of state programs. Vestnik Omskogo universiteta. Seriya: Ekonomika=Herald of Omsk University. Series “Economics”, 2, 128–136 (in Russian).
- Caetano I. (2017). Innovation, Evaluation and Measurement: Macro-Level and Firm-Level Perspectives. DOI: 10.1057/978-1-137-55577-9_7
- Dmitrenko M.A. (2018). Features of scientific and technical policy in Russia. Gosudarstvennoe i munitsipal’noe upravlenie. Uchenye zapiski=State and Municipal Management. Scholar Notes, 2, 227–231. DOI: 10.22394/2079-1690-2018-1-2-227-231 (in Russian).
- Gokhberg L.M., Gershman M.A., Lapochkina V.V. et al. (2023). Delaem nauku v Rossii: reiting mer nauchno-tekhnicheskoi politiki [Doing Science in Russia: Rating of Science and Technology Policy Measures]. NIU VSHE. Available at: https://issek.hse.ru/news/page2.html (accessed: September 13, 2023).
- Kuhlmann S. (1996). Evaluation as a Medium of Science & Technology Policy: Recent Developments in Germany and Beyond. Available at: https://www.oecd.org/science/inno/1823592.pdf (accessed: September 14, 2023).
- Kuhlmann S. (2003). Evaluation of research and innovation policies: A discussion of trends with examples from Germany. Journal of Technology Management, 26(2-4), 131–49. Available at: https://www.researchgate.net/profile/Stefan-Kuhlmann/publication/46671429_Evaluation_of_research_and_innovation_policies_A_discussion_of_trends_with_examples_from_Germany/links/0c96051ed410f21139000000/Evaluation-of-research-and-innovation-policies-A-discussion-of-trends-with-examples-from-Germany.pdf (accessed: September 14, 2023).
- Lepori B., Reale E. (2012). S&T indicators as a tool for formative evaluation of research programs. Evaluation, 18(4), 451–465. DOI: https://doi.org/10.1177/1356389012460961
- Luo L.P. (2012). A review of the Chinese National Center for Science and Technology Evaluation. Journal of MultiDisciplinary Evaluation (JMDE: 3), 197–199. Available at: https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/111/126 (accessed: September 14, 2023).
- Luukkonen T. (1997). The difficulties in assessing the impact of EU framework programs. Research Policy, 27(6), 599–610. DOI: https://doi.org/10.1016/S0048-7333(98)00058-4
- Malinetskii G.G. (2021). Science and development strategy of Russia. Znanie. Ponimanie. Umenie=Knowledge. Understanding. Skill, 3, 26–44. DOI: 10.17805/zpu.2021.3.2. EDN XFIPED (in Russian).
- Onishchenko G.G., Kablov E.N., Ivanov V.V. (2022). Scientific and technological development of Russia in the context of achieving national goals: Problems and solutions. Innovatsii=Innovations, 6(260), 3–16. DOI: 10.26310/2071-3010.2020.260.6.001 (in Russian).
- Rykova I.N. (2013). Approaches to determining the performance of research and development activities in Russia. Finansovyi zhurnal=Financial Journal, 3(17), 73–88 (in Russian).
- Sanz Menéndez L. at al. (1997). Science and Technology Policy Evaluation in the Context of Advanced S&T Policy Planning. Available at: https://digital.csic.es/bitstream/10261/2038/1/science_technology.pdf (accessed: September 14, 2023).
- Sanz Menéndez L. at al. (2005). Explaining the science and technology policies of regional governments. In: Serie Documentos de Trabajo, Instituto de Políticas y Bienes Públicos (CSIC), 10-2005. Available at: http://hdl.handle.net/10261/1644 (accessed: September 14, 2023).
- Tanaka K., Sakata I. (2017). New Science and Technology Policy Evaluation Using Bibliometric Approach. DOI: 10.23919/PICMET.2017.8125259
- Tulyakova I.V. (2017). Assessing the efficiency of government programs: problems and prospects. Finkontrol’, 4. Available at: https://rufincontrol.ru/online/article/332551/(accessed: September 14, 2023; in Russian).
- Vasilyeva I.N., Kris’ko M.O., Korneeva N.D. et al. (2022). The relevance of the tools and mechanisms created during the implementation of the action plan of the strategy of scientific and technological development of the Russian federation and the impact of the proposed measures on the socio-economic development of the Russian Federation. Sotsiologiya nauki i tekhnologii=Sociology of Science and Tchnology, 13(3), 118–142. DOI: 10.24412/2079-0910-2022-3-118-142 (in Russian).
