Expert assessment as a key element of the procedure for evaluation the efficiency of scientific institutions of the NAS Ukraine

Artiushenko Viktor
PhD, Senior Researcher, State Institution “Center for Evaluation of Activity of Research Institutions and Scientific Support of Regional Development of Ukraine of the National Academy of Sciences of Ukraine”, Kyiv, E-mail:artiushenko@gmail.com, ORCID ID: https://orcid.org/0000-0003-3454-9264

Stupina Lada
PhD, Senior Researcher, State Institution “Center for Evaluation of Activity of Research Institutions and Scientific Support of Regional Development of Ukraine of the National Academy of Sciences of Ukraine”, Kyiv, E-mail:stupinalv@nas.gov.ua, ORCID ID: https://orcid.org/0000-0002-5082-0862

Cite this article:

Artiushenko V., Stupina L. (2023) Expert assessment as a key element of the procedure for evaluation the efficiency of scientific institutions of the NAS Ukraine. Ed.: V.V. Kovalenko (ed.-in-ch.) and others [Ekspertna otsinka yak kliuchovyi element protsedury otsiniuvannia efektyvnosti diialnosti naukovykh ustanov NAN Ukrainy; za red.: V.V. Kovalenko (gol. red.)], Scientific Bulletin of the Odessa National Economic University (ISSN 2313-4569), Odessa National Economics University, Odessa, No. 1-2 (302-303), pp. 46-52.

Abstract

The article shows that the procedure for evaluating the results of the activities of scientific institutions is the most important mechanism for determining the results of the activities of scientific institutions in a number of world countries. The article shows the importance of the procedure for evaluating the effectiveness of scientific institutions as a whole. It has been proven that the main approaches in the assessment procedure are quantitative and qualitative. A comparative analysis of the use of the quantitative method of evaluating the effectiveness of scientific institutions with the qualitative (expert) method was carried out. It is shown that the approach to determining the effectiveness of scientific research activities should be comprehensive and based on both expert – qualitative – assessments and quantitative – scientometric and bibliometric indicators. It was determined that the introduction of expert evaluation into the general procedure for evaluating the effectiveness of scientific institutions of the National Academy of Sciences of Ukraine stimulates the development of a new model of financing individual divisions and institutions of the National Academy of Sciences of Ukraine as a whole. In addition, it has been proven that the implementation of the evaluation procedure stimulates the development of a new model of financing academic units and institutions as a whole, which is an important step on the way to reform and further development of the Academy.

Keywords

evaluation, activity efficiency, scientific institution, expert assessment, quantitative method, evaluation categories.

JEL classification: O100; DOI: 10.32680/2409-9260-2023-1-2-302-303-46-52

UD classification: 330.341

References

1. Standards and Guidelines for Quality Assurance in the European Higher Education Area (ESG) (2015). Brussels, Belgium. Retrieved from https://enqa.eu/wp-content/uploads/2015/11/ ESG_2015.pdf.
2. The Strategy Evaluation Protocol 2021–2027. (2020). Publication of VSNU, KNAW and NWO. The Hague. Retrieved from https://www.universiteitenvannederland.nl/files/documenten/ Domeinen/Onderzoek/SEP_2021-2027.pdf. (accessed January 25, 2023).
3. Pinar, M., Unlu, E. (2020). Evaluating the potential effect of the increased importance of the impact component in the Research Excellence Framework of the UK. British educational research journal, 46, 1, 140–160. Retrieved from https://doi.org/10.1002/berj.3572. (accessed February 17, 2023).
4. Bando Valutazione della Qualità della Ricerca 2015–2019 (VQR 2015–2019). (2020). Decreto del Presidente del 25 settembre. Retrieved from https://www.anvur.it/attivita/vqr/vqr– 2015–2019. (accessed February 17, 2020).
5. International Landscape Study of Research and Innovation Systems. Annex report – country profiles. UK (2019), Technopolis group.
6. The Leiden Manifesto for research metrics. Nature, April 2015, 520, 429–431. Retrieved from https://doi.org/10.1038/520429a. (accessed February 17, 2023).
7. Regarding the evaluation methodology of scientific institutions of the National Academy of Sciences of Ukraine. Resolution of the Presidium of the National Academy of Sciences of Ukraine dated February 2016, 3, 22. Retrieved from https://newin.nas.gov.ua/legaltexts/corporate/ Pages/regulation.aspx?ffn1= ActID&fft1=Eq&ffv1=P–160203–22. (accessed January 31, 2023). [In Ukrainian].
8. Yegorov, I. Yu., Zhukovych, І. А., Stupina, L. V., Artiushenko, V. V. Analysis of the results of evaluation of the efficiency of scientific institutions of the NAS of Ukraine in the first round of evaluation for the period 2016–2022 (2022). Visnyk of the National Academy of Sciences of Ukraine, 11, 79–89. Retrieved from https://doi.org/10.15407/visn2022.11.079. (accessed January 31, 2023). [In Ukrainian].
9. Artiushenko, V. V., Stupina, L. V. Evaluation of the activities of scientific institutions of the NASU as an effective mechanism for reforming the Academy (2021). Innovative development of the economy: infrastructural and investment aspects. Materials of international science and practice conference, Zaporizhzhia. November, 26–27, 32–37. [In Ukrainian].
10. Bohdanov, V. L., Kubalskyi, O. N. (2021). About the concept of development of the National Academy of Sciences of Ukraine for 2021–2025. Visnyk of the National Academy of Sciences of Ukraine, 12, 38–45. Retrieved from https://visnyk-nanu.org.ua/ojs/index.php/v/article/view/190. (accessed February 06, 2023). [In Ukrainian].