Journal of Applied Economic Research
ISSN 2712-7435
Selection of Informative Indicators for Assessing the Economic Security of Russian Companies
Lev A. Bulanov 1, Alexei V. Kalina 1,2, Vadim V. Krivorotov 1
1 Ural Federal University named after the First President of Russia B.N. Yeltsin, Yekaterinburg, Russia
2 Institute of Economics, The Ural Branch of Russian Academy of Sciences, Yekaterinburg, Russia
Abstract
Ensuring the economic security of enterprises and companies is one of the top priorities under the current economic and political conditions. Central to solving this problem is a comprehensive and objective assessment of the economic security of companies, which is usually based on the method of indicative analysis. This, in turn, necessitates the development and formation of indicators of economic security, which would most comprehensively and qualitatively reflect the state of companies both in the current and future periods. The purpose of this article is the development of an algorithm and its model implementation for selecting the most significant indicators of economic security of enterprises based on the use of machine learning technologies. To achieve this goal, the paper explores the interpretable multiclass classification of large manufacturing companies (“bad/normal/good”) according to their financial coefficients with the formation of target labels by K-Means++ clustering on a real dataset for 2023 (2,249 observations). One-dimensional filters (ANOVA/n2, one-vs-rest ROC-AUC, Mutual Information) and model SHAP values for CatBoost are compared; the comparison is carried out through correlation of ranks, intersection of top-k and ablation with a logloss estimate on a stratified k-fold CV with strict separation of train/val. Additionally, the compromise “compactness vs accuracy” at k is evaluated. {5, 10, 15, 20, 30} and the statistical significance of the differences is checked (the Wilcoxon criterion). The proposed approach and its implementation for Russian companies have revealed that their own working capital is the basis for the formation and evaluation of the most significant and informative indicators of the companies' economic security. At the same time, class profiles show asymmetric, economically consistent threshold: for “bad” companies, the decisive factor is a shortage of working capital and low liquidity; for “good” companies, high fast/current liquidity and coverage; “normal” companies are formed as a buffer with moderate values and serviced debt. The primary practical result of the research is a set of actionable recommendations as to the minimum set of indicators and a strategy for selecting features for monitoring the economic security and financial condition of companies and applied financial analytics.
Keywords
economic security indicators; machine learning; cross-validation; feature selection; ANOVA; ROC-AUC; Mutual Information; CatBoost; SHAP.
JEL classification
D22, G30, C45References
1. Bulanov, L.A., Kalina, A.V., Krivorotov, V.V. (2025). Clustering of Russian Manu-facturing Companies by Indicators of Their Financial Condition Using Machine Learning Technologies. Journal of Applied Economic Research, Vol. 24, No. 2, 584–621. (In Russ.). https://doi.org/10.15826/vestnik.2025.24.2.020
2. Hauge, J., Houtzager, B., Hörmann, A.J. (2025). The new economic nationalism: industrial policy and national security in the United States, China, and the European Union. Geoforum, Vol. 166, 104382. https://doi.org/10.1016/j.geoforum.2025.104382
3. Ahumada, J.M. (2023). Bringing freedom back to developmentalism: industrialisation as national independence. Cambridge Journal of Economics, Vol. 47, Issue 6, 1037–1056. https://doi.org/10.1093/cje/bead030
4. Ghazouani, T. (2025). Geopolitical, technological, and economic influences on U.S. energy security: A quantile-wavelet analysis. Journal of Environmental Management, Vol. 390, 126393. https://doi.org/10.1016/j.jenvman.2025.126393
5. Akusta, E. (2024). The impacts of different types of globalization on energy security risk: Can globalization be a remedy for the energy security risk of OECD countries? Energy, Vol. 313, 133787. https://doi.org/10.1016/j.energy.2024.133787
6. Yao, L., Chang, Y. (2014). Energy security in China: A quantitative analysis and policy implications. Energy Policy, Vol. 67, 595–604. https://doi.org/10.1016/j.enpol.2013.12.047
7. Kruyt, B., van Vuuren, D.P., de Vries, H.J.M., Groenenberg, H. (2009). Indicators for energy security. Energy Policy, Vol. 37, Issue 6, 2166–2181. https://doi.org/10.1016/j.enpol.2009.02.006
8. Löschel, A., Moslener, U., Rübbelke, D.T.G. (2009). Indicators of energy security in industrialised countries. Energy Policy, Vol. 37, Issue 6, 2166–2181. https://doi.org/10.1016/j.enpol.2009.02.006
9. Ang, B.W., Choong, W.L., Ng, T.S. (2015). Energy security: Definitions, dimensions and indexes. Renewable and Sustainable Energy Reviews, Vol. 42, 1077–1093. https://doi.org/10.1016/j.rser.2014.10.064
10. Abd El-Ghani, S.S., Mansour, T.G.I., Esleem, S.A. (2025). The most important economic and social indicators of the challenges facing food security for the most important crops in Egypt. Environmental and Sustainability Indicators, Vol. 25, 100808. https://doi.org/10.1016/j.indic.2025.100808
11. Akinci1, O.S., Kumcu, S.Y. (2024). Towards Resilient and Sustainable Food Systems: Integrating Agricultural Production Efficiency and Food Security. Archives des Sciences: A Multidisciplinary Journal, Vol. 74, Issue 1, 51–56. https://doi.org/10.62227/as/74106
12. Onwe, J.C., Makuachukwu, G. Ojide, M.G., Subhan, M., Forgenie, D. (2024). Food security in Nigeria amidst globalization, economic expansion, and population growth: A wavelet coherence and QARDL analysis. Journal of Agriculture and Food Research, Vol. 18, 101413. https://doi.org/10.1016/j.jafr.2024.101413
13. Boiral, O., Brotherton, M.-C., Talbot, D. (2025). Anticipating the unforeseeable? ESG risk management in mining companies. Resources Policy, Vol. 106, 105628. https://doi.org/10.1016/j.resourpol.2025.105628
14. Bertolotti, A. (2020). Effectively managing risks in an ESG portfolio. Journal of Risk Management in Financial Institutions, Vol. 13, Issue 3, 202–211. https://doi.org/10.69554/TQVN4497
15. Razak, S.E.A., Mustapha, M., Shah, S.M., Abu Kasim, N.A. (2024). Sustainability risk management: Are Malaysian companies ready? Heliyon, Vol. 10, Issue 3, e24681. https://doi.org/10.1016/j.heliyon.2024.e24681
16. Belás, J., Mišanková, M., Schönfeld, J., Gavurová, B. (2017). Credit risk management: financial safety and sustainability aspects. Journal of Security and Sustainability Issues, Vol. 7, No. 1, 79–93. http://dx.doi.org/10.9770/jssi.2017.6.1(7)
17. Altman, E.I., Sabato, G., Wilson, N. (2010). The Value of Non-Financial Information in Small and Medium-Sized Enterprise Risk Management. Journal of Credit Risk, Vol. 6, No. 2, 95–127. https://doi.org/10.21314/JCR.2010.110
18. Behr, P. Guttler, A. (2017). Credit Risk Assessment and Relationship Lending: An Empirical Analysis of German Small and Medium-Sized Enterprises. Journal of Small Business Management, Vol. 45, Issue 2, 194–213. https://doi.org/10.1111/j.1540-627X.2007.00209.x
19. Pylypenko, K.A., Babiy, I.V., Volkova, N.V., Feofanov, L.K., Kashchena, N.B. (2019). Structuring economic security of the organization. Journal of Security and Sustainability Issues, Vol. 9, No. 1, 27–38. http://doi.org/10.9770/jssi.2019.9.1(3)
20. Ianioglo, A. (2015). Comprehensive system of ensuring the economic security of enterprise. Agricultural and Resource Economics: International Scientific E-Journal, Vol. 1, No. 1, 69–79. https://doi.org/10.51599/are.2015.01.01.07
21. Ianioglo, A., Polajeva, T. (2017). Innovative component of economic security of enterprises: A case of the Republic of Moldova. Journal of Business Economics and Management, Vol. 18, No. 6, 1228–1242. https://doi.org/10.3846/16111699.2017.1405365
22. Ereshko, F., Karanina, E. (2022). A systematic approach to the diagnosis of economic security of a transport enterprises. Transportation Research Procedia, Vol. 63, 322–328. https://doi.org/10.1016/j.trpro.2022.06.019
23. Ryazanova, O., Timin, A. (2022). Assessment of the state, threats and risks of the economic security system of motor transport enterprises of the Kirov region. Transportation Research Procedia, Vol. 63, 1121–1130. https://doi.org/10.1016/j.trpro.2022.06.115
24. Prievozník, P., Strelcová, S., Sventeková, E. (2021). Economic Security of Public Transport Provider in a Three-Dimensional Model. Transportation Research Procedia, Vol. 55, 1570–1577. https://doi.org/10.1016/j.trpro.2021.07.146
25. Beaver, W.H. (1966). Financial Ratios as Predictors of Failure. Journal of Accounting Research, Vol. 4, 71–111. https://doi.org/10.2307/2490171
26. Altman, E.I. (1968). Financial Ratios, Discriminant Analysis and the Prediction of Corporate Bankruptcy. Journal of Finance, Vol. 23, No. 4, 589–609. https://doi.org/10.1111/j.1540-6261.1968.tb00843.x
27. Ohlson, J.A. (1980). Financial Ratios and the Probabilistic Prediction of Bankruptcy. Journal of Accounting Research, Vol. 18, No. 1, 109–131. https://doi.org/10.2307/2490395
28. Shumway, T. (2001). Forecasting Bankruptcy More Accurately: A Simple Hazard Model. Journal of Business, Vol. 74, No. 1, 101–124. https://doi.org/10.1086/209665
29. Lessmann, S., Baesens, B., Seow, H.-V., Thomas, L.C. (2015). Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research. European Journal of Operational Research, Vol. 247, 124–136. https://doi.org/10.1016/j.ejor.2015.05.030
30. Saisana, M., Saltelli, A., Tarantola, S. (2005). Uncertainty and Sensitivity Analysis Techniques as Tools for the Assessment of Composite Indicators. Journal of the Royal Statistical Society Series A: Statistics in Society, Vol. 168, Issue 2, 307–323. https://doi.org/10.1111/j.1467-985X.2005.00350.x
31. Altman, E.I., Iwanicz-Drozdowska, M., Laitinen, E.K., Suvas, A. (2017). Financial Distress Prediction in an International Context: A Review and Empirical Analysis of Altman’s Z-Score Model. Journal of International Financial Management & Accounting, Vol. 28, Issue 2, 131–171. https://doi.org/10.1111/jifm.12053
32. Guyon, I., Elisseeff, A. (2003). An introduction to variable and feature selection. Journal of Machine Learning Research, Vol. 3, 1157–1182. https://doi.org/10.1162/153244303322753616
33. Saeys, Y., Inza, I., Larranaga, P. (2007). A review of feature selection techniques in bioinformatics. Bioinformatics, Vol. 23, Issue 19, 2507–2517. https://doi.org/10.1093/bioinformatics/btm344
34. Li, J., Cheng, K., Wang, S., Morstatter, F., Trevino, R.P., Tang, J., Liu, H. (2017). Feature selection: A data perspective. ACM Computing Surveys (CSUR), Vol. 50, Issue 6, 94. https://doi.org/10.1145/3136625
35. Kruskal, W.H., Wallis, W.A. (1952). Use of ranks in one-criterion variance analysis. Journal of the American Statistical Association, Vol. 47, Issue 260, 583–621. https://doi.org/10.1080/01621459.1952.10483441
36. Hand, D.J., Till, R.J. (2001). A simple generalisation of the area under the ROC curve for multiple class classification problems. Machine Learning, Vol. 45, 171–186. https://doi.org/10.1023/A:1010920819831
37. Fawcett, T. (2006). An introduction to ROC analysis. Pattern Recognition Letters, Vol. 27, Issue 8, 861–874. https://doi.org/10.1016/j.patrec.2005.10.010
38. Bademlioglu, A.H., Karatas, O.B., Sokmen, K.F., Yuruklu, E. (2024). Thermal management and fin characteristic optimization of an electronic power supply utilizing Taguchi and ANOVA methods. Applied Thermal Engineering, Vol. 252, 123671. https://doi.org/10.1016/j.applthermaleng.2024.123671
39. AravindKumar, P., Sivaranjini, S., JyothirGanesh, P., Garlapati, C. (2024). New solubility model to correlate solubility of anticancer drugs in supercritical carbon dioxide and evaluation with Kruskal–Wallis test. Fluid Phase Equilibria, Vol. 582, 114099. https://doi.org/10.1016/j.fluid.2024.114099
40. Kraskov, A., Stögbauer, H., Grassberger, P. (2004). Estimating mutual information. Physical Review E-Statistical, Nonlinear, and Soft Matter Physics, Vol. 69, 066138. https://doi.org/10.1103/PhysRevE.69.066138
41. Ross, B.C. (2014). Mutual information between discrete and continuous data sets. PloS One, Vol. 9, Issue 2, e87357. https://doi.org/10.1371/journal.pone.0087357
42. Zhang, X., Tian, R., Xu, H., Liu, X, C. Soares, C.G. (2025). Ship manoeuvring model identification using mutual information clustering with stepwise regression structural optimisation under small-sample constraints. Ocean Engineering, Vol. 341, Part 2, 122594. https://doi.org/10.1016/j.oceaneng.2025.122594
43. Stuart, T., Butler, A., Hoffman, P., Hafemeister, C., Papalexi, E., Mauck, W.M., Hao, Y., Stoeckius, M., Smibert, P., Satija, R. (2019). Comprehensive Integration of Single-Cell Data. Cell, Volume 177, Issue 7, 1888–1902. https://doi.org/10.1016/j.cell.2019.05.031
44. Lundberg, S.M., Erion, G., Chen, H., DeGrave, A., Prutkin, J.M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., Lee, S.-I. (2020). From local explanations to global understanding with explainable AI for trees. Nature Machine Intelligence, Vol. 2, 56–67. https://doi.org/10.1038/s42256-019-0138-9
45. Štrumbelj, E., Kononenko, I. (2014). Explaining prediction models and individual predictions with feature contributions. Knowledge and Information Systems, Vol. 41, 647–665. https://doi.org/10.1007/s10115-013-0679-x
46. Lundberg, S.M., Nair, B., Vavilala, M.S., Horibe, M., Eisses, M.J., Adams, T., Liston, D.E., Low, D.K.-W., Newman, S.-F., Kim, J., Lee, S.-I. (2018). Explainable machine-learning predictions for the prevention of hypoxaemia during surgery. Nature Biomedical Engineering, Vol. 2, 749–760. https://doi.org/10.1038/s41551-018-0304-0
47. Bussmann, N., Giudici, P., Marinelli, D., Papenbrock, J. (2021). Explainable machine learning in credit risk management. Computational Economics, Vol. 57, 203–216. https://doi.org/10.1007/s10614-020-10042-0
48. Aas, K., Jullum, M., Løland, A. (2021). Explaining individual predictions when features are dependent: More accurate approximations to Shapley values. Artificial Intelligence, Vol. 298, 103502. https://doi.org/10.1016/j.artint.2021.103502
49. Covert, I., Lundberg, S., Lee, S.-I. (2021). Explaining by removing: A unified framework for model explanation. Journal of Machine Learning Research, Vol. 22, Issue 209, 1–90. https://doi.org/10.48550/arXiv.2011.14878
50. Oladimeji, O.O., Ayaz, H., McLoughlin, I., Unnikrishnan, S. (2024). Mutual information-based radiomic feature selection with SHAP explainability for breast cancer diagnosis. Results in Engineering, Vol. 24, 103071. https://doi.org/10.1016/j.rineng.2024.103071
51. Zhou, C., Wang, Z., Wang, X., Guo, R., Zhang, Z., Xiang, X., Wu, Y. (2024). Deciphering the nonlinear and synergistic role of building energy variables in shaping carbon emissions: A LightGBM-SHAP framework in office buildings. Building and Environment, Vol. 266, 112035. https://doi.org/10.1016/j.buildenv.2024.112035
52. Friedman, J.H. (2001). Greedy function approximation: A gradient boosting machine. The Annals of Statistics, Vol. 29, No. 5, 1189–1232. https://doi.org/10.1214/aos/1013203451
53. Chen, T., Guestrin, C. (2016). Xgboost: A scalable tree boosting system. KDD'16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, Association for Computing Machinery, 785–794. https://doi.org/10.1145/2939672.2939785
54. Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., Liu, T.-Y. (2017). Lightgbm: A highly efficient gradient boosting decision tree. NIPS'17: Proceedings of the 31st International Conference on Neural Information Processing Systems. Edited by U. von Luxburg, I. Guyon, S. Bengio, H. Wallach, R. Fergus. New York, Curran Associates Inc., 3149–3157. https://dl.acm.org/doi/10.5555/3294996.3295074
55. Prokhorenkova, L., Gusev, G., Vorobev, A., Dorogush, A.V., Gulin, A. (2018). CatBoost: Unbiased boosting with categorical features. Advances in Neural Information Processing Systems, Vol. 31 (NeurIPS 2018). Edited by S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, R. Garnett. Neural Information Processing Systems Foundation, 6638–6648. https://doi.org/10.48550/arXiv.1706.09516
56. Zhang, Y., Ren, W., Lei, J., Sun, L., Mi, Y., Chen, Y. (2024). Predicting the compressive strength of high-performance concrete via the DR-CatBoost model. Case Studies in Construction Materials, Vol. 21, e03990. https://doi.org/10.1016/j.cscm.2024.e03990
57. Arif, M., Ahmed, S., Ge, F., Kabir, M., Khan, Y.D., Yu, D.-J., Thafar, M. (2022). StackACPred: Prediction of anticancer peptides by integrating optimized multiple feature descriptors with stacked ensemble approach. Chemometrics and Intelligent Laboratory Systems, Vol. 220, 104458. https://doi.org/10.1016/j.chemolab.2021.104458
58. Guyon, I., Weston, J., Barnhill, S., Vapnik, V. (2002). Gene Selection for Cancer Classification using Support Vector Machines. Machine Learning, Vol. 46, 389–422. https://doi.org/10.1023/A:1012487302797
59. Whitney, A.W. (1971). A Direct Method of Nonparametric Measurement Selection. IEEE Transactions on Computers, Vol. 20, Issue 9, 1100–1103. https://doi.org/10.1109/T-C.1971.22341
60. Pudil, P., Novovičová, J., Kittler, J. (1994). Floating search methods in feature selection. Pattern Recognition Letters, Vol. 15, Issue 11, 1119–1125. https://doi.org/10.1016/0167-8655(94)90127-9
61. Kursa, M.B., Rudnicki, W.R. (2010). Feature selection with the Boruta package. Journal of Statistical Software, Vol. 36, Issue 11, 1–13. https://doi.org/10.18637/jss.v036.i11
62. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), Vol. 58, Issue 1, 267–288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
63. Zou, H., Hastie, T. (2005). Addendum: Regularization and Variable Selection Via the Elastic Net. Journal of the Royal Statistical Society Series B: Statistical Methodology, Vol. 67, Issue 5, 768. https://doi.org/10.1111/j.1467-9868.2005.00527.x
64. Meinshausen, N., Bühlmann, P. (2010). Stability selection. Journal of the Royal Statistical Society Series B: Statistical Methodology, Vol. 72, Issue 4, 417–473. https://doi.org/10.1111/j.1467-9868.2010.00740.x
65. Varma, S., Simon, R. (2006). Bias in error estimation when using cross-validation for model selection. BMC Bioinformatics, Vol. 7, 91. https://doi.org/10.1186/1471-2105-7-91
66. Cawley, G.C., Talbot, N.L. (2010). On Over-fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation. The Journal of Machine Learning Research, Vol. 11, 2079–2107. https://doi.org/10.5555/1756006.1859921
67. Wilcoxon, F. (1945). Individual Comparisons by Ranking Methods. Biometrics Bulletin, Vol. 1, No. 6, 80–83. https://doi.org/10.2307/3001968
68. Wiley (1983). Understanding Robust and Exploratory Data Analysis. Edited by D.C. Hoaglin, F. Mosteller, J.W. Tukey. New York, Wiley, 447 p. Available at: https://archive.org/details/understandingrob0000unse/page/n1/mode/1up
About Authors
Lev Alexeevich Bulanov
Post-Graduate Student, Department of Economic Safety of Industrial Complexes, Ural Federal University named after the first President of Russia B.N. Yeltsin, Yekaterinburg, Russia (620002, Yekaterinburg, Mira street, 19); ORCID https://orcid.org/0009-0001-0242-0127 e-mail: levbulanov2013@yandex.ru
Alexei Vladimirovich Kalina
Candidate of Technical Sciences, Associate Professor, Department of Economic Safety of Industrial Complexes, Ural Federal University named after the first President of Russia B.N. Yeltsin, Yekaterinburg, Russia (620002, Yekaterinburg, Mira street, 19), Senior Researcher, The Center of Economic Security, Institute of Economics, The Ural Branch of Russian Academy of Sciences, Yekaterinburg, Russia (620014, Yekaterinburg, Moskovskaya street, 29); ORCID https://orcid.org/0000-0003-0376-2505 e-mail: alexkalina74@yandex.ru
Vadim Vasilyevich Krivorotov
Doctor of Economics, Professor, Head of Department of Economic Safety of Indus-trial Complexes, Ural Federal University named after the first President of Russia B.N. Yeltsin, Yekaterinburg, Russia (620002, Yekaterinburg, Mira street, 19); ORCID https://orcid.org/0000-0002-7066-0325 e-mail: v_krivorotov@mail.ru
For citation
Bulanov, L.A., Kalina, A.V., Krivorotov, V.V. (2025). Selection of Informative Indicators for Assessing the Economic Security of Russian Companies. Journal of Applied Economic Research, Vol. 24, No. 4, 1371-1415. https://doi.org/10.15826/vestnik.2025.24.4.045
Article info
Received September 2, 2025; Revised October 9, 2025; Accepted October 23, 2025.
DOI: https://doi.org/10.15826/vestnik.2025.24.4.045
Download full text article:
~2 MB, *.pdf
(Uploaded
10.12.2025)
Created / Updated: 2 September 2015 / 20 September 2021
© Federal State Autonomous Educational Institution of Higher Education «Ural Federal University named after the first President of Russia B.N.Yeltsin»
Remarks?
select the text and press:
Ctrl + Enter
Portal design: Artsofte
©Ural Federal University named the first President of Russia B.N.Yeltsin (Website)