Loan classification using a feed-forward neural network
https://doi.org/10.37661/1816-0301-2024-21-1-83-104
Abstract
Objectives. The purpose of the study is to construct and study the use of a feed-forward neural network to solve the problem of loan classification, as well as to conduct a comparative analysis of the neural networkbased approach with the existing approach based on logistic regression.
Methods. Based on a feed-forward neural network using historical data on loans issued, the following metrics are calculated: cost function, Accuracy, Precision, Recall, and measure, calculated on Precision and Recall values. Polynomial parameters and the principal component method are used to determine the optimal set of input data for the studied neural network.
Results. The impact of data normalization on the final result was analyzed, the influence of the number of units in the hidden layer on the outcome was evaluated using a two-stage method and the Monte Carlo method, the effect of balanced data use was determined, the optimal threshold value for output layer of the neural network under investigation was calculated, the optimal activation function for the hidden layer units was found, the effect of increasing input indicators through missing values imputation and the use of polynomials of varying degrees was studied and the redundancy in the existing set of input indicators was analyzed.
Conclusion. Based on the results of the research, we can conclude that the use of a direct distribution network to solve problems of loan classification is appropriate. Compared to logistic regression, implementing a solution using a feed-forward neural network requires more time and computing resources. However, the obtained most important values of Accuracy and measure are higher than those calculated using logistic regression [1].
References
1. Behunkou U. I., Kovalyov M. Y. Loan classification using logistic regression. Informatika [Informatics], 2023, vol. 20, no. 1, pp. 55−74 (In Russ.). https://doi.org/10.37661/1816-0301-2023-20-1-55-74
2. Murati A., Skau O., Taraporevala Z. Disruption in European consumer finance: Lessons from Sweden. McKinsey Quarterly, 2018. Available at: https://www.mckinsey.com/industries/financial-services/our-insights/disruption-in-european-consumer-finance-lessons-from-sweden (accessed 01.06.2021).
3. Hand D. J., Henley W. E. Statistical classification methods in consumer credit scoring: a review. Journal of the Royal Statistical Society: Series A (Statistics in Society), 1997, vol. 160, no. 3, pp. 523–541.
4. Kombe S. K., Wafula M. K. Effects of internet banking on the financial performance of commercial banks in Kenya a case of Kenya Commercial Bank. International Journal of Scientific and Research Publications, 2015, vol. 5, no. 5, pр. 1–10.
5. Lessmann S., Baesens B., Seow H.-V., Thomas L. C. Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research. European Journal of Operational Research, 2015, vol. 247, iss. 1, рр. 124–136.
6. Geron A. Hands-on Machine Learning with Scikit-Learn, Keras, and TensorFlow, 2nd edition. O’Reilly Media, 2019, pp. 205–207, 370–371.
7. Oldham K., Myland J., Spanier J. An Atlas of Functions: with Equator, the Atlas Function Calculator, 2nd edition. Springer Science + Business Media, 2009, pp. 289–290.
8. Shalev-Shwartz S., Ben-David S. Understanding Machine Learning: From Theory to Algorithms. Cambridge University Press, 2014, pp. 125–127.
9. Raschka S., Mirjalili V. Python Machine Learning, 3d edition. Packt Publishing Ltd., 2019, pp. 65, 415–421.
10. Rumelhart D., Hinton G., Williams R. Learning representations by back-propagating errors. Nature, 1986, vol. 323, pp. 533–536.
11. Goodfellow I., Bengio Y., Courville A. Deep Learning, MIT Press, 2016, pp. 82–86, 205.
12. Bishop C. Neural Networks for Pattern Recognition. Clarendon Press Oxford, 1995, p. 231.
13. Metropolis N., Ulam S. The Monte Carlo method. Journal of the American Statistical Association, 1949, vol. 44, no. 247, pp. 335–341.
14. Harrington P. Machine Learning in Action, 1st edition. Manning Publication Co., 2012, pр. 148, 269–279.
15. Glorot X., Bordes A., Bengio Y. Deep sparse rectifier neural networks. Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA, 11–13 April 2011. Fort Lauderdale, 2011, vol. 15, pp. 315–323.
16. Murphy K. P. Machine Learning: A Probabilistic Perspective (Adaptive Computation and Machine Learning series). The MIT Press, 2012, pp. 387–407.
Review
For citations:
Behunkou U.I. Loan classification using a feed-forward neural network. Informatics. 2024;21(1):83-104. (In Russ.) https://doi.org/10.37661/1816-0301-2024-21-1-83-104
Views:
358
Email this article 