A Combined Learning Approach for Credit Scoring Using Adaptive Hierarchical Mixture of Experts: Iranian Banking Industry

Document Type : Research Article

Authors

1 Department of Industrial Engineering and Management Systems, Amirkabir University of Technology, Tehran, Iran

2 Department of Industrial Engineering and Management Systems, Amirkabir University of Technology, Tehran, Iran,

Abstract

Traditional methods for granting credit to loan applicants are based on personal judgment. Nevertheless, the current financial crisis alongside the efforts of banks and financial institutes for decreasing the percentage of overdue loans emphasis the importance of Credit Scoring (CS) models. This paper provides a credit scoring model by means of Modular Neural Network (MNN) established upon combined hybrid-ensemble learning. The proposed model is composed of four powerful neural networks that construct collectively the Adaptive Hierarchical Mixture of Experts (AHME). Training process is a hybrid way for learning the modular model and adaption to the CS model based on the modulation of learning rules specific to each module and particular HME online learning algorithm. Binary Particle Swarm Optimization (BPSO), using Taguchi reasoning scheme for tuning the governing parameters, is also applied for reducing dimensionality and decomposing the problem among the various modules. The proposed model’s performance is compared with that of Multi-Layer Perceptron (MLP) and Laterally Connected Neural Network (LCNN) models. The aforementioned models are evaluated using the data obtained from one of the Iranian banks. Results demonstrate that the AHME outperforms other methods in terms of prediction accuracy as well as the Area Under the ROC Curve (AUC) and the Mean Squared Error (MSE) rate.

Keywords

Main Subjects

References

Ahmadi, A., Fakhri, K., & Kamel, M. S. 2010. “Flocking Based Approach for Data Clustering.” Natural Computing 9(3): 767–91.
Ahmadi, A., Fakhri, K., & Kamel, M. S. 2012. “Model Order Selection for Multiple Cooperative Swarms Clustering Using Stability Analysis.” Information Sciences 182(1): 169–83.
Akkoç, S. 2012. “An Empirical Comparison of Conventional Techniques, Neural Networks and the Three Stage Hybrid Adaptive Neuro Fuzzy Inference System (ANFIS) Model for Credit Scoring Analysis: The Case of Turkish Credit Card Data.” European Journal of Operational Research 222(1): 168–78.
Alaraj, M., Abbod, M., & Hunaiti, Z. 2014. “Evaluating Consumer Loans Using Neural Networks Ensembles.” International Conference on Machine Learning, Electrical and Mechanical Engineering (ICMLEME), http://dx.doi.org/10.15242/IIE.E0114084.
Ayouche, S., Aboulaich, R., & Ellaia, R. 2017. “Partnership Credit Scoring Classification Probem: A Neural Network Approach.” International Journal of Applied Engineering Research, 12(5): 693–704.
Babaoglu, İ., Findik, O., & Ülker, E. 2010. “A Comparison of Feature Selection Models Utilizing Binary Particle Swarm Optimization and Genetic Algorithm in Determining Coronary Artery Disease Using Support Vector Machine.” Expert Systems with Applications 37(4): 3177–83.
Behesti, Z., Shamsuddin, S., M., & Hasan, S. 2015. “Memetic binary particle swarm optimization for discrete optimization problems.” Information Sciences Journal, 299: 58–84.
Chuang, L.,Y., Hsiao, C., J., & Yang, C., H. 2011. “An Improved Binary Particle Swarm Optimization with Complementary Distribution Strategy for Feature Selection.” In International Conference on Machine Learning and Computing, 244–48.
Hamada, M., & Hasan, M. 2018. “Artificial Neural Networks and Particle Swarm Optimization Algorithms for Preference Prediction in Multi-Criteria Recommender Systems.” Informatics Journal, 5(2):25.
Jordan, M., I., & Jacobs, R., A. 1994. “Hierarchical Mixtures of Experts and the EM Algorithm.” Neural computation 6(2): 181–214.
Kambal, E., Osman, I., Taha, M., Mohammed, N., & Mohammed, S. 2013. “Credit Scoring Using Data Mining Techniques with Particular Reference to Sudanese Banks.” Inernational Confrance on Computer, Electrrical and Electronics Engineering (ICCEEE), 378 - 383.
Karray, F., O., & De Silva, C. 2004. Soft Computing and Intelligent Systems Design: Theory, Tools, and Applications. Pearson/Addison Wesley. https://books.google.com/books?id=mqYw-Xig0IsC.
Kiruthika & Dilsha, M. 2015. “A Neural Network Approach for Microfinance Credit Scoring.” Journal of Statistics and Management Systems, 18:1-2, 121-138.
Kothari, R., & Agyepong, K. 1996. “On Lateral Connections in Feed-Forward Neural Networks.” In Neural Networks, 1996., IEEE International Conference on, IEEE, 13–18.
Limsombunchai, V., Gan, C., & Lee, M. 2005. “An Analysis of Credit Scoring for Agricultural Loans in Thailand.” American Journal of Applied Sciences 2(8): 1198.
Netjinda, N., Achalakul, T., & Sirinaovakul, B. 2015. “Particle Swarm Optimization Inspired by Starling Flock Behavior.” Applied Soft Computing 35: 411–22.
Ong, C., S., Huang, J., J., & Tzeng, G., H. 2005. “Building Credit Scoring Models Using Genetic Programming.” Expert Systems with Applications 29(1): 41–47.
Rafiee Vahid, P., & Ahmadi, A. 2016. “Modelling Corporate Customers Credit Risk Considering the Ensemble Approaches in Multiclass Classification : Evidence from Iranian Corporate Credits.” To appear in The Journal of Credit Risk.
Shayeghi, H., Shayanfar, H., A., & Azimi, G. 2010. “A Hrbrid Particle Swarm Optimization Back Prppagation Algorithm for Short Term Load Forcasting.” International Journal on Technical and Physical Problems of Engineering(IJTPE), 4(2): 12–22.
Tang, Q., Liu, B., H., Chen, Y., Q., & Ding, J., J. 2007. “Application of LVQ Neural Network Combined with the Genetic Algorithm in Acoustic Seafloor Classification.” Chinese Journal of Geophysics 50(1): 291–98.
Tran, K., & Duong, T. 2017. “The Application of Radial Basis Function (RBF) Neural Network for Mechanical Fault Diagnosis of Gearbox.” Future Technologies Conference (FTC), 145-149.
Unler, A., & Alper, M. 2010. “A Discrete Particle Swarm Optimization Method for Feature Selection in Binary Classification Problems.” European Journal of Operational Research 206(3): 528–39.
Valdovinos, R., M.,  & Sanchez, J., S. 2006. “Ensembles of Multilayer Perceptron and Modular Neural Networks for Fast and Accurate Learning.” In Artificial Intelligence, 2006. MICAI’06.
Vieira, S., M., Mendonça, L., F., Farinha, G., J., & Sousa, J., M., C. 2013. “Modified Binary PSO for Feature Selection Using SVM Applied to Mortality Prediction of Septic Patients.” Applied Soft Computing Journal 13(8): 3494–3504.
Wang, H., Geng, Q., & Qiao, Z. 2017. “Parameter Tuning of Particle Swarm Optimization by Using Taguchi Method and Its Application to Motor Design.” 4th IEEE International Conference on Information Science and Technology, Shenzhen, 722-726.
Wang, P. 2016. “Credit Scoring Model: A Combination of Genetic Programming and Deep Learning.” IOP Conference Series: Materials Science and Engineering, V(269), https://doi.org/10.1088/1757-899X/269/1/012056.
Waterhouse, S., R., & Robinson, A., J. 1994. “Classification Using Hierarchical Mixtures of Experts.” In Neural Networks for Signal Processing [1994] IV. Proceedings of the 1994 IEEE Workshop, IEEE, 177–86.
Xue, B., Zhang, M., & Browne, W., N. 2014. “Particle Swarm Optimisation for Feature Selection in Classification: Novel Initialisation and Updating Mechanisms.” Management Science and Engineering, 7(3), 81-85.
Yarushev, S., & Averkin, A. 2017. “Time series analysis based on the biologically inspired modular approach.” Procedia Computer Science Journal, V(120): 843–853.
 
 
 
AUT Journal of Modeling and Simulation
Volume 51, Issue 1
June 2019
Pages 67-80

Files

Share

How to cite

Statistics