Multi-Objective PSO-fuzzy Optimization Approach to Improve Interpretability and Accuracy in Medical Data
DOI:
https://doi.org/10.14419/ijet.v7i4.31.29943Keywords:
Fuzzy Rule-based Classification, Multi-objective PSO, Particle Swarm Optimization (PSO), Rule-based Systems, Single-objective PSOAbstract
Today, Decision Support Systems (DSS) plays a significant role in a medical and healthcare domain. Designing an Automatic FuzzyRule-based Classification Systems (FRBCSs) is considered as optimization problem associated to a result of high interpretability and
accuracy. Interpretability and accuracy are the two main objectives to be improved in the optimization measurement of FRBCSs. However, improving these objectives is found to be difficult in most of the existing systems due to the conflicting issues between accuracy
and interpretability. In this work, we proposed an approach that can effectively handle accuracy- interpretability trade-off in constructing
FRBCSs. We designed automated FRBCSs in the form of Multi-objective Particle Swarm Optimization with Crowding Distance. In the
approach, there will be a collection of solutions to FRBCSs that deem best global minimum or global maximum with respect to interpretability and accuracy. Our method is evaluated on a popular benchmark data sets being used in a medical domain for evaluations. These
datasets are Liver Disorders (BUPA), Pima Indians Diabetes and Thyroid Disease (New Thyroid). The result obtained shows that the
proposed method yields an optimum solution in minimizing the trade-off between accuracy and interpretability. Moreover, the result of
the comparison shows that our approach outperforms the alternate techniques in terms of accuracy of FRBCSs and also exhibits good
result in terms of interpretability objective.
References
- [1] N. Esfandiari, M. R. Babavalian, A. M. E. Moghadam, and V. K.
Tabar, “Knowledge discovery in medicine: Current issue and future
trend,†Expert Syst. Appl., vol. 41, no. 9, pp. 4434–4463, 2014.
[2] M. Fazzolari, R. Alcalá, and F. Herrera, “A multi-objective
evolutionary method for learning granularities based on fuzzy
discretization to improve the accuracy-complexity trade-off of
fuzzy rule-based classification systems: D-MOFARC algorithm,â€
Appl. Soft Comput. J., vol. 24, pp. 470–481, 2014.
[3] M. B. Gorzałczany and F. Rudziński, “Interpretable and accurate
medical data classification – a multi-objective genetic-fuzzy
optimization approach,†Expert Syst. Appl., vol. 71, pp. 26–39,
2017.
[4] K. Deb, S. Pratab, S. Agarwal, and T. Meyarivan, “A Fast and
Elitist Multiobjective Genetic Algorithm: NGSA-II,†IEEE Trans.
Evol. Comput., vol. 6, no. 2, pp. 182–197, 2002.
[5] M. J. Gacto, R. Alcalá, and F. Herrera, “An improved multiobjective genetic algorithm for tuning linguistic fuzzy systems,â€
Proc. IPMU, vol. 8, pp. 1121–1128, 2008.
[6] R. Alcalá, J. Alcalá-Fdez, M. J. Gacto, and F. Herrera, “A multiobjective evolutionary algorithm for rule selection and tuning on
fuzzy rule-based systems,†IEEE Int. Conf. Fuzzy Syst., pp. 1367–
1372, 2007.
[7] F. Jiménez, G. Sánchez, and J. M. Juárez, “Multi-objective
evolutionary algorithms for fuzzy classification in survival
prediction,†Artif. Intell. Med., vol. 60, no. 3, pp. 197–219, 2014.
[8] M. B. Gorzalczany and F. Rudzi, “Genetic Fuzzy Rule-Based
Modelling of Dynamic Systems Using Time Series,†In Swarm and
Evolutionary Computation (pp. 231-239). Springer, Berlin,
Heidelberg.
[9] K. Sindhya, K. Deb, and K. Miettinen, “Improving convergence of
evolutionary multi-objective optimization with local search: A
concurrent-hybrid algorithm,†Nat. Comput., vol. 10, no. 4, pp.
1407–1430, 2011.
[10] D. Phong Pham, C. Ho Nguyen, and T. Thuy Nguyen, “Multiobjective particle swarm optimization algorithm and its application
to the fuzzy rule based classifier design problem with the order
based semantics of linguistic terms,†Comput. Commun. Technol.
Res. Innov. Vis. Futur. (RIVF), 2013 IEEE RIVF Int. Conf., no.
January 2015, pp. 12–17, 2013.
[11] P. D. Pham, T. T. Nguyen, and T. X. Tran, “A Hybrid Multiobjective PSO-SA Algorithm for the Fuzzy Rule Based Classifier
Design Problem with the Order Based Semantics of Linguistic
Terms,†VNU J. Sci. Comput. Sci. Commun. Eng., vol. 30, no. 4, pp.
44–56, 2015.
[12] J. Kennedy, R. C. Eberhart, and Y. Shi, “Swarm Intelligence,†Evol.
Comput., vol. 78, no. 2, p. 512, 2001.
[13] M. J. Gacto, R. Alcalá, and F. Herrera, “Interpretability of linguistic
fuzzy rule-based systems: An overview of interpretability measures,â€
Inf. Sci. (Ny)., vol. 181, no. 20, pp. 4340–4360, 2011.
[14] H. Ishibuchi and Y. Nojima, “Analysis of interpretability-accuracy
tradeoff of fuzzy systems by multiobjective fuzzy genetics-based
machine learning,†Int. J. Approx. Reason., vol. 44, no. 1, pp. 4–31,
2007.
[15] M. Galende, G. Sainz, and M. J. Fuente, “Accuracy-Interpretability
Balancing Fuzzy Models based Based on Balancing in in Fuzzy
Models on Multiobjective Genetic Algorithm Multiobjective
Genetic Algorithm,†pp. 3915–3920, 2009.
[16] J. Alcalá-Fdez, R. Alcalá, and F. Herrera, “A fuzzy association
rule-based classification model for high-dimensional problems with
genetic rule selection and lateral tuning,†IEEE Trans. Fuzzy Syst.,
vol. 19, no. 5, pp. 857–872, 2011.
[17] M. Galende-Hernández, G. I. Sainz-Palmero, and M. J. FuenteAparicio, “Complexity reduction and interpretability improvement
for fuzzy rule systems based on simple interpretability measures
and indices by bi-objective evolutionary rule selection,†Soft
Comput., vol. 16, no. 3, pp. 451–470, 2012.
[18] M. Antonelli, P. Ducange, F. Marcelloni, and A. Segatori, “A novel
associative classification model based on a fuzzy frequent pattern
mining algorithm,†Expert Syst. Appl., vol. 42, no. 4, pp. 2086–
2097, 2015.
[19] A. S. Koshiyama, M. M. B. R. Vellasco, and R. Tanscheit, “GPFISCLASS: A Genetic Fuzzy System based on Genetic Programming
for classification problems,†Appl. Soft Comput., vol. 37, pp. 561–
571, 2015.
[20] P. C. Shill, M. A. H. Akhand, M. Asaduzzaman, and K. Murase,
“Optimization of Fuzzy Logic Controllers with Rule Base Size
Reduction using Genetic Algorithms,†Int. J. Inf. Technol. Decis.
Mak., vol. 14, no. 5, 2015.
[21] D. P. Rini, S. M. Shamsuddin, and S. S. Yuhaniz, “Particle swarm
optimization for ANFIS interpretability and accuracy,†Soft
Comput., vol. 20, no. 1, pp. 251–262, 2016.
[22] M. Antonelli, P. Ducange, B. Lazzerini, and F. Marcelloni, “Multiobjective evolutionary design of granular rule-based classifiers,â€
Granul. Comput., vol. 1, no. 1, pp. 37–58, 2016.
[23] H. Ishibuchi and T. Nakashima, “Effect of Rule Weights in Fuzzy
Rule-Based Classification Systems Effect of Rule Weights in Fuzzy
Rule-Based Classification Systems,†IEEE Transactions on Fuzzy
Systems, 9(4), 506-515, pp. 506–515, 2000.
[24] O. Cordón, “A historical review of evolutionary learning methods
for Mamdani-type fuzzy rule-based systems: Designing
interpretable genetic fuzzy systems,†Int. J. Approx. Reason., vol.
52, no. 6, pp. 894–913, 2011.
[25] F. Herrera, “Genetic fuzzy systems: Taxonomy, current research
trends and prospects,†Evol. Intell., vol. 1, no. 1, pp. 27–46, 2008.
[26] Y. Jarraya, S. Bouaziz, A. M. Alimi, and A. Abraham,
“Evolutionary multi-objective optimization for evolving
hierarchical fuzzy system,†2015 IEEE Congr. Evol. Comput., no.
May, pp. 3163–3170, 2015.
[27] M. R. Sierra and C. A. Coello Coello, “Improving PSO-Based
Multi-objective Optimization Using Crowding, Mutation and ∈-
Dominance,†In International Conference on Evolutionary MultiCriterion Optimization (pp. 505-519). Springer, Berlin, Heidelberg.,
2005.
Downloads
How to Cite
Batoul Rashed A, A., Hamdan, H., Sulaiman, M. N., Sharef, N. M., & Yaakob, R. (2018). Multi-Objective PSO-fuzzy Optimization Approach to Improve Interpretability and Accuracy in Medical Data. International Journal of Engineering and Technology, 7(4.31), 316-321. https://doi.org/10.14419/ijet.v7i4.31.29943
Received date: October 7, 2019
Accepted date: October 7, 2019
Published date: July 6, 2018