Similarity Technique Effectiveness of Optimized Fuzzy C-means Clustering Based on Fuzzy Support Vector Machine for Noisy Data
Abstract
Fuzzy VIKOR C-means (FVCM) is a kind of unsupervised fuzzy clustering algorithm that improves the accuracyand computational speed of Fuzzy C-means (FCM). So it reduces the sensitivity to noisy and outlier data, and enhances performance and quality of clusters. Since FVCM allocates some data to a specific cluster based on similarity technique, reducing the effect of noisy data increases the quality of the clusters. This paper presents a new approach to the accurate location of noisy data to the clusters overcoming the constraints of noisy points through fuzzy support vector machine (FSVM), called FVCM-FSVM, so that at each stage samples with a high degree of membership are selected for training in the classification of FSVM. Then, the labels of the remaining samples are predicted so the process continues until the convergence of the FVCM-FSVM. The results of the numerical experiments showed the proposed approach has better performance than FVCM. Of course, it greatly achieves high accuracy.References
L. Panigrahi, K. Verma, and B. Kumar Singh, Ultrasound Image Segmentation Using A Novel Multi-Scale Gaussian Kernel Fuzzy Clustering and Multi-Scale Vector Field Convolution, Expert Systems With Applications, vol. 115, pp. 486–498 , 2019.
E. Sert, and D. Avci, Brain tumor segmentation using neutrosophic expert maximum fuzzy-sure entropy and other approaches, Biomedical Signal Processing and Control, vol. 47, pp. 276–287, 2019.
F. Han, and R. Ellis, Identifying Consistent Patterns of Quality Learning Discussions in Blended Learning, The Internet and Higher Education, vol. 40, pp. 12–19, 2019.
J. Dunn, A fuzzy relative of the ISODATA process and its use in detecting compact well separated clusters, Journal of Cybernetics, vol. 3, no. 3, pp. 32–57, 1974.
N. Pal, K. Pal, J. Keller, and J. Bezdek, A possibilistic fuzzy c-means clustering algorithm, IEEE Transactions on Fuzzy Systems, vol. 13, p. 517-530, 2005.
K. Chintalapudi, and M. Kam, A noise resistant fuzzy c-means algorithm for clustering, IEEE Conference on Fuzzy Systems Proceedings, vol. 2, p. 1458–1463, 1998.
H. Khanali, and B. Vaziri, An improved approach to fuzzy clustering based on FCM algorithm and extended VIKOR method, Springer Transactions on Neural Computing and Applications, vol. 30, no. 179, p. 1-12, 2019.
H. Fritz, and L. Garcia-Escudero, Robust constrained fuzzy clustering, Elsevier Trans. Information Sciences, vol. 245, pp. 38–52, 2013.
M. Sabzekar, and M. Naghibzadeh, Fuzzy c-means improvement using relaxed constraints support vector machines, Elsevier Trans. Applied Soft Computing, vol. 13, no. 2, pp. 881–890, 2013.
M. Zarinbal, M. Fazel Zarandi, and I. Turksen, Relative entropy fuzzy c-means clustering, Elsevier Trans. Information Sciences, vol. 260, pp. 74–97, 2014.
M. Rostam Niakan Kalhori and M. Fazel Zarandi, Interval type-2 credibilistic clustering for pattern recognition, Elsevier Transactions on Pattern Recognition, vol. 48, no. 11, pp. 3652-3672, 2015.
S. Malek Mohamadi Golsed and M. Fazel Zarandi, Multi-central general type-2 fuzzy clustering approach for pattern recognitions, Elsevier Transactions on Information Sciences, vol. 328, p. 172-188, 2016.
H. Khanali and B. Vaziri, A Survey on Clustering Algorithms for Partitioning Method, International Journal of Computer Applications, vol. 155, no. 4, pp. 20–25, 2016.
A. Sefidian and N. Daneshpour, Missing value imputation using a novel grey based fuzzy c-means, mutual information based feature selection, and regression model, Expert Systems With Applications, vol. 115, pp. 68–94, 2018.
F. Bu, An efficient fuzzy c-means approach based on canonical polyadic decomposition for clustering big data in IoT, Future Generation Computer Systems, vol. 88, pp. 675–682, 2018.
A. Ramos, A. da Silva Neto and O. Llanes-Santiag, An approach to fault diagnosis with online detection of novel faults using fuzzy clustering tools, Expert Systems with Applications, vol. 113, pp. 200–212, 2018.
N. Heidari, Z. Moslehi, A. Mirzaei and M. Safayani, Bayesian Distance Metric Learning for Discriminative Fuzzy C-Means Clustering Neurocomputing, vol. 319, pp. 21–33, 2018.
C.-F. Lin and S.-D. Wang, Fuzzy support vector machines, IEEE Transactions on neural networks, vol. 13, no. 2, p. 464-471, 2002.
V. Vapnik, The nature of statistical learning theory, Springer, New York, 1995.
D. Gupta and B. Richhariya, Entropy based fuzzy least squares twin support vector machine for class imbalance learning, Applied Intelligence, vol. 48, no. 11, p. 4212-4231, 2018.
H.S. Yan and Y.F. Wang, Matching decision method for knowledgeable manufacturing system and its production environment, Journal of Intelligent Manufacturing, vol. 30, no. 2, p. 771-782, 2019.
J. Hamidzadeh and S. Moslemnejad, Identification of uncertainty and decision boundary for SVM classification training using belief function, Applied Intelligence, pp. 1–16, 2018.
H. Zhou, H. Qin and H. Shen, An Improved Fuzzy Support Vector Machine Algorithm Based on Refactoring Class Center, International Conference on Applications and Techniques in Cyber Security and Intelligence ATCI, pp. 91–99, 2018.
H. Samma, C. Lim and U. Ngah, A Hybrid PSO-FSVM Model and Its Application to Imbalanced Classification of Mammograms, Intelligent Information and Database Systems, vol. 7802, pp. 275–284, 2013.
W. Tang, Fuzzy SVM with a New Fuzzy Membership Function to Solve the Two-Class Problems, Neural Processing Letters, vol. 34, no. 3, pp. 209–219, 2011.
X. Zhou, P. Jiang and X. Wang, Recognition of control chart patterns using fuzzy SVM with a hybrid kernel function, Journal of Intelligent Manufacturing, vol. 29, no. 1, p. 51-67, 2018.
H. Khanali and B. Vaziri, A survey on improved algorithms for mining association rules, International Journal of Computer Applications, vol. 165, no. 9, pp. 6–11, 2017.
M. Tavana, R. Mavi, F. Santos-Arteaga and E. Dous, An Extended VIKOR Method Using Stochastic Data and Subjective Judgments, Computers and Industrial Engineering, pp. 1–29, 2016.
A. Asuncion and D. Newman, UCI Machine Learning Repository. University of California, School of Information and Computer Science, Irvine, http://www.ics.uci.edu/ mlearn/MLRepository.html, accessed June, 2020.
A. Macedo-Cruz and I. Villegas-Romero, Unsupervised Classification of Aerial Images Based on the Otsu’s Method, INTECH Open Access Publisher, 2012.
M. Halkidi and Y. Batistakis, On Clustering Validation Techniques, Journal of intelligent information systems, vol. 17, no. 2-3, pp. 107–145, 2001.
S. Sripada, Comparison of purity and entropy of k-means clustering and fuzzy c means clustering, Indian Journal of Computer Science and Engineering (IJCSE), vol. 2, no. 3, pp. 343–346, 2011.
E. Rendon, I. Abundez and A. Arizmendi, Internal versus External cluster validation Indexes, International Journal of Computers and Communications, vol. 5, no. 1, pp. 27–34, 2011.
Y. Liu, Z. Li and H. Xiong, Understanding and Enhancement of Internal Clustering Validation Measures, IEEE Trans. Cybernetics, vol. 43, no. 3, pp. 982–994, 2013.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
