Parallel execution of distributed SVM using MPI (CoDLib)

• Main Authors: Salleh N.S.M., Suliman A., Ahmad A.R.
• Other Authors: 54946009300
• Format: Conference paper
• Published: 2023
• Subjects: Distributed SVM; LIBSVM; Message Passing Interface (MPI); Support Vector Machine (SVM); Cluster computing; Data mining; Information technology; Message passing; Parallel architectures; Computational time; Data classification; Data sets; Distributed and parallel computing; Memory requirements; Message Passing Interface; Multiple machine; Parallel executions; Support vector; SVM algorithm; Training time; Support vector machines

Support Vector Machine (SVM) is an efficient data mining approach for data classification. However, SVM algorithm requires very large memory requirement and computational time to deal with very large dataset. To reduce the computational time during the process of training the SVM, a combination of distributed and parallel computing method, CoDLib have been proposed. Instead of using a single machine for parallel computing, multiple machines in a cluster are used. Message Passing Interface (MPI) is used in the communication between machines in the cluster. The original dataset is split and distributed to the respective machines. Experiments results shows a great speed up on the training of the MNIST dataset where training time has been significantly reduced compared with standard LIBSVM without affecting the quality of the SVM. � 2011 IEEE.