A Resource Aware MapReduce based Parallel SVM for Large Scale Image Classifications

Guo, W., Alham, N., Liu, Y., Qi, M. and Li, M. (2015) A Resource Aware MapReduce based Parallel SVM for Large Scale Image Classifications. Neural Processing Letters. pp. 1-24. ISSN 1370-4621.

Full text not available from this repository.

Abstract

Machine learning techniques have facilitated image retrieval by automatically classifying and annotating images with keywords. Among them support vector machines (SVMs) are used extensively due to their generalization properties. However, SVM training is notably a computationally intensive process especially when the training dataset is large. This paper presents RASMO, a resource aware MapReduce based parallel SVM algorithm for large scale image classifications which partitions the training data set into smaller subsets and optimizes SVM training in parallel using a cluster of computers. A genetic algorithm based load balancing scheme is designed to optimize the performance of RASMO in heterogeneous computing environments. RASMO is evaluated in both experimental and simulation environments. The results show that the parallel SVM algorithm reduces the training time significantly compared with the sequential SMO algorithm while maintaining a high level of accuracy in classifications

Item Type: Article
Subjects: Q Science > QA Mathematics > QA0075 Electronic computers. Computer science
Divisions: Faculty of Social and Applied Sciences > School of Law, Criminal Justice and Computing
Depositing User: Dr Man Qi
Date Deposited: 12 Jan 2016 11:11
Last Modified: 12 Jan 2016 11:12
URI: https://create.canterbury.ac.uk/id/eprint/14209

Actions (login required)

Update Item (CReaTE staff only) Update Item (CReaTE staff only)

Downloads

Downloads per month over past year

View more statistics

Share

Connect with us

Last edited: 29/06/2016 12:23:00