Noisy label relabeling by nonparallel support vector machine

Iranian Journal of Numerical Analysis and Optimization

مقاله 10، دوره 14، Issue 1 - شماره پیاپی 28، بهار 2024، صفحه 265-290   

نوع مقاله: Research Article

شناسه دیجیتال (DOI): 10.22067/ijnao.2023.84198.1307

نویسندگان

A. Sahleh¹؛ M. Salahi^{* 2}

¹Department of Applied Mathematics, Faculty of Mathematical Sciences, Rasht, Iran.

²Department of Applied Mathematics, Faculty of Mathematical Sciences, University of Guilan, Rasht, Iran.

چکیده

In machine learning, models are derived from labeled training data where labels signify classes and features define sample attributes. However, noise from data collection can impair the algorithm’s performance. Blanco, Japón, and Puerto proposed mixed-integer programming (MIP) models within support vector machines (SVM) to handle label noise in training datasets. Nonetheless, it is imperative to underscore that their models demonstrate an observable escalation in the number of variables as sample size increases. The nonparallel support vector machine (NPSVM) is a bi-nary classification method that merges the strengths of both SVM and twin SVM. It accomplishes this by determining two nonparallel hyperplanes by solving two optimization problems. Each hyperplane is strategically po-sitioned to be closer to one of the classes while maximizing its distance from the other class. In this paper, to take advantage of NPSVM’s fea-tures, NPSVM-based relabeling (RENPSVM) MIP models are developed to deal with the label noises in the dataset. The proposed model adjusts observation labels and seeks optimal solutions while minimizing compu-tational costs by selectively focusing on class-relevant observations within an ϵ-intensive tube. Instances exhibiting similarities to the other class are excluded from this ϵ-intensive tube. Experiments on 10 UCI datasets show that the proposed NPSVM-based MIP models outperform their counter-parts in accuracy and learning time on the majority of datasets.

کلیدواژه‌ها

Label noise؛ SVM؛ Mixed-integer program؛ Nonparallel SVM

مراجع