Please use this identifier to cite or link to this item: http://hdl.handle.net/10263/7257
Title: Estimation of Error Bound for k-Nearest Neighbor Classi er on Multi Class Data Sets
Authors: Bose, Kushal
Keywords: Error Bound, Penalty Function
Penalty Matrix
Issue Date: Jul-2019
Publisher: Indian Statistical Institute, Kolkata
Citation: 50p.
Series/Report no.: Dissertation;;2019:10
Abstract: A motivational problem that arises in machine learning is to estimate out-of-sample error rate of a k-nearest neighbor classi er. Without having any prior knowledge of distribution or any assumption of distribution it is required to estimate the maximum probability of misclassi cation of an unlabeled sample. Previous works include the assumption on data distribution as identical and independent distribution (i.i.d.). This method works for binary classi cation only. Our proposed algorithm is applicable for any data sets without having any knowledge of the underlying data distribution. Our algorithm will search the misclassi cation region in the data set and calculate the bound for an unlabeled test sample. Our method will always detect the class overlapping region within the data set irrespective of balanced and imbalanced. Our method is also designed for both two-class and multi-class data sets. Our experiments includes the bound validation for di erent scenarios. We have tested for random k value and xed range of k. Also veri ed for balanced and imbalanced data sets. We also demonstrated to nd optimal sets of k values where classi er error will be minimized.
Description: Dissertation under the supervision of Prof. Dr. Swagatam Das
URI: http://hdl.handle.net/10263/7257
Appears in Collections:Dissertations - M Tech (CS)

Files in This Item:
File Description SizeFormat 
M_Tech_Dissertation.pdf1.3 MBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.