gaborszucs/obebs

OBEBS method

OBEBS method

• obebs_func.ipynb contains the implemented OBEBS (Optimally Balanced Entropy-Based Sampling) method with adaptive assignment.
• obebs_demo.ipynb is a demo with MNIST dataset, it shows how to use the OBEBS method implemented in the obebs_func.ipynb iPython notebook.
• obebs_data folder contains the required files for the demo: Q.txt, X_pool.txt, Y_pool.txt, cluster_centers.txt, labels.txt.
• Unzip the X_pool.txt.zip to get X_pool.txt
• Please cite this article: Gábor Szűcs & Dávid Papp (2021): Zero Initialised Unsupervised Active Learning by Optimally Balanced Entropy-Based Sampling for Imbalanced Problems, Journal of Experimental & Theoretical Artificial Intelligence, DOI: 10.1080/0952813X.2021.1924871
• Link to this article: https://doi.org/10.1080/0952813X.2021.1924871

---

Abstract

Given the challenge of gathering labelled training data for machine learning tasks, active learning has become popular. This paper focuses on the beginning of unsupervised active learning, where there are no labelled data at all. The aim of this zero initialised unsupervised active learning is to select the most informative examples – even from an imbalanced dataset – to be labelled manually. Our solution with proposed selection strategy, called Optimally Balanced Entropy-Based Sampling (OBEBS) reaches a balanced training set at each step to avoid imbalanced problems. Two theorems of the optimal solution for selection strategy are also presented and proved in the paper. At the beginning of the active learning, there is not enough information for supervised machine learning method, thus our selection strategy is based on unsupervised learning (clustering). The cluster membership likelihoods of the items are essential for the algorithm to connect the clusters and the classes, i.e., to find assignment between them. For the best assignment, the Hungarian algorithm is used, and single, multi, and adaptive assignment variants of OBEBS method are developed. Based on generated and real images datasets of handwritten digits, the experimental results show that our method surpasses the state-of-the-art methods.