Fast and Accurate Multi-Neural Network Ensemble Model

Abstract

In image classification, having a high accuracy is a significant metric for a model. Therefore, some certain methods such as ensemble technique etc. are commonly used for this objective. However, while trying to achieve high accuracy, other important metrics such as training time must also be considered. Transfer learning method is widely applied in image classification to reduce training time and enhance model efficiency. Even though transfer learning with models such as AlexNet, VGG16, and DenseNet121 is applied on some image datasets, it requires a great amount of training time to achieve high accuracy. In this study, we propose a model that utilizes weighted voting ensemble technique with an auxiliary network. We evaluate our model and pre-trained models - Alexnet, VGG1, and DenseNet121 - on CIFAR-10 dataset. The results show that the proposed model outperforms pre-trained models in terms of achieving high accuracies and requiring less training time. To achieve 80% accuracy, our model requires 15,38%, 10%, and 87.78% of the training time used by Alexnet, VGG16 and DenseNet121, respectively. While the proposed model achieves 85% and 90% accuracy, AlexNet and VGG16 cannot. In addition, it achieves 90% accuracy in 38.23 min, whereas DenseNet121 - more efficient than the other two pre-trained models - only reaches 87% accuracy in over three hours.