Classification of Trash and Valuables with Machine Vision in Shared Cars

Nilusha Jayawickrama*, Risto Ojala, Jesse Pirhonen, Klaus Kivekas, Kari Tammi

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

1 Citation (Scopus)
3 Downloads (Pure)

Abstract

This study focused on the possibility of implementing a vision-based architecture to monitor and detect the presence of trash or valuables in shared cars. The system was introduced to take pictures of the rear seating area of a four-door passenger car. Image capture was performed with a stationary wide-angled camera unit, and image classification was conducted with a prediction model in a remote server. For classification, a convolutional neural network (CNN) in the form of a fine-tuned VGG16 model was developed. The CNN yielded an accuracy of 91.43% on a batch of 140 test images. To determine the correlation among the predictions, a confusion matrix was used, and in addition, for each predicted image, the certainty of the distinct output classes was examined. The execution time of the system, from capturing an image to displaying the results, ranged from 5.7 to 17.2 s. Misclassifications from the prediction model were observed in the results primarily due to the variation in ambient light levels and shadows within the images, which resulted in the target items lacking contrast with their neighbouring background. Developments pertaining to the modularity of the camera unit and expanding the dataset of training images are suggested for potential future research.

Original languageEnglish
Article number5695
Number of pages15
JournalAPPLIED SCIENCES
Volume12
Issue number11
DOIs
Publication statusPublished - Jun 2022
MoE publication typeA1 Journal article-refereed

Keywords

  • vision-based
  • shared cars
  • prediction model
  • classification
  • convolutional neural network
  • camera module
  • WASTE MANAGEMENT
  • DEEP
  • GARBAGE
  • MODEL

Fingerprint

Dive into the research topics of 'Classification of Trash and Valuables with Machine Vision in Shared Cars'. Together they form a unique fingerprint.
  • Shared 21010-2021

    Tammi, K., Jayawickrama, N., Kivekäs, K., Keskinen, H. & Ojala, R.

    01/01/202131/12/2021

    Project: EU: EIT

  • Shared 20007-2020

    Tammi, K., Kivekäs, K., Jayawickrama, N., Ojala, R. & Pirhonen, J.

    01/01/202031/12/2020

    Project: EU: EIT

Cite this