Image-based Renovation Progress Inspection with Deep Siamese Networks

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

60 Lataukset (Pure)

Abstrakti

Various specialized machine vision systems have been proposed for item inspection, robot supervision and quality control in manufacturing and construction industries. However, construction industries are still lacking solutions for automating the progress inspection in building renovation projects. As smartphones becoming increasingly pervasive among construction workers and use of smartphone photos for documentation getting more popular, in this work, we propose machine learning methods for automatic progress recognition in renovation projects from smartphone images. Renovation progress inspection is formulated as an ordinal classification problem, with every class representing one stage of the renovation process. The baseline solutions inspired by the popular deep learning architectures like VGG19, ResNet, Xception, DenseNet and MobileNet do not benefit from the temporal property of the data. Consecutive stages share a substantial amount of visual features, which makes it difficult to differentiate between them. To cope with that, we design special networks - Ordering Nets which utilize the consecutive property of the classes to predict the order of a photo pair. For the special use case, we train the 1-Step- Net to recognize progress from two subsequent photos. The extracted order information increases classification accuracy and provides more precise temporal prediction. We report our results on a new Reno-2018 dataset - a two-part collection of photos that covers bathroom and kitchen renovation steps. The applicability of our approach is demonstrated on a simulated progress estimation task. Our method significantly improves the temporal accuracy of stage predictions compared to the base deep neural network models.

AlkuperäiskieliEnglanti
OtsikkoProceedings of the 2020 12th International Conference on Machine Learning and Computing, ICMLC 2020
KustantajaACM
Sivut96-104
Sivumäärä9
ISBN (elektroninen)9781450376426
DOI - pysyväislinkit
TilaJulkaistu - 15 helmikuuta 2020
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaInternational Conference on Machine Learning and Computing - Shenzhen, Kiina
Kesto: 15 helmikuuta 202017 helmikuuta 2020
Konferenssinumero: 12

Conference

ConferenceInternational Conference on Machine Learning and Computing
LyhennettäICMLC
MaaKiina
KaupunkiShenzhen
Ajanjakso15/02/202017/02/2020

Sormenjälki Sukella tutkimusaiheisiin 'Image-based Renovation Progress Inspection with Deep Siamese Networks'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä