Joint use of a low thermal resolution thermal camera and an RGB camera for respiration measurement

Recently, joint use of thermal camera and RGB camera has emerged as a potential solution for respiration measurement. Bulky and large thermal cameras with high thermal resolution have been mostly used in thermal-imaging-based respiration measurement studies. We aim to present a method for respiration measurement using an RGB camera and a low thermal resolution thermal camera. Thermal cameras with low thermal resolution are small in size and easily portable, allowing flexible and a simple implementation of the measurement system. First, the cameras were calibrated and synchronized using calibration objects and sound analysis tools, respectively. Second, a cross-spectrum mapping method was developed which was followed by the extraction of the respiration signal. Third, the extracted and reference respiration signals were aligned. In the last step of the proposed method, a signal processing framework was applied to the estimated and reference respiration signals. The performance of the cross-spectrum mapping method was visually evaluated. The mapping method performed well when a participant had little to no head movements, however, the performance decreased when head movements were present. Our analysis showed that there is a relatively good agreement between the proposed and the reference respiration measurement methods. The number of breathing cycles from the estimated respiration signal was computed with a decent accuracy. However, the accuracy of measuring breathing rate is low compared to the previous studies. The estimated breathing patterns were measured with better accuracy than in the previous work. This study demonstrates that respiration measurement can be done by the joint use of an RGB camera and thermal camera, that has a low thermal resolution, with a decent level of accuracy.