Cimo / Dina Molleshy

Robots play an important role in the manufacturing industry and there is an ongoing effort to empower robots the ability to monitor humans for human-robot collaboration (HRC). We propose radio sensing through millimeter-waves to provide safety and control to humans in HRC because of convenience, privacy, and performance in different lighting conditions. Accordingly, we place the radio on the robot arm providing the egocentric view to the robot. We provide safety by monitoring human motion and control by gesture recognition when the robot is static or moving. Finally, we provide an enabling system for HRC ensuring human safety and control. The project develops novel models and algorithms and generates unique data traces. The impact of the egocentric view will be significant as the models can be adapted to logistic and hospitality robots in motion for mapping of the environment and human interaction. Hand guiding can be extended for guiding objects in hazardous environments.