Automatic Recognition of Workers’ Motions in Highway Construction by Using Motion Sensors and Long Short-Term Memory (LSTM) Networks

Monitoring and understanding construction workers’ behavior and working conditions are essential to achieve success in construction projects. The dynamic nature of construction sites has heightened the awareness of the need for improved monitoring of the individual workers on the sites. Although several studies have shown promising results in automated motion and activity recognition using wearable motion sensors, their technical and practical feasibility was not properly validated in actual jobsites. Motion recognition models have to be evaluated in actual conditions because the motion sensor data collected in controlled conditions, and actual conditions can have different characteristics. This study proposes Long Short-Term Memory (LSTM) networks for recognizing construction workers’ motions. The LSTM networks were validated through case studies in one bridge construction site and two road pavement sites. The LSTM networks showed classification accuracies of 97.6%, 95.93%, and 97.36% from three different field test sites, respectively. Through the case studies, the technical and practical feasibility of the LSTM networks was properly investigated. With the LSTM networks, it is expected that the individual workers’ behavior and working conditions can be automatically monitored and managed without excessive manual observation.