thumbnail

Topic

Technologies and technical equipment for agriculture and food industry

Volume

Volume 77 / No. 3 / 2025

Pages : 158-168

Metrics

Volume viewed 0 times

Volume downloaded 0 times

RESEARCH ON NON-INVASIVE DROWSINESS DETECTION METHOD FOR HARVESTER DRIVERS BASED ON MULTI-FEATURE FUSION

基于多特征融合的非侵入性收获机驾驶员困倦检测方法的研究

DOI : https://doi.org/10.35633/inmateh-77-12

Authors

Wei LIU

School of Agricultural Engineering and Food Science, Shandong University of Technology Institute of Modern Agricultural Equipmen

Kai RONG

School of Agricultural Engineering and Food Science, Shandong University of Technology Institute of Modern Agricultural Equipmen

Yi NIU

School of Agricultural Engineering and Food Science, Shandong University of Technology Institute of Modern Agricultural Equipmen

Ruixue LI

School of Agricultural Engineering and Food Science, Shandong University of Technology Institute of Modern Agricultural Equipmen

Haoxuan HONG

School of Agricultural Engineering and Food Science, Shandong University of Technology Institute of Modern Agricultural Equipmen

(*) Guohai ZHANG

School of Agricultural Engineering and Food Science, Shandong University of Technology Institute of Modern Agricultural Equipmen

(*) Corresponding authors:

guohaizhang@sdut.edu.cn |

Guohai ZHANG

Abstract

Driver drowsiness severely impairs the normal operation of harvesters, leading to casualties and economic losses. Effectively detecting driver drowsiness in harvesters remains a significant challenge. This paper introduces a lightweight convolutional neural network that identifies driver drowsiness in harvester operators by analyzing the driver's eyes, mouth, and head posture. The model comprises a lightweight CNN, a Long Short-Term Memory (LSTM) network, and an attention layer, achieving high efficiency and low latency. Experimental results demonstrate that the CNN-LSTM-Attention model effectively balances accuracy and computational efficiency, enabling rapid and precise drowsiness detection. This approach significantly improves safety during combine harvester operation.

Abstract in Chinese

驾驶员困倦严重影响收获机正常作业,造成人员伤亡和经济损失。对收获机驾驶员困倦的有效检测依然是重大挑战。本文介绍了一种轻量化卷积神经网络,利用驾驶员眼睛、嘴巴以及头部姿态对收获机驾驶员驾驶困倦进行识别。该模型由轻量化的CNN、长短时记忆网络以及一个注意力层组成,具有高效、低延迟的特点。实验结果表明,CNN-LSTM-Attention模型很好的平衡了结果准确性和计算效率,能够快速准确的识别困倦,对收获机驾驶安全产生重大影响。


Indexed in

Clarivate Analytics.
 Emerging Sources Citation Index
Scopus/Elsevier
Google Scholar
Crossref
Road