A method for analyzing biometric data to assess the cognitive load and stress resistance of an agricultural unmanned aerial vehicle operator during mission planning

Taskina L.A. Abakumov L.A. Kazarkin T.D.

Журнал: Компьютерная оптика @computer-optics

Рубрика: International conference on machine vision

Статья в выпуске: 6 т.49, 2025 года.

Бесплатный доступ

We present a computer vision method to assess cognitive load and stress resistance of an agricultural unmanned aerial vehicle operator during mission planning in virtual reality. The approach combines geometrically rigorous gaze-to-user-interface mapping projecting the eye-tracker ray into widget space to obtain metrically correct hits on areas of interest, behavioral and ocular biomarkers, and image-like attention representations, such as heatmaps and recurrence plots. In a study with twelve participants across four scenarios, we recorded 1,198 interaction events and obtained 85.3 % accuracy of gaze-to-interface hits; with increasing difficulty, fixation durations shortened, transition entropy increased, and event-locked pupil responses became larger and slower to recover. Planning time and the time required for replanning increased, while route quality decreased under time pressure. The approach relies only on software–platform aggregate signals and does not use raw eye images, which supports privacy-preserving deployment and portability to ground control software.

agricultural; unmanned aerial vehicle; stress resistance; virtual reality; Unreal Engine; gaze tracking; mission planning

Похожие статьи в разделе Transport vehicle engineering

Quantification of the quality of image formation in virtual reality
Quantification of the quality of image formation in virtual reality

Kruchinin P.A., Kruchinina A.P., Odintsov M.A., Opanasenko E.A., Chertopolokhov V.A., Chuliukova E.A.

Reverse techniques as a means of increasing the validity of the cardio-oculometric diagnostics
Reverse techniques as a means of increasing the validity of the cardio-oculometric diagnostics

Brodovskaya E.V., Dombrovskaya A.Y., Zernov V.A., Lobanova E.V., Likhacheva E.V., Nikolaeva L.P., Ognev A.S., Rudenko M.Y.

Aerial vehicles detection and recognition for UAV vision system
Aerial vehicles detection and recognition for UAV vision system

Muraviev Vadim Sergeevich, Smirnov Sergey Aleksandrovich, Strotov Valery Viktorovich

Короткий адрес: https://sciup.org/140313283

IDS: 140313283   |   DOI: 10.18287/COJ1849