Images of the simulation (top) and the hardware setup.
Summary
This project was created with researchers from Florida Tech's Atlas Lab under the Consortium Research Fellows Program (CRFP).
The testbed examines the impact of presenting UAS flight information via augmented reality (AR) technology on situation awareness, performance, and workload for sUAS operations.
Features and Design
Software
Unreal Engine 4
_
Hardware
Real flight sUAS USB controller
Contributions
Team:
Jack Hu
_
Collaborators:
Atlas Lab, Florida Tech
Meredith Carroll, PhD
Summer Rebensky, PhD
Kendall Carmody
Cherrise Ficke
Outcomes and Additional Information
The project featured two simulated interfaces. The first interface type was a simulated, traditional, heads-down display (HDD) in which system information was presented separately from the view of the aircraft and the environment. The second interface type was a simulated, heads-up display (HUDs) in which the system information was overlaid on the environmental view.
Follow on live studies were conducted matching the simulated testbed with less impacts observed to performance and situational awareness primarily due to learning curve and visibility in high brightness conditions.
The simulated testbed can be used in future research to explore different AR limitation impacts to performance and/or different information layouts.
The research compared participants' performance and line of sight usage in a simulated search and rescue task using both traditional and heads up configurations to identify differences.
The results revealed that:
There was a significant effect of interface type on situation awareness, with the simulated HUD resulting in significantly higher objective situation awareness.
Interface type was found to have no significant effect on workload, performance, or subjective situation awareness.
Situation awareness interacted with the order of display presentation and operator experience.
Publications related to this effort
Rebensky, S., Carroll, M., Bennett, W., & Hu, X. (2021). Impact of heads-up displays on small unmanned aircraft system operator situation awareness and performance: A simulated study. International Journal of Human-Computer Interaction, 38:5. https://doi.org/10.1080/10447318.2021.1948683
Rebensky, S.L. (2020). Set Your Sights High: The Effect of Heads-Up Displays on Situation Awareness and Performance for Small Unmanned Aircraft Systems. [Dissertation]. Florida Institute of Technology. https://repository.fit.edu/etd/60