Embedded Files
In 2021, the AR Maintenance trainer initially built in 2020 was expanded to include an augmented reality (AR) component that would present a virtual object along with the guidance above the physical object being maintained.
In 2021, the AR Maintenance trainer initially built in 2020 was expanded to include an augmented reality (AR) component that would present a virtual object along with the guidance above the physical object being maintained.
Summary
Students at the GRILL® worked to integrate the HoloLens 2 to to the 2020 AR Maintenance trainer project, expanding the effort by including image tracking and 3D object recognition.
Features and Design
Software
Unity and C#
Vuforia Support
AR and Microsoft MR Toolkit
_
Hardware
HoloLens 2
Contributions
Team:
Elijah Crawford
Antoine Gagne
Anna Yang
Mentor:
Mr. Jerry Huggins
_
Clients:
O'Neil and Associates, Inc.
Mr. Dwight Oakley
Outcomes and Additional Information
The project goals included reviewing image tracking and 3D object recognition, implementing full-scale object recognition, automatically detecting equipment for maintenance, spawning and overlaying a virtual object over physical object, and creating easy to follow, step-by-step instructions with visual aids.
Microsoft's HoloLens 2 was explored as an AR head mounted device for the project.
The challenge came from O'Neil and Associates, Inc., a company that creates technical manuals for Fortune 500 companies. Using Vuforia and the Unity editor, the students successfully tracked and animated the physical palette jack inside the virtual world.
Future work was identified, including integrating text-to-speech capability, adding robust database security, and diversifying bbject recognition to include larger objects, less unique shapes, and additional components.
Google Sites
Report abuse