Military
Military Applications for Extended Reality.
By leveraging advanced technology solutions like augmented reality (AR), virtual reality (VR), and extended reality (XR) our military personnel are able to acquire and refine crucial skills in a safe and virtual environment. Our solutions have dramatically improved complex training and operational readiness with customizable and highly interactive immersive environments that enhance safety, lower costs and reduce errors.
Use Case
The Explosive Ordnance Disposal (EOD) community operates across all military branches, handling some of the world’s most dangerous missions. To add to the dangerous and high stakes missions, EOD operators must undergo significant training to prepare for all the variants of their missions. To help revolutionize this worldwide training concern, AVATAR was funded by the US Marine Corps to create the Explosive Ordnance Disposal Augmented Reality (EOD AR) training solution. EOD AR incorporates a comprehensive Ordnance Library that includes interactive 3D models to aid in device identification. It also provides AR experiences that allow technicians to virtually explode ordnances into their individual parts, facilitating familiarization and providing training on proper assembly and disassembly techniques. EOD AR incorporates the Thermo Fisher Scientific identiFINDER R400, allowing technicians to engage in realistic hazard identification scenarios. By combining ordnance familiarization, virtual disassembly, and practical test equipment exercises, EOD AR provides essential knowledge and skills for safer and more effective EOD operations.
Use Case
Developed for the United States Air Force (USAF), the Augmented Reality for Nondestructive Evaluation (ARNE) platform revolutionizes the way Non-Destructive Evaluation/Inspection (NDE/NDI) is conducted. ARNE empowers inspectors, students, and instructors to train and perform inspections through an AR headset with overlayed instructions, sensor data, and visual data, guiding them through complex maintenance tasks with step-by-step AR cues. By integrating AI and IoT technologies, ARNE enhances inspection accuracy by automatically identifying and labeling inspection points, accelerating flaw detection while minimizing errors. The system creates a digital twin of the testing device, allowing inspectors to interact with the equipment, control the device remotely, and monitor sensor data through the HoloLens—completely hands-free. IoT integration allows for automatic classification and documentation of inspection results, complete with visual records, eliminating the need for multiple tools and reducing downtime. This innovative solution not only improves inspection speed and accuracy but also shortens training time and facilitates rapid development of training aids for future personnel. ARNE ensures the operational readiness and safety of USAF aircraft while minimizing maintenance disruptions, creating a scalable platform applicable to all aircraft in the fleet.
Use Case
The Advanced Mission Planning System was developed specifically to enhance the capabilities of Naval Special Warfare, addressing the need for dynamic and time-sensitive mission planning. Given the high-pressure nature of these operations, Navy Special Warfare personnel must rapidly plan, rehearse, and evaluate missions. To support this, AVATAR created a Real Time Decision Aid, a 3D planning tool designed for airborne and amphibious assault missions. This system enables seamless collaboration and the deconfliction of routes, jump points, and landing areas, while also accounting for critical environmental factors like weather, tides, and currents. The AR-based application integrates data from existing mission planning systems and incorporates AI for enhanced decision-making, allowing multiple command locations to participate in real-time, collaborative planning. Users can view the mission in both a bird’s-eye perspective or a first-person view, enriched with time, space, and positional data. This system transforms mission planning by offering a highly interactive and collaborative tool for streamlined execution in complex, fast-moving combat scenarios.
Use Case
The purpose of the Mixed Reality Secure Mission Planning System (SMPS) is to achieve integration and transfer of unclassified and classified Mission Planning data. Developed for PMA-281 with Amazon Web Services, the solution is designed to address the issue of Naval mission planning which largely operates as platform-specific isolated silos, largely via whiteboard or paper-based. The solution is a digitized SMPS architecture where data could be shared securely across collaborative stakeholders, providing Mixed Reality based visualization for mission planning and rehearsal. The SMPS architecture and processes will allow for better Mission Planning collaboration from currently isolated data silos, so naval aviators can recognize and exploit the value of centralizing and simplifying the process of Mission Planning information discovery, analysis, rehearsal and execution. The solution involved mapping and displaying how Mission Planning data can be shared collaboratively across the Navy, Ready Rooms, and disparate hardware, securely, and includes 3D visualizations to enhance training, Mission Planning visualization, and mission rehearsal.
Products and Technology Used
XRcreate
IMRSA STANDARDS
IMRSA is a global organization dedicated to standardizing the development and distribution of Extended Reality (XR) experiences, encompassing Augmented Reality (AR), Mixed Reality (MR), and Virtual Reality (VR). By establishing common guidelines for content tagging and functionality, IMRSA aims to streamline the XR development process, reduce costs, and enhance compatibility across different hardware and software platforms. This benefits a wide range of users, including businesses, government agencies, and educational institutions seeking to harness the power of XR technology.