Learn about headsets like the Meta Quest, design software like KeyVR and why XR has real benefits for engineers today.
Engineering may be the scientific discipline most concerned with reality. While mathematics and physics, for example, are interested in theory, engineering is focused on applying science to solve problems and modify the reality we live in. But what about other types of “reality”?
Virtual reality (VR) has long been a staple in science fiction as an immersive entertainment device, allowing users to interact with a virtual world. Today, digital displays, computer processing, and optics and sensor technology have reached a point enabling affordable VR devices, and they’ve found applications not only in entertainment and video games, but beyond, including art, education, medical science, engineering, manufacturing and design. Together, the different types of virtual and mixed reality technology are referred to as extended reality (XR).
Let’s take a look at the types of virtual and extended reality available for engineers, including the devices that run them.
Types of extended reality (XR)
What is virtual reality (VR)?
Virtual reality immerses the user in a computer-generated 3D environment. A headset equipped with displays and motion-tracking sensors fill the user’s field of vision with the image, and match the motion of the image to the head movement of the user, allowing the user to look around the virtual environment. Other peripheral input devices can also be used to move around within the virtual environment.
What is augmented reality (AR)?
Similar to the heads-up display on a fighter jet, augmented reality (AR) technology overlays computer-generated images onto the user’s field of vision. These devices employ transparent displays to allow light from the outside world to enter the user’s view. Motion tracking sensors are used to keep digital images aligned with the user’s vision relative to the real world. For example, if an AR device was used to give the user driving directions, an AR headset could use sensor data to display a “turn left” arrow at the correct place and in the correct orientation on the road. AR may also be experienced without a headset device. For example, some smartphone or tablet devices can use the built-in cameras and accelerometers to display not only the view from the camera, but also a virtual object that appears to occupy real space.
What is mixed reality (MR)?
VR involves interacting with virtual objects and not physical objects. AR involves interacting with physical objects with superimposed virtual images. Mixed reality (MR) brings the two together by creating an inter-reality experience in which the user interacts with both physical and virtual objects together. In MR, virtual objects are attached to physical objects.
How engineers are using VR, AR and MR
According to George Smith, marketing manager at Infisim, XR devices are useful in engineering for viewing and interacting remotely with designs and virtual objects. “Engineers may modify 3D models, simulate real-world settings, and interact remotely using these immersive technologies. AR, VR and MR help engineers optimize design processes, detect and fix difficulties early, increase training and skill development, and boost productivity and efficiency. These technologies enable engineers to innovate and optimize production processes, improving product quality and lowering costs,” Smith told engineering.com.
For example, in manufacturing, virtual reality may be used to explore and interact with a digital model of a piece of equipment, such as a turbine. A recent engineering.com survey found that XR in architecture, engineering and construction (AEC) is most commonly used for visualizing data, internal design reviews and stakeholder presentations.
An example of how AR might be used is in creating AR-enabled work instructions for maintenance or commissioning. PTC Vuforia is one product that enables this. With Vuforia, users see a virtual overlay indicating work instructions on their view of the physical part. This application speeds knowledge transfer and aids workers in following instructions accurately. As you can see from the below image, augmented reality can be a relatively basic experience, not requiring a dedicated headset device.
Mixed reality brings the two together. An example of a mixed reality experience could be a user wearing an MR headset performing maintenance on equipment, interacting with a digital model for reference while also working on the physical parts. The user could even interact with the digital model using their hands, just as with physical objects.
In manufacturing, one application for AR and MR that provides significant value is remote assistance. This enables a remote user (an expert) to patch into the view of a user on site (a technician with less expertise), and use voice communication while adding virtual images to the technician’s view to coach through the task. This saves travel time for more highly paid experts. For example, an offshore oil rig can save significant costs using XR remote assistance compared to flying the expert to the remote rig.
Most popular VR headsets with benefits and drawbacks
The most common piece of VR hardware is the HMD (head-mounted display), colloquially known as VR goggles or VR headsets. These devices may also come with controllers for manipulating the virtual environment.
VR headsets for engineers
HTC Vive Pro
The HTC Vive is an easy-to-deploy solution with a rich feature set. The HTC Vive may be a good fit for users new to VR, as it creates a virtual outline of the physical environment (the room you are using VR in) to remind users not to bump into objects. However, the Vive Pro requires a powerful PC and external tracking cameras.
Meta Quest 2 and 3
The Meta Quest 2 is a standalone VR headset powered by a Qualcomm Snapdragon XR2 system-on-chip. With a low price point ($300 to $400, depending on internal memory), it’s an easy option for exploring the world of VR. Primarily targeted at gaming applications, it’s nonetheless supported by some professional applications like KeyVR (more on that below).
In June 2023 Meta announced the successor to the Quest 2, the Meta Quest 3, which is expected to be available by the end of the year.
Varjo Aero
Varjo is an HMD manufacturer that makes XR devices including the Varjo XR-3 for MR and the Varjo Aero for VR.
One thing that sets Varjo apart is that professional engineers and designers are the main target of their products, whereas some other HMDs (including products not featured in this article) balance the consumer and professional markets.
The Varjo Aero is a VR headset. One benefit of the Aero is that it is designed to be light, which is a serious selling point when you’re wearing a computer display on your face. Like the XR-3, the Aero features high resolution and built-in eye tracking.
Varjo devices currently require a base station PC with powerful minimum specs. Varjo devices are also very expensive compared to other HMDs on the market. For comparison, the HTC Vive Pro 2 costs approximately $800, while Varjo’s website currently lists the Aero for $1990.
AR headsets for engineers
Magic Leap
Magic Leap is a dedicated AR headset designed for enterprise. As such, it has robust security and collaboration features relative to some consumer devices. Magic Leap offers software for virtual collaboration.
Android and Apple smartphones and tablets for AR
The current generations of Apple and Android smart devices support AR features, such as viewing 3D objects in your environment, or using AR software such as PTC Vuforia. However, many of these consumer devices are not designed for factory environments. In addition, viewing on a handheld device is less immersive, and does not provide the hands-free experience of a headset.
MR headsets for engineers
Microsoft HoloLens 2
The Microsoft HoloLens 2 mixed-reality smart glasses allow users to see their environment while also interacting with virtual images via gestures. All the sensors—including cameras for motion tracking and gesture recognition, and microphones for voice commands—are in the headset, obviating the need for external tracking devices. One drawback of the holographic display is that because it allows in environmental light, black appears transparent in virtual images. This device is self-contained and does not need to be connected to a computer.
Varjo XR-3
The Varjo XR-3 MR headset uses HD video cameras to create video pass-through to present the user’s physical environment, instead of a transparent display, such as that of HoloLens or Magic Leap. On its website Varjo claims its devices feature photorealistic displays with sufficiently high resolution that the user’s eye can’t see the pixels, which are sometimes noticeable on lower-resolution displays (such as smartphone-display headsets). The XR-3 also uses LiDAR depth sensors and hand and eye tracking.
Windows Mixed Reality headsets
There are several other HMDs on the market powered by Windows Mixed Reality, MR functionality that’s built into the Windows operating system. These include HMDs like the HP Reverb G2, Lenovo Explorer series, and others from hardware OEMs including Samsung and Acer.
Most popular engineering software for VR, AR and MR
PTC Vuforia
PTC Vuforia is an AR content development platform for industrial enterprise. The solution includes multiple apps: Expert Capture, Studio, Engine, and Chalk.
- Vuforia Expert Capture enables the creation of AR step-by-step instructions and AI-enhanced inspections to support front-line workers with expert knowledge.
- Vuforia Studio allows users to use 3D model data, IoT sensor data, and more to create AR experiences.
- Vuforia Engine is a software development kit (SDK) for creating augmented reality apps.
- Vuforia Chalk is a remote assistance tool which allows for live visual annotations.
Prospect by IrisVR
Prospect IrisVR is a VR tool designed to enable the most common applications for VR in architecture, engineering and construction, including viewing 3D models and plans in VR, and live immersive collaboration. One advantage of IrisVR is that it is headset-agnostic, and supports integrations with several popular engineering software tools, including Revit, Rhino and Navisworks.
TeamViewer Remote Assist AR
TeamViewer, a remote screen-sharing collaboration tool, has recently launched an AR assist tool which uses smartphone or tablet hardware to perform AR-enabled remote assist.
KeyVR
KeyVR is a product from software vendor KeyShot which allows users to import CAD into a VR environment. Users can view the model in a 360-degree virtual environment, including the ability to change materials and choose lighting. KeyShot claims the capability will allow users to make design decisions faster. The software also has a “connect” feature which allows multiple users to interact in the same virtual space, fostering collaboration.
Siemens NX
Siemens NX supports VR as a way to review designs at human scale, giving you the ability to get up close and personal with full size models. According to the company, NX Virtual Reality is integrated into the desktop application and accessible with one click, extending familiar interactions into a truly immersive 3D environment. In addition, NX support for VR includes multi-user sessions to facilitate collaboration.
Are VR headsets ergonomic?
One consideration for professionals and VR gamers alike is what wearing an HMD for eight hours might feel like on the eyes, face and neck.
A 2021 study performed by Defence Research and Development Canada, Human Factors and Ergonomics Considerations when using Augmented Reality Head Mounted Displays—Literature Analysis Report, reported that “evidence suggests that the use of AR HMDs is unlikely to result in deleterious effects associated with comfort and physical safety.” The literature review study examined effects in four categories: General safety concerns, cybersickness, musculoskeletal impacts and visual impacts.
However, a study published in 2020 in the Journal of Medical Engineering, Experimental Setup Employed in the Operating Room Based on Virtual and Mixed Reality: Analysis of Pros and Cons in Open Abdomen Surgery, reported “an increase in the physical stress and reduced comfort due to the weight of the Microsoft HoloLens device, along with drawbacks due to the battery autonomy.” Engineers and designers may not be using the HoloLens for as strenuous a task as open abdomen surgery, but it’s an interesting consideration nonetheless.
Research in this field is ongoing, and as with all digital devices, experts recommend taking breaks and stretching muscles to reduce strain and risk of injury while using XR devices.
