← Back ← Back

AR Solution for maintenance

During my summer internship in 2018, at Vaisala, I was working on a proof of concept and prototype for an Augmented Reality (AR) application for the maintenance of Vaisala’s weather station.

This application should help and support a worker in the field with their daily tasks. All the needed instructions and information are presented through the AR application, which can be accessed either by mobile devices or Microsoft HoloLens, to eliminate the need for physical manuals.


This project was implemented and helped along by Siili Solutions.


Year: 2018

Goal

To create a pilot version and a proof of concept for an AR solution, which would simplify the maintenance and installation of Vaisalas product.

Key Learnings

  1. Prototyping for 360°
  2. Designing for Augmented Reality
  3. Working with developers 
  4. Understanding how Augmented Reality can help for maintenance, troubleshoot and installation work

Challenges

  1. Identifying the key users and use cases for which an AR solution can be applied to
  2. Creating a prototype for handheld mobile devices and Microsoft Hololens
  3. Working with new technologies and environments that were beyond common UX tools at the time
  4. Creating and pitching a full working application, which could be tested to verify how AR can support Vaisala’s product

Process

1.
Research & Analysis

Identifying the user and user scenarios

2.
Design

Designing and iterating based on feedback

3.
Development

Supporting the development of the designs

4.
Delivery

Presenting and documenting the work

Research

User Research
To identify the use cases and the user I interviewed several people from the R&D team, who introduced me to Vaisala’s products and their current way of providing help to the customer and how their current products are troubleshooted.
Additionally, I attended training for installing Vaisala’s devices and was able to interview possible users about their current struggles and their needs for an AR solution.
 
Based on the research I analysed the data and created storyboards, and user journeys and -flows for different use cases. Finally we decided to focus on the weather station product and a main use case for installing the station. 
 
Technology Research
With the aim of using Augmented Reality it was crucial to understand how AR could be applied to help the user. What limitations were given when designing an AR for a mobile device or for an AR headset? What were the ways to interact within the AR and how should we design them?
 
By researching the technology I figured out the following things: 
  • Interfaces and objects need to be mapped within the real world
  • The movement and space of the user plays an important role, as it can affect what is seen 
  • The screen is not static anymore, but instead a full 360 degrees
  • Microsoft HoloLens provides new ways to interact, as the user is hand free when using the device
  • In HoloLens the navigation happens with the gaze

Prototyping & Testing

The UX prototyping tools, such as Figma or Sketch, had the problem that their designs cannot be tested within the AR environment. To implement them and test them would be too time intensive, however, as there were no other options given, I had to use what I had at hand.

As the user interacts with the real world, I used a photo of the product as a background and sketched the designs on it. This method gave me an idea of how the designs could feel like and how they could be tested for mobile devices.

However, the tools were limited and did not give any possibilities to test any interactions within the space. HoloLens could not be tested with them either. Therefore, I tried to come up with a quick solution to test the design, which did not require any implementations of the designs, as those would be too time intensive.

My approach for a quick low-fidelity prototype was: 

  • Imitating the gaze by using a stick with which the user hold to navigate with the interface.
  • Interfaces are on transparent foil and held in front of the device to simulate a similar AR experience.
  • All design interfaces and elements are drawn on the transparent foils and hold around the device which required a helping hand.

With this approach I could validate my designs and create a very authentic AR experiences. Because of this usability testing I was able to change quickly the designs based on the feedback.

Design & Implementation

The development was been done by Siili Solutions’ developer Sami Matero, however, as time and resources were limited, I was called in to help  to implement the parts of the user interfaces based on the wireframes.

Instead of reinventing the wheel, I reused existing UI elements from Microsoft HoloLens’ Unity toolkit and adjusted them to Vaisala’s context and created all the needed resources (images, content, graphics, marker, etc.)

Conclusion

The application was demonstrated and presented by me and the developer, and the stakeholders could get an idea of how AR could be applied to their products. Feedback has been collected for further development of this demo. 

All in all, the project was successful, as the goal of this internship was reached, however, there is room for improvement on the design: with more resources and time, for instance, modelling the 3D object instead of using 2D Illustration, improving the visuals, running usability tests with the application. Nevertheless, there is potential for the use case.
Scroll up