Report

Teaser, summary, work performed and final results

Periodic Reporting for period 1 - EXTEND (Resolution Revolution to Extend Reality)

Teaser

The aim of the project is to build the 2nd Generation Varjo head-mounted display to realise the full potential of both of our novel technologies.By the start of the project we are finalising the launch of 1st Generation commercial product that utilizes our Bionic DisplayTM...

Summary

The aim of the project is to build the 2nd Generation Varjo head-mounted display to realise the full potential of both of our novel technologies.

By the start of the project we are finalising the launch of 1st Generation commercial product that utilizes our Bionic DisplayTM. The SMEI project focuses on the next big step in our business strategy - commercialising our video-see-through technology and becoming an XR solution provider.

The project was originally planned to be 18 months but we are planning to submit an amendment to extend the project to 21 months.

The project’s activities can be divided into three categories:
1. Product development
We will finalise the product development of the video-see-through front-plate hardware and design motion controllers that truly complement the unparalleled potential of our human-eye-resolution capable product. We will also build software for operating both and prepare for mass-manufacturing.
2. Pilots
We will pilot our Gen 2 front-plate with first professional users to collect and analyse market segment specific customer feedback.
3. Commercialisation activities to support the market launch

To take a full advantage of the improved product offering, we aim to update our commercialisation plan, carry out wide-scale dissemination and communication activities among potential customers, and build strong sales channels suitable for global commercialisation.

The expected outcomes of the EXTEND project are:
• Market ready 2nd Gen system (head-mounted display and controllers);
• Capability to start mass-manufacturing of the 2nd Gen system;
• Strong market reference and validation for 2nd Gen system form successful pilots;
• Wholesale agreements and VAR network suitable for global expansion.

Work performed

Work Package 1
During the reporting period, we have nearly finalized industrial, mechanical and electronic design for the Second-Generation Front-plate product, and created the associated design data: mechanical drawings, digital 3D models, electronics schematics and layouts.
We have hopefully solved all major 2nd Generation front-plate design challenges with the current design, and proceed swiftly towards the next build, build B2. The build B2 is an enhanced version of the first build B1 prototypes, which was manufactured in a series of 20 units. These units taught us valuable learnings of thermal design, optics focusing, gluing and calibration processes, as well as effect of thermal phenomena to optics. We utilized build B1 units to stabilize its electronics and firmware, and as a development and design verification platform towards the B2 builds and mass production.
One very important result is the feedback we have received through the presence at major exhibitions, such as CES and ITSEC. The feedback has given the courage that we are definitely on the right track, as well as indicated some development items.
After implementing manufacturer feedback, we are ready to start to manufacture the mechanical tooling and printed circuit board, as well as to purchase the components for the builds B2 and B3. We also have good understanding of how the manufacturing and testing processes should be arranged.

Work Package 2
During the reporting period, we have not been proceeding according to the work plan with regards to the motion controller work due to multitude of reasons. Evaluation of different technologies have taken longer than expected, underlying market situation has evolved during last year and company focus has been more on the finalization and launch of the 1st generation front-plate, to name a few.
As a result, controller development work will continue longer than originally planned and which is why we need to extend the project. Objectives and tasks of the controller work package remain unchanged apart from the schedule, some subcontractors will potentially change during the cause of action.

Work Package 3
We have done some changes in our piloting partners and will now be collaborating with Volvo, Bohemia Interactive and a third partner (discussions still on-going).
Pilot with Volvo has been proceeding well according to the plans and we have been able to test and verify our 2nd Gen front-plate use cases in real-life situations. This has yielded a number of improvements to our software and extended our compatibility with alternative tracking solutions.
Activities in simulation pilot with Bohemia Interactive have recently been started and we have high expectations for results also from that pilot case. Third pilot partner is still under discussion and we will start activities within coming months.

Work Package 4
We successfully started with our B2 Roadshow at the end last year. We were working on our website Varjo.com, which is our key sales channel and also the digital centre of commercial operations. We participated in several shows and conferences and confirmed that there is a great interest in our products.

Work Package 5
We have carefully followed the work plan set out in the EXTEND proposal. There have been some obstacles and some R&D work has taken longer time than planned, which is why we are planning to launch an amendment to extend the project and some tasks. However, work is still progressing nicely and with good results. All dissemination and commercialisation activities are on track and all the deliverables of the first period have been submitted.

Final results

Mixed reality work package (WP1) has enabled Varjo to surpass the competition technically. Final production preparation builds for the mixed reality add-on are in progress, all risks have been mitigated and everything seems on-track to enable add-on product launch during Summer 2019. During front plate design work many findings were discovered that will be taken to subsequent prototypes. Software work has been able to proceed with the previous prototypes strongly, and technological milestones have been met.
One of the key metrics for video-see-through (VST) is latency, from the time of light hitting sensor to the representation of the light being emitted from the display. We have achieved an imperceptible delay, which keeps the visual true-to-life. Additionally, Varjo has made new algorithms that fuse the data of traditional VR tracking and enable that to register virtual objects accurately and stability in the real world.
We have partnered with several European companies during the project. Separate testimony on this is given, but cars have been driven on real (but closed) roads at high speed seeing only VST based reality, altered by virtual changes. The future direction could be to let more pilots and drivers consider video feeds as the primary way of perceiving the world, and the impact to systems (planes, trucks, armoured vehicles) of not needing any optical openings on these things. Varjo VST is at the forefront of such developments.
Controller work package has proceeded in two stages. Designs of controllers have been made for multiple tracking technologies. Evaluation of said tracking technologies has been done simultaneously. Technology selection took longer time than expected due to unforeseen issues in optical tracking technology and later decision to switch to magnetic tracking. Ultimately technology selection allowed Varjo to begin development of the most ergonomic, accurate and reliable controller technology.

Website & more info

More info: https://varjo.com/.