VR Version: HTC Vive, Unity

AR Version: Kinect, Vuforia, Unity and Mobile Phone

A client project from High School

3 Members, 1 Year

Roles: Programmer

• Designed and Implemented the whole system

Implement the VR Versinon

The VR version of the simulator could be divided into three parts, including visual effects, interaction system and reaction engine.

I was responsible for reaction engine. It fetches the reactants, concludes reactions and calculate reaction speed. To support reversible reaction and chain reaction, several data structures are used.

Besides, I also implemented some of the visual effects like dissolving, reflection and some particle systems.

Implement the AR Version - Object Tracing

The object tracing system is based on RGB-D images fetched from Kinect and an object tracing algorithm. I created the interface from Linux system to Kinect and made use of the algorithm.

The problem I came across is that the Kinect 2 is not supported well by current drivers so I needed to make some modifications on them.

Implement the AR Version

The AR system could be divided into three parts, tracing system, interaction system and the website communication system in between.

Implement the AR Version - AR System

I used Vuforia in Unity to build the augmented reality world. It could be divided into authoring system and interaction system,

The authoring system is designed and implemented based on the requirement from the client and their feedback.

The interaction system offering real sense of touching with the pose information of object being traced through network.