13

AUGMENTED REALITY

This week is the wildcard week, and I decided to play with the virtual reality (VR) and augmented reality (AR) techniques. My original idea was to use AR to develop something I can use to assist my experiments, something like using AR for tracking the chemicals in tubes. However, I later realized a 2D click-and-show is probably enough in our case as we have a finite and enumeratable workspace. So I essentially just went through the process of making an AR app and simply visualize a cube on my hand.

I downloaded Unity with its ARCore plug-in for Android. Mostly following this video, I took a photo of my hand, added into a reference image library, created prefab object for it. I used the Code from the tutorial and it eventually worked. The problem is it can only recognize the picture of my hand, but not my actual hand. I found out I should not use image recognition but should use something like ManoMotion module instead. I will explore it once I have time.

Another problem I ran into was that I got an error of "fail to get enough keypoint from target image" during my first trial with simple square patterns. When I chnage to a more complex figure, the problem was naturally solved.