So the question is, how do you achieve this?

[shapanwwuom]

There are countless factors that contribute to creating this sense of presence. I mean, first of all, obviously, being able to look around and keep the room around you. Getting good spatial audio is also crucial; if someone is talking, the audio needs to be 3D and come from where they are talking. It will be interesting to see which factors are ultimately important in creating this sense of presence and which ones are not.

Having hands is obviously important; if you can't just look around and move objects, it'll ruin the illusion. Hand tracking is important because it allows you to interact with objects. One interesting thing we found is that seeing your arms is actually not that important. You just have to see your hands. Apparently, seeing your arms is a bonus, unless we incorrectly infer where your elbows are.

If we look at your hands or use a controller, we can determine bc data singapore where your hands are, but that doesn't tell us where your elbows are. Your elbow can be bent in a variety of ways. If we get it wrong and you see your hand in VR but your elbow doesn’t appear to be in the right place, it creates a confusing experience. It is crucial to get these details right to maintain immersion.

Touch is also important. The most important aspect of touch is the hands. We have more sensory neurons in our fingers than anywhere else in the body, or maybe it's just higher-resolution sensations. When you grab something, you need to feel some reaction force. There are a lot of gaming systems today that give you a little vibration when you pull the trigger. We built a device similar to a table tennis paddle that has a sensor in it that allows you to feel the ball as it interacts with the paddle.

Just like the virtual ball hitting the ping pong paddle, it feels very different when you're playing ping pong. It's not a generic feeling; instead, you experience the precise point where the ball makes contact with the racket. We built a system that uses a real racket, and the haptics let you feel where the ball is going to hit it. All of these factors contribute to a more realistic experience in a virtual environment.