Support for Web cam pointed at keyboard

Hell, I'd like to point the camera to the door and have the view screen above the virtual monitor as sort of a rear view mirror. In addition, it can have a second view screen oriented match up with the real world door so I could turn around and it's like I'm looking there in real life.

Not as useful for the Vive but pretty useful for the Rift.

Seems like you'd need a tracker on the camera to be able to accurately determine its orientation, and even then,m without depth information, you couldn't place the image in the right place.

You could potentially achieve something similar by mounting a clip on your keyboard and attaching one of the controllers. You could then put a correctly-positioned model of your keyboard into the virtual world. The downside to this approach is that you wouldn't be able to see your hands.

Of course, a better solution would be to combine both approaches - with a tracked camera, a tracked keyboard you should be able to do a very good approximation. Still some issues.. your hands might not look quite right, and there'd be some desk, etc. visible at the edges of the keyboard, butj it should be perfectly usable.

The best option I can think of is to combine all of the above with an accurate model of your keyboard. That would potentially allow you to map only the keyboard outline from the camera feed. Still a hand problem but now, no excess desktop.

That said, the overhead required to do all those transforms and image masking might be excessive.

Would love it if I could setup a webcam and be able to place it's window in the virtual world. I love to flight sim. Flying VR is amazing but can't see my stick/throttle ect. Flying on a monitor (or even three) has a very limited field of view. Flying VR with a dedicated VR window to my controls would be the best of both worlds.