I bet the lag would be worse than the perspective. Even a few dozen milliseconds is noticeable by some people and you'd feel drunk or nauseated.
When I first started VR I would get sick, so I started to use it for 30 minutes at a time, then 1 hour, then more and more until I can handle 8 hours at a time (break at 4 hour mark). It just takes practice.
I feel like after some time (and some throwing up) you'd maybe get used to it.
There are diary entries of John Carmack about this. And a lecture on youtube
I've played enough racing games to say that the worse part about this is going to be when you have to go back to normality.
Are there videos of this?
Did this with a car once. It was a controlled enviroment, had one guy on an e-bike with the camera at the top of a poll and then I drove around the track with the headset on. Probably would've worked better if we'd gotten the tires aligned beforehand but it did work.
