Dashcams (or rather fancy backup+ systems) already do this! They take 4 or more cameras, assume the top of your car is bland, and stitch them together. Super cool tech.
I did that once, albeit walking, not driving, and the drone had no auto flight programming.
It was really hard to do anything more than walking on flat ground. Bumpy ground, difficult. Try to grab something on a shelf, difficult. This was a few years back, so tech is better, having auto follow would free up some brain power, but it'd still be real rough.
There's a video of a bunch of soccer players trying to play using VR and a camera above the field, it's got some funny moments.
They did that with a 30-40 foot stick a few years ago, and the initial attempts by the driver were hilarious. They didn't show improvement because I'm sure it wouldn't be as funny, but I think we all forget how difficult it first was to match up how far to push the stick left or right for a particular turn. Now imagine an actual wheel.