I have one setup here https://github.com/Matsemann/oculus-fpv but it may be a bit overkill for this unless you're very interested. I'd go for a cheaper and smaller quadcopter if you want to fly like this, and instead of the transmitter/receiver for the video just buy a transmitter and a matching Fatshark goggle. It's the quickest way to get something flying, and if you like it then buy some more advanced stuff.

So a full setup:

* Cheap drone, cheap CMOS camera on the drone, video transmitter. Possibly a battery mounted on the drone if you can't steal power directly from it to the transmitter.

* On the ground a pair of Fatsharks (they have built in receivers) and a battery to power them.

I don't have exact product recommendations, but for instance the support on HobbyKing can help put together a setup where everything matches/works together.