That's assuming you actually own the mineral rights, which are not necessarily the same as the land ownership itself. These are quite often separated and held by different entities. In practice, the extraction of oil under a parcel of land has almost no relation to what the land is being used for.