They are natives to all of Virginia and they are shade loving trees. They actually prefer shade as young trees and not until they are fully mature can then tolerate sun.
Source, lived in VA for a decade, hunting for wild pawpaws and growing my own trees. Before we moved out of the state we had a pawpaw "collection" of about fifty (ten we owned, approx forty we found in the national forest and harvested yearly).