This is not my experience at all. I have noticed some FPS drops when using the 'ultrahand' to move many objects around, but other than that I've been pretty impressed with the performance.
It still blows my mind that I can walk for what seems like hours from one end of the map to the other while the weather and environment changes drastically and not experience any loading screens.