I never do the export/import process for that exact reason.
If I need to move a VM for some reason, I copy the entire VM directory to the new location then open VirtualBox and use "Machine" -> "Add ..." and select the directory with the VM config and files.
I hope that helps, unless I missed something.