1) As your project grows, it becomes unmanageable because the resource pipeline is hidden and you want to be able to improve that.
2) Skin mesh animation, which is the main point of using Unity in the first place, uses a compute shader which means they send all meshes from the CPU to the GPU every frame!
On the other hand Unreal takes 5 hours to compile and even Godot takes the same time as Unity ~30 min.
The only option is to fold your shirt sleeves up and build your own engine. It's not that hard really.