Have you tried using cabal sandboxes to work around your build issues?