If my pre-coffee memory is correct, Macports only needs command-line tools for XCode.
xcode-select --install
That said, MacPorts is often opinionated, e.g. they package certain versions of some software and not others.