You're correct in the short term but Venus only has four times the nitrogen content of Earth which might sound like a lot for now but in a fully developed Dyson swarm, will prove to be inadequate. It might turn out to be a non issue since we might be able to simply transmutate it into existence by recycling more abundant materials with fusion but there is still a lot of unknowns with the actual engineering constraints of controlled fusion.