You have to use the auto layout feature within Figma to have a consistent output for now (I intend on relaxing this requirement, but auto layout makes things much easier). But you don't need to do anything external to Figma. There's a plugin (currently in review) and you will be able to manage everything from there.

Will come back to this post to give you feedback later.