what's the server spec?
Building on separate computer will work, of course, but it makes everything more complex.
Have it run on a schedule to keep it updated, if necessary. Alternatively, GH Actions allows you to set a manual trigger so you can rebuild whenever.