Seems like download the weights would be the most flexible option. HF and inference providers would be nice to have.