> Due to the large size of the model (314B parameters), a machine with enough GPU memory is required to test the model with the example code
What type of machine do you need to play around with this?
What type of machine do you need to play around with this?
So 8xH100 (80Gb each) should do it.
-Emad