As long as you're going to add FP8 dense, you could do the same for the parts mentioned in the FP4 section. Divide by two from dense => sparse, and another two for FP4 => FP8.
That gives you 250 tops of fp8 for Spark.
That gives you 250 tops of fp8 for Spark.
No comments yet.