People are pretty cagey about what they use in production, but yes, speculative sampling can offer massive speedups in inference