For qwen, it's an additional transformer layer at the very back, it ships as part of the model.