OpenAI Playground will do that. Whether it's good quality I can't say. The RLHF models are too boring and the older ones are very hard to control.