No, it wouldn't.
Health benefits from dry sauna start at a minimum of around 170ºF, but more typically at 180ºF, and often up to 195ºF. A "slightly too hot bath" would be around maybe 110ºF. Water at 170ºF would scald you within seconds.
Infrared sauna typically heats up to 150ºF, but this heats you from the inside, and so has a similar efficacy to 180ºF dry sauna.