Nothing irritates me more than people taking idioms literally, with the exception of discussions where strictness/correctness is required (e.g. engineers building a bridge, court proceedings, etc.)