I think by definition we'd be officially out of the ice age then? If I remember my climate class accurately, average temperature out of ice age is significantly higher...
I don't know what the definition would think of a situation where we usually had ice caps, but sometimes didn't. I tend to assume that would still count as an ice age, but presumably right on the threshold.