Not all ice creams, some of them. When I say marked I mean in general if you ask the store; doesn't need to be actually marked (though some foods are marked this way, even if they contain gelatin)
I've had ice cream where they specifically included gelatine as one of the ingredients. Also, some gelatos contain gelatine as well.