Some Androids have a separate volume control for notifications. Settings -> Audio(Sound) -> Volume. (I think it may be in all but not exposed by the UI, so you may want to try widgetsoid or some other widget to expose the volume controls).
Failing that I think you can set the notification ringtone to "Silent".