Well, my simple solution would be to delete the channel name from the prompt because it does not serve me any purpose. Too bad I don't actually know how to do this in irssi, I already looked for an option.