Even if you kill the spores, there can be toxic compounds produced by the fungi that won't be denatured by heat and end up being consumed.