You are assuming that demand is constant, but oil can be replaced by other sources of energy. Whith a high price of the oil there are electricity generatora that do not profit, so they don't generate energy, leaving space for other cheaper sources.

Also, it is arguable that other costs, such as car gas rises, some people will use public transportation. This sustitution effect can be applied to many other examples.