There's a big difference between "some pretty good points" and "don't have an ethical leg to stand on". If you're now acknowledging that there is in fact a reasonable case for anti-gouging, that's a step forward. Thanks.
Sure, one of Shkreli's attempts to gouge was partially thwarted by a competitor. Were all of them? Is there any guarantee that all future gouging attempts would be equally pointless? Of course not. Because, your free-market fundamentalism aside, markets fail all the time. That's why to get well-functioning marketplaces we outlaw a great variety of market-harming behaviors. Including things like price gouging for things people need to survive.
Markets are not ends in themselves. They exist, with extensive societal support, because they're a useful mechanism to provide a reasonable distribution of goods and services to humans in those societies. When parasitic actors use those mechanisms to cause societal harm, it's entirely reasonable to tinker with the mechanism.