The thing with Buddhism and perhaps any genuine spiritual practice is that the tools you acquire through working on yourself are powerful and useful, which is why secular people are drawn to yoga/meditation as "just" a practice.

The problem here is that by removing the spiritual side, you get the all the tools but none of the restraint required to wield them gracefully.