Major, big big major, not just me either. How is it alarming beyond words? If I said "Im an emt and I just ask the AI everything" now that would be alarming beyond words.
If anything screws up, that's people's lives being messed with, potentially in a way none of the engineers on staff know how to fix. If I were an actuarial in that environment I'd blow a valve.