I was worried about this when I turned it on myself, but under the usage panel it shows that it limited my spending to just the $50 and that auto-reload is off, so it doesn't seem this would be the case.
Nope. I'm putting a lot of trust in American Express and the continued availability of Claude competitors.