"And yet it seems clear that deep down inside, I would love to try it."

You've already decided what you want. So the only real question is whether you can afford it. That should be fairly straightforward to figure out.

It's not necessarily a bad sign that it pays less. Jobs that suck have to pay more, and vice versa.