You're right although multi-armed bandit problem doesn't address all the problems in the real world. E.x. adding different slot machines (prices) intelligently, or discounting past data without using magic parameters