Yes, that's how Cell works. If you want to work with the data in place, you need a RefCell instead.
Because the counter is non-atomic and non-volatile the optimiser can sometimes optimise out the actual modification of the counter. It's not free, but it's not also not a huge expense.