Yes, which is why it's important to regularly "shock" the pool to oxidize the chloramines, typically by superchlorinating the pool, but much more effectively by adding ozone.
Your comment on ozone made me do some quick searching, and [0] suggests to me that I should also run my pool pump for longer at lower RPM. I'm interested too in how I can minimise the cost of running the pool, which that will help with.
[0] https://aquamagazine.com/service/ozone-and-uv-systems-allow-...
It's extremely helpful to have a decent test kit, like the ones sold by Taylor. The color-change 'strips' are almost worse than useless, as they can often give misleading readings. The info at troublefreepool.com is also very useful when first learning this stuff.