Yes, in general, having a better router would probably help (although you haven't mentioned the exact model you have, maybe it's already fine and the problem is elsewhere).

Enabling SQM [1] would probably mitigate the issue further, at the cost of requiring more processing power.

[1] https://openwrt.org/docs/guide-user/network/traffic-shaping/...

The need for aqm is dependent on the status quo. Most providers nowadays use red/pie in the last mile and buffers-inducted delay rarely exceeds 100ms; much less so when it became clear that flow-queueing would be required and possible. Also multiple queues with codel on them have found their way into some wifi stack’s to deblot this access layer