I'll take your advice by following up with an invoice overdue e-mail next week, then a final reminder 4 weeks later.
I'm in Scotland. If the invoice remains unpaid after that period I will take the client to the Small Claims Court. It's very typical that if a case is submitted to that court, the accused ends up paying the invoice before the hearing date.