You could technically do that but then you’d have to keep paying taxes to Germany on your income in the other country. And the other country will consider you a resident too and will want a chunk of that…
Double taxation should be taken care of by tax treaties. Usually you'd pay the maximum of the two tax rates in total, with your current residence country getting first dibs.