https://en.wikipedia.org/wiki/List_of_former_European_coloni...
The Baltic States and Ukraine were part of Russia when it went through its imperialistic/colonization phase, reaching into Alaska and Mongolia, and Fort Ross as noted on the linked page.
The German Empire is conveniently listed as Germany on that page, which leaves out the fact that the German Empire consisted of land that is now part of the Czech Republic, Poland, and Lithuania.
Of course, these modern day countries were some times subjugated much in the same way that true colonies were subjugated. That being said, I don't think it's fair to say that Western Europe is solely to blame for world wide colonization.
The thought of those vikings sucking the fertile soil of Greenland dry fills me with guilt.