The main problem: Many refugees are poorly suited for jobs in Germany’s highly skilled labor market and Germany hasn’t been very good at training them. To change that, Berlin is planning to introduce a points-based immigration system modeled on Australia’s or Canada’s next year.
German "Auslaenderfeindlichkeit" won't help either. I can tell you from experience witnessing it that it takes quite a while/a bit to convince a lot of Germans of someone and if they're unlucky, they will never get the chance to prove that they're qualified, because they get discriminated against simply because of their name or color of their skin is not the right one. German CVs basically require photos and other information that we don't even legally allow in the US/Canada (not that discrimination simply by name isn't happening there either). There are obviously exception where someone "made it". German "Stammtisch" culture will also pick up and amplify any criminal element within migrant or refugee populations and apply it in broad strokes to all of them instead of recognizing that there are obviously criminals among both German natives and migrant populations. That doesn't mean there aren't lots of law abiding ones.On top of that Germany obviously has the same issues as other countries as well: employers just don't want to hire at the salary levels they'd need to hire at in order to fill certain positions.
At the same time, job seekers face high hurdles in a rigid labor market that protects incumbents, requires lengthy traineeships and rarely recognizes foreign degrees, often forcing even specialists to retrain from scratch.
Which is not really much different in Canada either. Where else than Canada can you find the highest number of taxi/Uber drivers with a law/medical degree?