In mine, it's been just the opposite: I've been working professionally for 16 years, and extended contact with non developers always helped. It didn't help me code faster, but it helped me code the right things, which is far more important than speed.
In my first job, We had separate infrastructure and development. Infrastructure had DBAs, Sys admins and specialists in random tooling, but nobody could code to save their lives. I managed to get myself sitting with infra, and not only I learned things that back then they'd not share with application programmers, but I could use my programming skills to deal with a lot of low hanging fruit. Today nobody in their right mind would train someone to know SQL and DB administration and know no general programming at all, because of how much power you lose by not coding... but there, it was a life saver.
At my next job I spent time programming from the back room of a retail store, stints in warehouses, and even with accounting. Then I could not just write code for them that made more sense, but even keep their goals in mind when working at a project with someone else.
At another job the company was doing heavy waterfall. The project I landed on had been going on for 2 years, but no developer had EVER talked to anyone in the user's department. It all went through business analysts and project leads. Needles to say, the internals of the system had nothing to do with the user's mental model, and the business analysts, which had no special training, were designing screens and answering questions, while they were badly informed. I used a fortuitous maternity leave by one of the leads to just spend a few days a week in another campus: One that had people that were not my users, but understood them far better than any analyst I had, and broke all protocol, redesigning some pieces of the system. When management came back, I told them that I wanted to show my changes to users, and they were ecstatic, as the changes were right on. A month later, my team was embedded with real business units, and management decided that, since we had better results than anyone else, that we could get away with not doing waterfall. All because I actually cared about what other people in the company were doing.
So sure, if you are sitting next to recruiting in an open office, and recruiting doesn't go into any closed booths to take calls, it's probably not so productive, but I have never worked at a place where getting to know what other departments are doing didn't multiply my chances of having more impact.