Can you and should you measure success of your UX Department?

Yes and yes, but it’s even more important to understand how to do it correctly to keep everyone happy and content with their work.