I'm a fairly new user of it but perhaps https://www.draw.io/ would be useful (there are desktop clients to in addition to the multi-user edit capable Google Drive hosted option)
It has some very useful features
- open source
- saves to GitHub for version control and collaboration
- magnets / anchors on objects
- UML-style library
Doesn't look like you can collaborate concurrently though?