Have you looked at QGIS? You can drag OSM files onto it and add layers from loads of different data sources. It's a GUI app that runs on Windows, MacOS and Linux.
It can, however, be used for any lightweight overlays (with QGIS Server). I remember someone from the Polish community set up some OSM data QA that worked quite fine.
I ruled out QGIS simply because of the fact that it's a native app and not a JS library.
Also, Paul Ramsey's pg_tileserv isn't on your radar, is it?
Also, LeafletJS supports GeoJSON overlays.