I totally agree, columnar databases have rendered "traditional" BI tool irrelevant and required the analysis and visualization layer to adapt to billions of records accessible via SQL.
We (EverythingMe) open sourced our own internal data visualization and collaboration tool which is used with our own Redshift setup - https://github.com/EverythingMe/redash