It's not an answer to your question, but you may be interested in Alfred North Whitehead. He was initially trained as a mathematician and co-wrote some important works, but eventually shifted to religion and developed what is called "process philosophy."

> Beginning in the late 1910s and early 1920s, Whitehead gradually turned his attention from mathematics to philosophy of science, and finally to metaphysics. He developed a comprehensive metaphysical system which radically departed from most of Western philosophy. Whitehead argued that reality consists of processes rather than material objects, and that processes are best defined by their relations with other processes, thus rejecting the theory that reality is fundamentally constructed by bits of matter that exist independently of one another. Today Whitehead's philosophical works – particularly Process and Reality – are regarded as the foundational texts of process philosophy.

https://en.wikipedia.org/wiki/Alfred_North_Whitehead

Alain Badiou also wrote some books on mathematics. He is definitely outside of the "official canon" in analytic philosophy of mathematics. His math-related work seems to have been controversial among more traditional mathematicians and philosophers:

https://en.wikipedia.org/wiki/Alain_Badiou#Being_and_Event