I mean that is a significant reason mobile development is fragmented. Some things have to be tailored for the device if you want any kind of mass appeal or reliability.
I think it would be a huge mistake to NOT tailor a specific experience for a Linux phone since it would then be doomed to obscurity (more than just by fact of not being Android or IOS) like the million Linux desktop distributions that never "just get it" out of the box for 99% of people.