To put it another way: Time cannot exist without mass. Time only exists because everything is always in motion (at least a little bit) and--in our perception--we have a memory/frame of reference.
From the perspective of a photon it lives and dies in an instant. Even if it crosses the entire universe!
Protons and neutrons are not considered fundamental because they are made out of quarks and gluons.