Yes, they are protected by the government by force and it's possible for someone to violate your rights.
This does not mean the rights are arbitrary. The right to life is a fundamental good agreed upon by pretty much every culture and civilization in the world. No one sanctions arbitrary killing.
You are starting to move into the world of moral relativism which is a false moral philosophy.
Even the utilitarian philosophy relies on some fundamental ideas about what is good and should be promoted.