Carbon MTBs are pretty strong. Just don't clamp the frame so much you are crushing it and avoid direct rock hits, which will damage any material anyway.
I am also remind of the Danny M video of the carbon wheels test: https://www.youtube.com/watch?v=VfjjiHGuHoc
Given that I mostly ride my local volcano, this may not be a practical constraint for me.