Saying No is a skill you have to jump in and develop to get good enough at it to be responsible for others. It’s okay to say No for yourself, but keep in mind the other party may have a lot of practice saying No themselves.