I recommend you to read this old post about guess vs ask culture. You don't have to reply yes if you don't want to. Even if you are not working, you may have other reasons.

https://ask.metafilter.com/55153/Whats-the-middle-ground-bet...