You need to wait a bit for the reply button to appear. The site has a delay to prevent discussions from getting too heated. (The delay increases the deeper a comment thread gets.)
I learned about the reply button because I too was once wondering why it sometimes doesn't appear, and I Googled it.