Ask HN: I shipped my first product, now what?

Long time reader, first Ask HN. I shipped my first product www.jamaicanize.com. It may not appeal to most hackers but the site is getting a decent amount of visits/day. I appreciate all your comments :)

I've been testing new features but most users ignore them and go directly to the translator page (core feature). For instance, there was a dictionary page but it got less than 10% of the total visits.

At what point do I stop tweaking the layout, ad placement and move on to something else?

Thanks