I typically do the same thing. I only wear sunscreen if I am planning on being in direct sun for an extended period of time where I can't easily get back in the shade.
The more you're able to build up a base tan the less you need it to avoid a burn at least.