Make sure you exercise your core muscles - don't go overboard if you're just starting out and make sure you include some good stretches before and after.
Look at how you're sitting, make sure your chair gives you good support for your back.
Look at how you're sleeping, a bad mattress can give you all sorts of problems including back pain.