I hit exactly the same problem in an old job I had. We had flexi-time and most people would work 10am - 6pm or so yet I decided to work 7am - 3pm.

The same hours, the same amount of work but you should see peoples faces when you walk out the office at 3pm...