Out of curiosity, do you move your hands a lot when talking? A coworker uses his Fitbit daily, but has mentioned that it falsely reads his arm movements when he talks (which he does a lot of hand waving and other movements).
I worked a physical job, stocking books and filling book orders for a summer while in college[1]. I used a pedometer and rarely went much above 10k steps (for the 8 hour shift anyway). That's walking basically for 8 hours straight (with stops to place or grab a book).
[1] - not my only physical job, but the one I walked the most, and the only one I ever had a pedometer on.