If they can't tell if you are working or not without physically watching you come into an office and sit at the desk for 40 hours every week, then WTF is your actual job? It certainly can't be something consequential that the business actually needs to have done. If it were, they would quickly notice if you aren't doing it.

(Edit: As a concrete example, I once worked on an all distributed team where it was abundantly obvious to the whole team that a new hire was goofing off. If they were simply having issues meeting productivity expectations, that would have been one thing, the kind of thing we could hopefully resolve with closer mentoring. But they were also really difficult to get a hold of during the day, and frequently made lame excuses - or obvious lies - for why they couldn't be available for meetings on short notice. Things like that.)