You're most probably right.

  $ time git status
  real 0m0.324s
  user 0m0.197s
  sys 0m0.425s

That's on a working tree with 314,708 files and no watchman.