Even though one can say "two people", to me it feels that "less people" or "fewer persons" are more correct than "fewer people".

On another note, see how "fewer times" and "less time" means different things (might help clarify the distinction to some.)

(Non native speaker here though.)