I have sadly to use one M1 with 8gb and it is really painful.
I think that a normal user will feel the bad effect of the low ram amount but will not really realize where the problem is coming from.
Switching from one app to another is painfully slow. It might take 1, 2 or more seconds to go from one app to another in my opinion.
The os is really greedily evicting app memory once you switch to another window. And reload it when you come back.
I even have the personal hypothesis that Apple is keeping as-is the ergonomically awful Dock because of that. As it is difficult to switch between multiple windows of a single app, you can't easily realize how show you pass from a window to another. Like a magic trick.