I finally feel justified! Not only do I get my hands dirty, but I also don't use soap unless water alone can't get them clean. Most of the time, our great universal solvent does a fine job without stripping my good bacteria.
Hard to find anything on it now, and I understand soap was particularly effective against SARS-CoV-2 compared to water alone (can I just call it the COVID-19 virus?) so it looks like the idea is mostly gone now.