There are some competitions with crowds. They're effectively strongman comps but solely with stones, and they're getting more popular.
Generally, you're alone or in a small group. So your idea of a lone man stalking across a Scottish moor isn't too far off. Usually no lycra though.