In a sense spiders are part of the problem - insect killers. I keep one in the kitchen window, and a little jumping one lives on the bedroom roof, migrates across to the windows a couple of times a day, but all others strictly belong outside.
I love spiders but avoid touching them if I can.
If you don't like the idea of catching and caging spiders, keep one by a window. The small amount of webbing they leave isn't prominent, unless they have trouble climbing (like in glass terrariums).