I don't think it's a big problem, as earth mass is already increasing my quite a few tons per day, from comets burning up in the atmosphere. If the asteroids are refined and processed in space, which makes more sense than trying to land them, it should be a non-problem.