Arresting people and putting them in jail makes them leave the neighbourhood for a while. It doesn't solve the drug addiction problem, but it solves the feeling of unease and safety risks associated with being near drug addicts.
Being the only place in the region where drugs can be abused free from meddling influence can also pull in addicts from surrounding areas, only increasing the problem.