What constitutes a dangerous level of arsenic in the diet is controversial. First, arsenic is an essential micronutrient similar to selenium, and with a similar toxicity profile. There isn't much science to support the notion that the trace levels commonly found in food and water represent a health risk. Second, the recommended arsenic thresholds set by the government were the product of efforts by environmentalists to make opening new mines impractical by setting the standard below background environmental levels for many types of mining. This was sold under the theory that "arsenic is toxic at any dose" but per the first point, it clearly isn't.
tl;dr: There was a lot of motivated reasoning and not much science behind the food and water arsenic recommended safe levels, and several regions of the planet are subject to significantly higher background levels with no ill effects. You definitely don't want to go out of your way to consume arsenic -- it is toxic at some dose -- but much of the discussion around the level of risk is misleading.