That's right, and Rust bans that. The definition of "concurrently" typically means "without synchronization in between". An atomic access is by definition a form of synchronization.
This necessitates some level of synchronization.
http://www.open-std.org/jtc1/sc22/wg21/docs/papers/2007/n233...
There is a lot more explanation here that should cast some light on the situation: http://www.open-std.org/jtc1/sc22/wg21/docs/papers/2007/n248...