RxSwift is just an implementation of Rx (Observable pattern) and doesn't really qualify as an architectural library and MVVM/MVP with proper separation of concerns should not be difficult to refactor to use another data binding pattern.

I overheard someone once say they used NotificationCenter as the data binding mechanism in an MVVM app. Big Yikes.