Borges is "hard" because of his ideas of the infinite, time and so on, not because it's hard to understand what he writes. His Spanish is quite plain and easy to follow. That doesn't mean one understands completely the message.

I don't think any native Spanish speaker would have trouble understanding what he writes.