Are you talking about the amazon library or an actual library that lends you ebooks? I'm assuming the latter, in which case you just plug in and transfer.
Epub can be downloaded directly from the library, but these have to be converted into a Kindle compatible format. I'm also unsure if every digital book copy has Epub as a format, since there are some digital copies that don't have Kindle format.
This has been true of all public digital libraries I've used in the past 10 years (Houston, Arlington, Fort Worth)