You can turn off the part where it logs into the cloud and insert your own logging backend fairly easily.

Also if your research/biz needs are satisfied by sklearn, then why not just use sklearn? But for a lot of NLP systems, BERT is actually really really useful. And if you don't want to use a pretrained BERT, you can easily initialize their BERT implementation randomly and train it on your own data.