TavernAI and SillyTavern both have pretty detailed guides on setting one up by downloading the models from HuggingFace and loading htem into their software.