You can combine HTMX with a SSG like Hugo and generate a bunch of partial HTML files that HTMX can load later on request. No server is required.

htmx simply expects hypermedia/HTML

whatever can serve that can be used with htmx: it is intended as a straight-forward extension of HTML

Github pages hosting your static content is a server...