Dokan provides FUSE support going back to Windows 7. There are also paid solutions with ExpanDrive and Mountain Duck, but in my experience Dokan+WinSSHFS [0] is easy to setup and works great.

[0]: https://igikorn.com/sshfs-windows-10/