I found that changing my keybinding to start alacritty with this environment variable set seems to work:

  WINIT_X11_SCALE_FACTOR=1.0 alacritty

https://github.com/alacritty/alacritty/commit/93780ef0929e08...