x=clerk.seattle.gov
printf 'GET / HTTP/1.1\r\nHost: '$x'\r\nConnection: close\r\n\r\n' \
|nc -vvn 156.74.251.24 80
There's a line in the fwd proxy config for these rare situations where I need to use HTTP without TLS
use_backend b407-notls if { hdr(host) -m str -f /somedir/hosts-notls.txt }
Normally the proxy will use TLS for any request from any application, not just a web browser, regardless of whether URL begins with http:// or whether it's sent to port 80
To avoid HSTS supercookies^1 I can also add a response header
http-response add-header Strict-Transport-Security max-age=0
but I have not needed to do that.
1. https://nakedsecurity.sophos.com/2015/02/02/anatomy-of-a-bro...
If the site is on some pre-approved list compiled into the browser, I can remove it and recompile. But I am not interested in such user-hostile browsers for frequent use. Good for online shopping, banking, other commercial transactions, but not for non-commercial purposes.
The ubiquity of TLS is of course a relatively recent phenomena
It seems like Internet Archive still does lots of crawls of port 80; I wonder if that's also true for Common Crawl
If so, it's interesting to think about how much of the data used to train ChatGPT and other AI may have come from crawls over port 80
On ChatGPT data sources:
https://www.searchenginejournal.com/how-to-block-chatgpt-fro...