HNHacker News
TopNewBestAskShowJobs

jcat123

47 karma · joined December 5, 2023

submissionscomments
jcat123··on Nearly 90% of our AI crawler traffic is from ByteDance
(disclaimer: i wrote that post)

It is not. We rely on more than User Agents because they are too often faked, so it is not just marketing. There are other signals we see that confirm whether the request came from a "legitimate" AI scraper, or a different scraper with the same user agent.

jcat123··on Nearly 90% of our AI crawler traffic is from ByteDance
More than user-agent, because user-agent cannot be trusted.
jcat123··on Ask HN: Global non-HTTP CDN provider
Hey, I work at HAProxy. Want to reach out to me in a DM on https://www.linkedin.com/in/jakubsuchyus/ and I'll see if I can connect you with our Edge team to see what we can do about your Asia -> NA needs?
jcat123··on Freenginx: Core Nginx developer announces fork
Jetbrains is Czech and most Czech people would get offended by your characterization of them as Russian.
jcat123··on HAProxy 2.9
Reverse HTTP is fascinating!