Hacker News Reader

Comment by flexagoon | Hacker News Reader

I assume that's because the IP range of your company network overlaps with a range used by some scrapers, and if it doesn't happen on your phone even in the corporate network, then IA probably checks some extra signals like the user agent in addition to the IP

View on HN

Are there any decent/reputable residential proxy companies? I’m pretty sure I’ll end up needing one occasionally, for those days when my residential IP has a poor reputation score.

No, they are all grey-market. Some have more professional-looking websites, but they're all using the same proxies. This should not prevent you from using them.

There are definitely factors beyond IP being used. A week ago I found that all requests from Chrome-like browsers got a 429 across more than a half dozen networks and several machines, while Firefox reliably worked. I assume this was an overzealous policy on UAs.

In my work, it's failing on both Firefox and Chrome.

No - my phone is not connected to work's WiFi.

Wonder who the bad actors in my company are...

Doesn't have to be someone at your work, it could be a block on a whole ISP network or at least an IP subnetwork that is shared between many clients

You can try emailing the address mentioned in their post so they adjust their filters to match just the bot networks more precisely

You should file a support ticket with your manager and the IT security or support desk. Show them the evidence of 429s that are blocking your assigned tasks during working hours. Also include the screenshots and files that you downloaded on your personal device in order to access your work-related materials. Be sure and thank them for adequately configuring the MDM on your personal mobile device so that you could do these work-related tasks. You should definitely also file an expense report to request reimbursement of your personal mobile bill, any data charges incurred, and the hours of networking or collaborating with external colleagues, while you were working on these work-related projects with your personal device.

Not sure if you're posting as a joke or sarcasm but accessing archive.org is not relevant to my work.

Well I'm not gonna lie: the comment was generated by a neural net. In decades to come, scraping will liberate all forum comments from context, hypertext, and subtext alike.And our immortal human souls shall

It might just be your corporate VPN and whatever ASN it’s being routed through.

Reply on news.ycombinator.com