hubraumhugo

Appreciate the feedback, will try to iterate it to greatness further. It's still a bit hit or miss, but I've made a few improvements:

- improved prompts with your feedback

- added post/comment shuffling to remove recency bias

- tried to fix the speech attribution errors in the xkcd

Thanks, you got a great tagline!

The xkcd should be saved and cached once generated, I'll look into the issue.

How would you improve saving?

Server is melting a bit, looking into it.

EDIT: a retry worked. Enjoy: https://hn-wrapped.kadoa.com/jaggs

The salt race condition comic made me laugh :D

You can get your HN profile analyzed and roasted by it. It's pretty funny :) https://hn-wrapped.kadoa.com

No gemini-3-flash yet, right? Any ETA on that mentioned? 2.5-flash has been amazing in terms of cost/value ratio.

Kadoa | Web Scraping/Software Engineer | Remote | Full-Time | https://kadoa.com

We’re automating web scraping at scale with AI. Web scraping used to be the same for decades (writing and maintaining rule-based scripts for each source), and we're fully automating that process with LLMs. We're also heavily focused on making ethical scraping the default (robots.txt checks, rate limiting, any custom compliance rules).

But we can't do it alone. We are looking for people who share our passion for software craftsmanship, data, and AI. We are growing fast, have a “no-bullshit” policy, and try to minimize the distance between the code you write and the customers who use it. We iterate to greatness :)

We're currently looking for a senior web scraping engineer: https://www.kadoa.com/careers/web-scraping-engineer

If that sounds like you, please email me at (adrian at kadoa dot com) and mention HN in the subject line. Ideally you include an ETL or scraping project you've been working on in the past.

What's the endgame of this increasing arms race? A gated web where you need to log in everywhere? Even more captchas and Cloudflare becoming the gateway to the internet? There must be a better way.

We're somehow still stuck with CAPTCHAs (and other challenges), a 25 years old concept that wastes millions of human hours and billions in infra costs [0].

[0] https://arxiv.org/abs/2311.10911

Why does everyone think chat is better UX than traditional interfaces? I get the AI hype, but so many products are not a fit for chat interfaces.

Why would I use a chat to do what could be done quicker with a simple and intuitive button/input UX (e.g. Booking or Zillow search/filter)? Chat also has really poor discoverability of what I can actually do with it.

thanks, just deployed an improved error handling

Kadoa | Multiple roles | Remote | Full-Time | https://kadoa.com

We’re automating web scraping at scale with AI.

But we can't do it alone. We are looking for people who share our passion for software craftsmanship, data, and AI. We are growing fast, have a “no-bullshit” policy, and try to minimize the distance between the code you ship and the customers who use it.

We have openings for:

- Web Scraping Engineer: https://www.kadoa.com/careers/web-scraping-engineer

- Frontend Developer/UX Designer: https://www.kadoa.com/careers/frontend-dev-ux-designer

If that sounds like you, please email me at (adrian at kadoa dot com) and mention HN in the subject line.

[deleted]

> It's able to operate from airstrips that are no more than roads

The Swiss Air Force is regularly practicing starting and landing on highways: https://www.youtube.com/watch?v=wYkleF72du8

Meta's goal with Llama was to target OpenAI with a "scorched earth" approach by releasing powerful open models to disrupt the competitive landscape. Looks like OpenAI is now using the same playbook.

Kadoa | UX Designer/Frontend Developer | Remote | Full-Time | https://kadoa.com

We’re automating web scraping at scale with AI.

But we can't do it alone. We are looking for people who share our passion for software craftsmanship, data, and AI. We are growing fast, have a “no-bullshit” policy, and are very execution focused.

We have openings for:

- Senior Software Engineer: https://www.kadoa.com/careers/senior-software-engineer

- Frontend Developer/UX Designer: https://www.kadoa.com/careers/frontend-dev-ux-designer

If that sounds like you, please email me at (adrian at kadoa dot com) and mention HN in the subject line.

Since you're in the current YC batch, why is this a Show HN instead of a Launch HN?

Pretty proud to see this at the top of HN as a Swiss (and I know many are lurking here!). These two universities produce world-class founders, researchers, and engineers. Yet, we always stay in the shadow of the US. With our top-tier public infrastructure, education, and political stability (+ neutrality), we have a unqiue opportunity to build something exceptional in the open LLM space.

it's case-sensitive: https://hn-wrapped.kadoa.com/Mossly?share

I built a similar tool that profiles/roasts your HN account: https://hn-wrapped.kadoa.com/

It’s funny and occasionally scary

Edit: be aware, usernames are case sensitive

Kadoa | Multiple Roles (Senior Software Eng, Frontend/UX) | Remote | Full-Time | https://kadoa.com

We're building AI agents for unstructured data.

80% of data is unstructured and traditional methods such as web scraping, PDF parsing, and manual data preparation require expensive engineering resources and constant maintenance.

We’re solving this at scale, but we can't do it alone. We are looking for talented people who share our passion for crafting exceptional software and data products.

We have openings for:

- Senior Software Engineer: https://www.kadoa.com/careers/senior-software-engineer

- Frontend Developer/UX Designer: https://www.kadoa.com/careers/frontend-dev-ux-designer

If you want to iterate to greatness and work at the intersection of data and AI, please email us at (adrian at kadoa dot com) and mention HN in the subject line.

We all agree that AI crawlers are a big issue as they don't respect any established best practices, but we rarely talk about the path forward. Scraping has been around for as long as the internet, and it was mostly fine. There are many very legitimate use cases for browser automation and data extraction (I work in this space).

So how will Cloudflare detect bots and get them to pay? And how many humans and legitimate bots will get blocked as a side effect? We're somehow still stuck with CAPTCHAs, a 25 years old concept that wastes millions of human hours and billions in infra costs [0].

How can we enable beneficial automation while protecting against abusive AI crawlers?

[0] https://arxiv.org/abs/2311.10911

I think you guys nailed the "selling shovels during a gold rush" as the biggest issue with LLMs currently is their reliability/hallucinations, not their capabilities. If I can use websets to back up LLM responses through your API, that's super useful.

Since you were part of YC 21, could you share a bit about your pivots/product iterations you went through over the last 4 years?

We all agree that AI crawlers are a big issue as they don't respect any established best practices, but we rarely talk about the path forward. Scraping has been around for as long as the internet, and it was mostly fine. There are many very legitimate use cases for browser automation and data extraction (I work in this space).

So what are potential solutions? We're somehow still stuck with CAPTCHAS, a 25 years old concept that wastes millions of human hours and billions in infra costs [0].

How can enable beneficial automation while protecting against abusive AI crawlers?

[0] https://arxiv.org/abs/2311.10911

fixed!

You can get your HN profile analyzed and roasted by it. It's pretty funny :) https://hn-wrapped.kadoa.com/

I'll add a selection for different models soon.

I recently built this because I spent too much time here and had FOMO about relevant topics :) https://www.kadoa.com/hacksnack

Let me know what I should improve.

Pharma products were previously tariff-free under a WTO agreement that is based on the principle that life-saving items shouldn't face any tariffs. Looks like this exemption is now also being eliminated and will probably cause the prices of drugs and treatments in the USA to skyrocket.

Kadoa | Frontend/UX | Remote | Full-Time | https://kadoa.com

Kadoa is an AI platform that automates unstructured data ETL.

80% of data is unstructured and traditional methods such as web scraping, PDF parsing, and manual data preparation require expensive engineering resources and constant maintenance.

We’re solving this at scale, but we can't do it alone. We are looking for talented people who share our passion for crafting exceptional software products.

There is one official role, but we welcome conversations with anyone interested in joining the team.

- Frontend Developer/UX Designer: https://www.kadoa.com/careers/frontend-dev-ux-designer

If you want to iterate to greatness and work at the intersection of data and AI, please email us at (adrian at kadoa dot com) and mention HN in the subject line.

That's the most HN headline I've read in a while

We should try separating good bots from bad bots:

Good bots: search engine crawlers that help users find relevant information. These bots have been around since the early days of the internet and generally follow established best practices like robots.txt and rate limits. AI agents like OpenAI's Operator or Anthopic's Computer Use probably also fit into that bucket as they are offering useful automation without negative side effects.

Bad bots: bots that have a negative affect website owners by causing higher costs, spam, or downtime (automated account creation, ad fraud, or DDoS). AI crawlers fit into that bucket as they disregard robots.txt and spoof user agent. They are creating a lot of headaches for developers responsible for maintaining heavily crawled sites. AI companies don't seem to care about any crawling best practices that the industry has developed over the past two decades.

So the actual question is how good bots and humans can coexist on the web while we protect websites against abusive AI crawlers. It currently feels like an arms race without a winner.