Hacker News Reader

Parent Full thread

babuskov

Relative.

For example, the page:

https://website/blog/1-post

contains:

href="2-post"

Browsers and other bots like Google Bot correctly interpret this as a link to

https://website/blog/2-post

While OpenAI crawler goes to:

https://website/blog/1-post/2-post

I wonder is there some way to report this bug to them?

View on HN

Google recommends absolute urls:

https://web.archive.org/web/20221208150134/https://www.webma...

I actually think OpenAI is right, unless you have a base url tag? That’s a relative url and its relative to the current url you are on, not the root domain

Reply on news.ycombinator.com