HNHacker News
TopNewBestAskShowJobs

gitremote

581 karma · joined March 28, 2024

submissionscomments
gitremote··on Are OpenAI and Anthropic losing money on inference?
Yes, API pricing is usage based, but ChatGPT Pro pricing is a flat rate for a time period.

The question is then whether SaaS companies paying for GPT API pricing are profitable if they charge their users a flat rate for a time period. If their users trigger inference too much, they would also lose money.

gitremote··on Are OpenAI and Anthropic losing money on inference?
These numbers are off.

> $20/month ChatGPT Pro user: Heavy daily usage but token-limited

ChatGPT Pro is $200/month and Sam Altman already admitted that OpenAI is losing money from Pro subscriptions in January 2025:

"insane thing: we are currently losing money on openai pro subscriptions!

people use it much more than we expected."

- Sam Altman, January 6, 2025

https://xcancel.com/sama/status/1876104315296968813

gitremote··on Everything I know about good API design
I don't think the author meant they don't include /v1 in the endpoint in the beginning. The point is that you should do everything to avoid having a /v2, because you would have to maintain two versions for every bug fix, which means making the same code change in two places or having extra conditional logic multiplied against any existing or new conditional logic. The code bases that support multiple versions look like spaghetti code, and it usually means that /v1 was not designed with future compatibility in mind.
gitremote··on The forgotten meaning of "jerk"
For the vast majority of the situations in a English-speaking society, the term for that type of person is a "white supremacist". For example, a person who does Nazi salutes, or wants to update refugee policy so that the majority of immigrants are White South Africans, is a white supremacist.
gitremote··on VC-backed company just killed my EU trademark for a small OSS project
"You’ve heard of animals chewing off a leg to escape a trap? There’s an animal kind of trick. A human would remain in the trap, endure the pain, feigning death that he might kill the trapper and remove a threat to his kind."

- Dune, the gom jabbar's test for humanity

gitremote··on TeaOnHer, a rival Tea app for men, is leaking users' personal data
> Not justifying it, but many applications consider the uniqueness of the URL enough protection to prevent discovery.

Yes, that's why it's the #1 most common web security vulnerability in production code:

https://owasp.org/Top10/A01_2021-Broken_Access_Control/

"Permitting viewing or editing someone else's account, by providing its unique identifier (insecure direct object references)"

What vibe coding promoters don't understand is that the average web developer hasn't learned web security 101. Proof: HN commenter points out that "A01:2021 – Broken Access Control" is completely normal in production code.

gitremote··on TeaOnHer, a rival Tea app for men, is leaking users' personal data
... in the same way that women's shelters are common but men's shelters are rare looks like a gender war.
gitremote··on Why Understanding AI Doesn't Necessarily Lead People to Embrace It
This suggests the marketing professors have an incorrectly optimistic view of LLMs, and that's why they were surprised that those who understood AI mechanics embraced it less.
gitremote··on Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?
When an end user asks ChatGPT a question, the chatbot application sends the system prompt, user prompt, and context as input tokens to an inference API, and the LLM generates output tokens for the inference API response.

GPT API inference cost (for developers) is per token (sum of input tokens, cached input tokens, and output tokens per 1M used).

https://openai.com/api/pricing/

https://azure.microsoft.com/en-us/pricing/details/cognitive-...

(Inference cost is charged per token even for free models like Meta LLaMa and DeepSeek-R1 on Amazon Bedrock. https://aws.amazon.com/bedrock/pricing/ )

ChatGPT Pro subscription pricing (the chatbot for end users) is $200/month

https://openai.com/chatgpt/pricing/

"insane thing: we are currently losing money on openai pro subscriptions!

people use it much more than we expected."

- Sam Altman, January 6, 2025

https://xcancel.com/sama/status/1876104315296968813

Again, this means that the average ChatGPT Pro end user's chattiness cost OpenAI too much inference (too many input and output tokens sent and received, respectively, for inference) per month than would be balanced out by OpenAI receiving $200/month in revenue from the average Pro user.

The analogy is like Netflix losing money on their subscriptions because their users watch too much streaming, so they ban account sharing, causing many users to cancel their subscriptions, but this actually helps them become profitable, because the extra users using their service too much generated more costs than revenue.

gitremote··on Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?
Currently, they lose more money per inference than they make for Pro subscriptions, because they are essentially renting out their service each month instead of charging for usage (per token).
gitremote··on Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?
Inference contributes to their losses. In January 2025, Altman admitted they are losing money on Pro subscriptions, because people are using it more than they expected (sending more inference requests per month than would be offset by the monthly revenue).

https://xcancel.com/sama/status/1876104315296968813

gitremote··on Food, housing, & health care costs are a source of major stress for many people
> Protip: look for an Asian market in your area for food. ... Discovering the Asian market has been one of the best financial things to happen to me.

Whenever I see this protip, I feel bad for struggling Asians getting validated that they and their extended family already fully optimized all their opportunities.

gitremote··on AWS European Sovereign Cloud to be operated by EU citizens
"The Cloud Act is a law that gives the US government authority to obtain digital data held by US-based tech corporations irrespective of whether that data is stored on servers at home or on foreign soil. It is said to compel these companies, via warrant or subpoena, to accept the request."

https://www.theregister.com/2025/07/25/microsoft_admits_it_c...

gitremote··on People still use our old-fashioned Unix login servers
The servers are for professors and graduate students, so this IT guy wants to block PhD students from doing AI research, demanding that they explain their cron jobs to him, because he thinks he can optimize them and save a few bucks.
gitremote··on OpenAI's "Study Mode" and the risks of flattery
"I'm doing the equivalent of vibe coding, except it's vibe physics." - Travis Kalanick, founder of Uber

https://gizmodo.com/billionaires-convince-themselves-ai-is-c...

gitremote··on We may not like what we become if A.I. solves loneliness
> Sex is decoupled from birth rates, due to access to 100% effective birth control (IUD/morning after pill/abortion).

In 2022, the US overturned the constitutional right to abortion. Abortion is now outlawed in 17 US states, restricted in 8.

Politicians in some of these states are also trying to ban IUDs and the morning after pill.

gitremote··on Live coding interviews measure stress, not coding skills
I assume questions to explain the code would be extremely specific about why you did something on a specific line, or why you chose to design this part that way instead of another, to detect plagiarism and vibe coding, not a request for a prepared monologue.
gitremote··on Live coding interviews measure stress, not coding skills
How would someone explain code that was vibe-coded?
gitremote··on Sleep all comes down to the mitochondria
Sure. Foundation models aren't fine-tuned, and companies fine-tune foundation models to optimize user experience. So they are modeling the animal brain on an even more specific type of LLM that happens to be related to being a consumer of AI products.
gitremote··on Sleep all comes down to the mitochondria
The statement was "AI frenzy almost convinced me that sleep was the training of our neural network with all the prompts of the day."

Prompts are specific to LLMs. Most neural networks don't have prompts.

Additionally, prompts happen during LLM inference, not LLM training. There are many non-technical people who claim they have experience "training" LLMs, when they are just an end user who added a lot of tokens to the context window during inference.

gitremote··on Sleep all comes down to the mitochondria
Indeed. Animals without linguistic ability (like fruit flies) need sleep, but after ChatGPT's release in 2022, now tech bros think LLMs specifically might model the animal brain in general because of anthropocentrism and anthropomorphism.

It's also a fundamental misunderstanding of how LLMs work, mixing up inference with training.

gitremote··on VPN use surges in UK as new online safety rules kick in
"Elections in the People's Republic of China occur under a one-party authoritarian political system controlled by the Chinese Communist Party (CCP). Direct elections, except in the special administrative regions of Hong Kong and Macau, occur only at the local level people's congresses and village committees, with all candidate nominations preapproved by the CCP. By law, all elections at all levels must adhere to the leadership of the CCP."

https://en.m.wikipedia.org/wiki/Elections_in_China

> This discussion highlights how westerners suffer from some serious superiority complex where only THEY can experience genuine freedom and democracy(probably due to their superior phenotype or some inane bs)

There is democracy in Japan, South Korea, and Taiwan.

Just say, "I'm a tankie and I support Russia's invasion of Ukraine."

gitremote··on VPN use surges in UK as new online safety rules kick in
How would you know? In countries without free speech where anti-government speech is illegal, the only legal speech is pro-government or neutral.
gitremote··on The natural diamond industry is getting rocked. Thank the lab-grown variety
He's an earth sciences geek, so he prefers natural diamonds' relationship with the earth. This aesthetic is irrelevant for most people.
gitremote··on Purple Earth hypothesis
PBS Eons has an episode on this:

When the Earth Was Purple https://m.youtube.com/watch?v=IIA-k_bBcL0

(This is great science channel. PBS should have continued to receive federal funding.)

gitremote··on Experimental surgery performed by AI-driven surgical robot
It's only "ChatGPT-like AI" in that it uses transformers. It's not an LLM. It's not trained on the Internet.
gitremote··on Women dating safety app 'Tea' breached, users' IDs posted to 4chan
I don't care about the company and I'm not defending it. I don't have sympathy for the bad faith gossipers getting doxxed. But there are going to be legitimate users who gravitated towards the app for the real safety need. Doxxing this kind of user base means real women are going to get killed by their obsessive stalkers.

It was a choice to exfiltrate this data and distribute it on 4chan.

gitremote··on Women dating safety app 'Tea' breached, users' IDs posted to 4chan
> An irony in this conversation is how normalized it is for women to be concerned about men as a demographic when it's only a small minority that inflict harm.

The same hypothetical 5% can inflict harm to multiple women, that's why multiple women and girls complained about Epstein and Trump.

gitremote··on Women dating safety app 'Tea' breached, users' IDs posted to 4chan
Name and photo.
gitremote··on Women dating safety app 'Tea' breached, users' IDs posted to 4chan
Sure, and what was proposed was suing the women for warning others about an allegedly dangerous man, not suing the man.
← PreviousPage 2 of 6Next →