nutanc

Would this means remotion etc are not needed?

This is awesome. I am trying to build a full scale ASR system within 20-25MB. Now that we have Claude code to run experiments, I have started running some experiments. Promising results so far. First realization is that you can capture the nuances of speech in just 3300 embedding vectors(786d). This sequence can be decoded with a small CTC system to get text. Next experiments are on reducing the 768 dimension space into a 64D space. Thats also show some promising results. Hooking up my system so that the agent blogs the results everyday[1]. So my research "claw" setup does the experiments and posts results which I check in the morning and adjust the experiment direction as needed. Its not fully automated yet, but almost there.

[1] https://blog.trulm.com/posts/speech-as-independent-parts/

You can get very close to a working version by reverse engineering the javascript with Claude. I got a good version almost an year back. With Opus it might do a better job.

Most of the problems happen because we want to simulate human conversations. While thats a good goal to have, another approach is to let the user know clearly they are talking to a bot. You will be surprised at how accomodating users can be when they know they are talking to a bot and want their queries resolved.

Lets break this down. There is very little in newness in what Anthropic announced. Claude had skills for a long time. They have added one more layer of abstraction and called it plugins. This mainly comes with a set of integrations.

Thats the pitch.

But, what are Claude plugins?

Plugins=Commands+Skills+Integrations.

Commands are specific to Claude code. But commands and skills are nothing but prompts at their basest level.

So what is the main differentiator?

Integrations.

But what are you integrating with?

SaaS companies.

And what is the stock market doing?

Dumping SaaS stocks.

How do they think Claude cowork will work without the integrations. Without the system of records.

If anything, these SaaS products have become more important. If I was a trading guy, I would go to the github of claude plugins, see the default integrations and buy the stock of those companies.

Claude cowork and the SaaSpocalypse case makes no sense. What are Claude plugins? Plugins=Commands+Skills+Integrations. Commands and skills=prompts So differentiator? Integrations. Integrating with? SaaS companies. And what is the stock market doing? Dumping SaaS stocks.

2 years since this started. The effort is to protect the creators from the AI machine.

The AI machine is different from the printing press. We think we need protections more than just the copyright. Can we have a copyleft for data?

In this age of AI, how do we protect the creators?

Chat GPT has ads now. This is a dangerous domain we are entering and society is not ready.

Organizations adapting AI is the biggest problem that businesses are facing right now. Even in Ozonetel I face this problem day in and day out. The employees who really use AI to its full potential are minuscule. I can count on my fingertips. We need to overcome this in the right way or we will face the same problems we faced during industrial revolution.

Got pissed off with too many ARR manipulations and AI startups announcing revenue numbers manipulations(best day * 365 as ARR etc). These startups are not only messing up the AI ecosystem with the non standard numbers, they are also messing up the SaaS ecosystem by co opting the SaaS metrics. Now SaaS startups are supposed to show the same scale though the AI startups have also not achieved that scale. So here is what I propose, the AI startups should use their own new vocabulary. Since everyone is vibe coding, I suggest VRR, Vibe Revenue Run-rate :)

I have even provided a formula(all scientific and all) and also provided a checklist for the VCs.

You can disagree with the commons definition, and thats fine. But the point I wanted to make was about the exploitation. The open Internet was built with a code of sharing. Now they are trying to put walled gardens around all that knowledge. Lets remove Marx from the equation if that becomes a bone of contention. But we as a society need to come up with better dialogues to decide how we will treat our creators and how we will deal with the AI copy machine. We cannot expect that profit mongers will do the right thing.

The question here is, is social media addictive and is it harmful. If we have enough evidentiary proof, then yes, it should be banned just like we do for alcohol or cigarettes. We also ban porn for kids. And we don't need any ID proofs in implementing the ban. So we have a precedent. It's not perfect, but society knows it's bad, government, family, schools come together and implement the ban. No need for IDs etc and give more control to government.

Well not exactly earning calls in the classical sense, but haven't you heard about these startups announcing how they have scaled to $100 million in 3 months etc. Maybe revenue calls every quarter.

I would say in the AI age almost every business is a startup as per PGs definition [https://paulgraham.com/growth.html]

This will need a separate blog post But when you give something for free, then you will run out of that resource. So yes, companies have too little GPUs to give their services for free, but too many GPUs for their paid services.

You are right. And "work sounds like AI" is an insult says everything you need to know about the generations by AI :)

Right. But my assistant wouldn't show me a new screen and ask me to do things in it :)

Why would you go inside a chat box and try to force fit applications and show the applications in weird ways and then finally link out to the actual application instead of just putting a chat box inside the application which is the accepted way.

This is just a glimpse of the future. The real future is when your self driving car talks to the Taco Bell AI and gets your Taco.

Other than the obvious discussions around free speech(very valid points), do we have any real studies on the actual effects of social media? What if social media platforms didn't exist. Would the world have been a better place? I don't know the answer, but atleast from my observations it feels as if almost every country in the world has moved to the right but by bit. We have moved away from globalization and are into protectionism. Is social media to be blamed for this? I think it has certainly played it's part for sure.

One advantage of social media I see is that it has allowed people to create D2C businesses.

I had been experimenting with some prompts for socratic method of teaching. Finally found one which works fairly well for me which I have integrated into our product.

Q: How does photosynthesis work?

Chat GPT Study Mode:

### How Photosynthesis Works (in simple steps):

Photosynthesis is the process *plants use to make their own food* using sunlight. It mostly happens in *leaves*, especially in a part called the *chloroplast*, which contains a green pigment called *chlorophyll*.

---

### Think of it like a recipe:

1. *Ingredients*:

   * **Sunlight**
   * **Water (H₂O)** — from the roots
   * **Carbon dioxide (CO₂)** — from the air

2. *Cooking place*: Leaf cells, in their chloroplasts

3. *Magic trick*: Chlorophyll traps sunlight energy

4. *What’s made*:

   * **Glucose (C₆H₁₂O₆)** — a sugar the plant uses for energy
   * **Oxygen (O₂)** — released into the air

---

### Word Equation:

*Carbon dioxide + Water* → (with sunlight & chlorophyll) → *Glucose + Oxygen*

Or:

*6CO₂ + 6H₂O → C₆H₁₂O₆ + 6O₂*

-------------------------------------------------

My Prompt(conversation):

me: How does photosynthesis work?

agent: Great question! Let's start by understanding the problem. What do you think is the main purpose of photosynthesis in plants?

me: dont know

agent: That's okay! Let’s start by breaking down the concept of photosynthesis. First, can you tell me what kind of organisms primarily use photosynthesis?

me: plants

agent: Exactly, plants primarily use photosynthesis. Now, let's think about the basic ingredients or components needed for photosynthesis to occur. Can you name any of these components?

me: no

agent: No problem! Let’s explore it together. Photosynthesis primarily requires three main components. One of them is light. Can you think of where plants might get light from?

me: sun

agent: That's right! Plants get light from the sun. Sunlight is crucial for photosynthesis. Now, besides sunlight, plants also need something from the air. Do you know what that might be?

...... and so on

We all know the advantages of smartphones. What we dont know yet are the harmful effects of the smartphones on young minds. I just hope we are not stunting the mental growth of our kids just because we dont know the harmful effects. Like how smoking was allowed everywhere initially and now we ban it everywhere.

We are attempting something with PETALS. But this question was more from a data collection perspective. We can really add value there.

How can we help. Can crowd sourcing help? Is there any list of tasks that we want a crowd to do? The reason I am asking is because we have done a couple of crowdsourcing efforts and collected story data in Telugu(Chandamama Kathalu) and ASR speech data using college going students. Since we have access to the students, we can mobilize them and get this going. We will also be doing an internship program for 100,000 students in Telangana as part of Viswam[1] in April. Can include some work as part of this effort.

[1] https://viswam.ai/

I am 45 now. Sad that most probably this is going to be the reality of the future.Its gonna be some robot with an AI, talking like ChatGPT, which means nothing it says that will take care of me in my old age.

Will check for these particular stories. But yes, when we tried this on some stories with a similar arc we saw that their path is similar in the semantic space.

This maps a little to what we are doing research on what we are calling as shape of stories[1].

We can clearly see in 2D space itself how different "concepts" are explored.

Using the shape of stories for semantic chunking we can clearly see in multiple articles how we can chunk by "concepts". [2]

Now we are trying to see if we can just use these chunks and train a next "chunk" predictor instead of a next word predictor.

In the paper, they take a sentence to mean a concept. We believe that a "semantic chunk" is better suited for a concept instead of a sentence.

[1] https://gpt3experiments.substack.com/p/the-shape-of-stories-...

[2]https://gpt3experiments.substack.com/p/a-new-chunking-approa...

I am surprised they did not use LLMs like Claude or maybe even train their own Llama version to do this. In my experience LLMs have been very reliable in translating code.

Got it. Will update the OP so that we are right pedantically :)

Pouchdb?