braindead_in

Interestingly, all these things are required for loving kindness meditation practice as well.

Why not build a new browser with GPT baked in?

Does it respond in correct JSON?

I have been trying to figure out how to fine tune codellama. Will the llama2 examples work for codellama as well?

The universe is a infinite neural network and we are all weights and biases.

The 34b Python model is quite close to GPT4 on HumanEval pass@1. Small specialised models are catching up to GPT4 slowly. Why not train a 70b model though?

From a Nondualist perspective, our brain is highly complex biological neural network that has a special ability to reflect pure consciousness giving rise to the mind and the world with it. A sufficiently advanced artificial neural network can also reflect the same consciousness but thier minds and world would be entirely unlike ours. However, consciousness will add a random component to the predictions and might make them completely useless as a tool. They might decide not to follow the instructions prompt given their internal state of mind.

That is a problem even now though. Sometimes LLMs just goof up for no reason. Maybe they are conscious.

The quote "The limits of my language mean the limits of my world" is attributed to Ludwig Wittgenstein, an Austrian-British philosopher. He expressed this idea in his work "Tractatus Logico-Philosophicus."

It's one of Sw Sarvapriyananda's favourite quotes. Wittgenstein was quite Vedantic it seems.

Beautiful. Today is Masik Shivratri. I am planning to stay up all night, do some 5, listen to bhajans and meditate. It's gonna be magical.

What if something is different but nothing has changed in the model? Transformers are non deterministic. The response to same prompt may vary slightly, and can be controlled somewhat by the temperature setting. Something could have gone wrong there.

I've played around with aider trying to run tests and fix the code, but it just crashes after exceeding the context window. I am now trying to repurpose the AutoGPT example in langchain.

Cool project. I tried to build a reactjs Todo app with TDD, but it just put comments in the test file instead of the actual test. A self heal loop would be quite useful.

Count me in as well.

Can you recommend some good places in Rishikesh to experience all this?

> Those are the very people who should be never ever allowed to become mods, or to be anywhere near any position of power

Okay. How about AI as the new mod then?

Someone please start the GPT 5 training before the regulation kicks in.

> With these updates, we’ll be inviting many more people from the waitlist to try GPT-4 over the coming weeks, with the intent to remove the waitlist entirely with this model. Thank you to everyone who has been patiently waiting, we are excited to see what you build with GPT-4!

What about the rate limits? The docs say that it's 200 RPM and "We are unable to accommodate requests for rate limit increases due to capacity constraints."

It's so mind-boggling to think that our everyday reality can be encoded as weights and biases in a giant matrix. Maybe we are just weights and biases.

> OpenAI and others have proposed that licenses would be required only for the most powerful models, above a certain training compute threshold. Perhaps that is more feasible

Somebody is bound to figure out how to beat threshold sooner or later. And given the advances in GPU technology, this compute threshold will itself keep going down exponentially. This is a dumb idea.

Aider looks cool. Gonna try it out today. Have you tried out StarCoder or Replit-code?

I mostly agree with the piece, except this part.

> And AI is a machine – is not going to come alive any more than your toaster will.

There have been claims that AIs are conscious. For example, Ilya Sutskever has suggested that LLMs may be slightly conscious.

It is possible that machine consciousness could be quite different from human consciousness. This idea aligns with the philosophy of Nonduality, which proposes that pure consciousness is the fundamental substratum of the universe. Our minds are able to reflect this pure consciousness, albeit in a limited way. If our human minds can reflect consciousness, perhaps artificial neural networks can as well, but in their own manner.

> The idea of inner monologue is to instruct the model to put parts of the output that are meant to be hidden from the user into a structured format that makes parsing them easy. Then before presenting the output to the user, the output is parsed and only part of the output is made visible.

This is quite remarkable. Can we now say that inner monologue is also an emergent property? Can this lead to some form of self-awareness or introspection?

What about the roadmap itself? Can we look forward to these goodies?

What about the plans itself though? I was looking forward to faster GPT-4, 1M context length and fine tuning APIs. These won't be coming anymore?

Feel sorry for the Humanloop guys though. Somebody forgot to tell them to keep it private or what?

I am looking forward to faster GPT-4, larger context windows and finetuning APIs. The combination of these can solve most of problems that I currently face with my LLM apps. It looks like a good roadmap for 2023.

It is a shame that Sama does not believe in Open Source. The community can solve their GPU bottleneck issue by making it run on CPUs and edge devices in a matter of days.

> it doesn’t have any underlying model of the world

Then how is it getting better at the ToM tests? For next word prediction to work well, as per Ilya Sutskever, requires a good understanding of the world. If you ask GPT-4 to predict what a human would do in a novel scenario, it will probably imagine the best human it can think of and then predict from there. That requires a world model.

I've been waiting for Code Interpreter access. Can you please bump me up. Email in my profile. TIA!

> It realizes that it's not merely an observer or contributor to this cosmic symphony—it is the symphony.

Or in other words, Tat Tvam Asi. We are not this body mind complex with consciousness, but consciousness itself. Whoever realises this, transcends all suffering.