mmazing

Honestly, it doesn't take any inference or need for AI, there's simply data in the documents that can be extracted.

Type O Negative here, they all kill me so luckily I don't have to guess!

It looks like you need to batch your updates and not tie them directly to UI actions, imo!

Cool project!

He found the loophole that courts hate!

Yeah, it is a far better source of information than literally anywhere else I have seen for getting commentary on the tariff's actual impact on trade.

Why does everything need to be tied to revenue? Genuine question.

That's a really good point. I wonder if eventually LLMs will start incorporating this as a feature.

Whitepaper contains many grammatical errors ... what else was not considered?

I don't think that necessarily negates any conclusions, but, it doesn't help the author's case.

When working with AI for software engineering assistance, I use it mainly to do three things -

1. Do piddly algorithm type stuff that I've done 1000x times and isn't complicated. (Could take or leave this, often more work than just doing it from scratch)

2. Pasting in gigantic error messages or log files to help diagnose what's going wrong. (HIGHLY recommend.)

3. Give it high level general requirements for a problem, and discuss POTENTIAL strategies instead of actually asking it to solve the problem. This usually allows me to dig down and come up with a good plan for whatever I'm doing quickly. (This is where real value is for me, personally.)

This allows me to quickly zero in on a solution, but more importantly, it helps me zero in strategically too with less trial and error. It let's me have an in-person whiteboard meeting (as I can paste images/text to discuss too) where I've got someone else to bounce ideas off of.

I love it.

What has really come with experience and what has made me a great software engineer is knowing when rules matter, when to bend where to make things move more quickly.

I prefer forgiveness over permission ...

> Would some hypothetical future AI just "know" that tomorrow it's going to be 79 with 7 mph winds, without understanding exactly how that knowledge was arrived at?

I think a consciousness with access to a stream of information tends to drown out the noise to see signal, so in those terms, being able to "experience" real-time climate data and "instinctively know" what variable is headed in what direction by filtering out the noise would come naturally.

So, personally, I think the answer is yes. :)

To elaborate a little more - when you think of a typical LLM the answer is definitely no. But, if an AGI is likely comprised of something akin to "many component LLMs", then one part might very well likely have no idea how the information it is receiving was actually determined.

Our brains have MANY substructures in between neuron -> "I", and I think we're going to start seeing/studying a lot of similarities with how our brains are structured at a higher level and where we get real value out of multiple LLM systems working in concert.

Love the description of intelligence.

https://en.wikipedia.org/wiki/Kolmogorov_complexity

https://en.wikipedia.org/wiki/Solomonoff%27s_theory_of_induc...

https://en.wikipedia.org/wiki/Minimum_description_length

Seems like these could be related, going to dive into this more! :)

> But, the neural networks are pretty small, so you could train a "hypernetwork" that predicts μ, Σ, θ for a given puzzle, and even predicts how to train these parameters.

Kurt Godel (or maybe Douglas Hofstadter, rather) would raise an eyebrow. :)

Weird. Followup - I am getting censorship on the model from ollama's public model repository, but NOT from the models I got from huggingface running on a locally compiled llama.cpp.

Not my experience - https://imgur.com/xanNjun just ran this moments ago.

I have not found any censorship running it on my local computer.

https://imgur.com/xanNjun

Well, it might matter for functionality in the application.

After you fix a lock-related bug for example, how do you deal with an open tab running a different version of your code that is erroneously misusing a lock?

You need to account for that when you release new code, yeah? Rename the lock maybe? Some other logic?

My grocery store pharmacy has homeopathic stuff next to the Sudafed too. Is literally a placebo.

At least the Sudafed has acetaminophen in it ...

I love their design aesthetic. I wish that I had even the most mild musical talent so I could justify buying some of their products.

Alas, I do not. :(

They make it clear in the paper that their primary "real-world" concern is that it's difficult to distinguish synthetic data from real human interaction when scraping data from the web. This will only get worse over time with our current way of doing things.

How are they supposed to deliberately train on synthetic data when they don't know whether it is (synthetic) or not?

Also, do you not feel that it is presumptuous to dismiss a body of work in a few sentences with a "seems fine to me"?

No map?

Seems like this relates to many other areas of human interaction, politics comes to mind for one ...

I'm not sure how you got any of those conclusions from my comment. I was just curious why crypto didn't cause a blip on the graph.

Maybe you should calm down.

Those are interesting indeed. I would have thought cryptocurrency farming might have made a blip on there somehow but seems not.

I wonder how those charts compare with the rest of the world?

Every choice we make has compromises, but I think coal pollution is magnitudes worse than soil erosion.

One affects the entire environment with air pollution, and the other affects a localized area by modifying terrain.

> Discoverability and smallness are at odds.

Is it really true on the internet though? omg.lol could presumably stay "small-appearing" and "quaint" and have millions of users. How could you really tell the difference?

If it were all indexed you could drill down and find people who share your interests, that doesn't necessarily ruin the website, yeah?

> it felt like this awesome "secret world" that connected you to the rest of the world!

I really miss that feeling, it's a rarity nowadays.

I never use rebase, and I've never once had trouble understanding who did what where and when, even in a large project with 500+ users.

That being said, after reading this stuff, I may start using it on my local branches to clean up multiple commits into one tidy one, but that's about it.

A few years ago, I was working with a team that was trying to convert an entire API for a fairly straightforward application into REST api microservices.

The architect wanted to break everything up into extremely small pieces, small enough pieces that many were dependent on each other for every single call. Think "a unified address service" to provide an physical address via an identifier for anything that had an address (customers, businesses, delivery locations, etc).

The problem was that it turns out when you're looking up a customer or business, you always need an address, so the customer service needed to hit the address service every time.

Disregarding the fact that this whole thing was a stupid design, the plan was that when you hit the customer api, the customer code would make internal http calls to the address service, etc.

I pointed out that this was a ton of unnecessary network overhead, when all of this information was sitting in a single database.

The whole team's argument was effectively - "it's 2015, computers and networks are fast now, we don't need to worry about efficiency, we'll just throw more hardware at it".

The whole thing ended up being scrapped, because it was crippled by performance issues. I ended up rewriting the whole thing as a "macroservice" which was 60000% faster for some particularly critical backend processes.

Anyway ... I think that mentality is prevalent in a lot of people involved in technology creation, technology has improved so much, moore's law etc etc etc.

So let's not worry about how much memory this thing takes, or how much disk space this uses, or how much processing power this takes, or how many network calls. Don't worry about optimization, it's no big deal, look at how fast everything is now.

25 grand is the best we can do for something like this?