eclectic29

I'm not sure why Ollama garners so much attention. It has limited value - used for only experimenting with models + cannot support more than 1 model at a time. It's not meant for production deployments. Granted that it makes the experimentation process super easy but for something that relies on llama.cpp completely and whose main value proposition is easy model management I'm not sure it deserves the brouhaha people are giving it.

Edit: what do you do after the initial experimentation? you need to deploy these models eventually to production. I'm not even talking about giving credit to llama.cpp, just mentioning that this product is gaining disproportionate attention and kudos compared to the value it delivers. Not denying that it's a great product.

I migrated to Joplin from Evernote. I can live with a slightly less polished UI. However the main issue is the time it takes to come up (launch) on my Windows 32GB RAM, Intel i7 laptop. It’s terribly slow to come up.

Will Sundar take true ownership of all the debacles after getting rushed to produce something in AI and resign?

Please excuse me for asking this. I know Andrej is an excellent instructor. I've watched his videos. But what has been his contribution to the industry (besides teaching of course)?

Did you try it? Did it work for you? I would first try it before looking for alternatives. This is what is called analysis-paralysis. You're simply wasting your precious time looking for alternatives without even giving it a shot.

Genuine question: why does kalman filter come up so frequently on HN? Is this something I'm missing? I'm a machine learning engineer, not a data scientist.

Why do we allow someone non technical, manipulative and a glorified salesman to run a deeply technological initiative like AI! The stupid media has made him the God of AI. He has no background in AI , no success stories to beat his chest other than being Paul’s protege.

Any googlers chime in? Is this any good? Or just a dump of one of their internal unused products?

Btw, where did you see that line of text in the docs? I didn't find it.

If you’re serious about production deployments vLLM is the best open source product out there. (I’m not affiliated with it)

Thanks. That’s fair. Just shocked by the extreme hype.

Once you've tested to your heart's content, you'll deploy your model in production. So, looks like this is really just a dev use case, not a production use case.

What's the use case of Ollama? Why should I not use llama.cpp directly?

Wow! Another configuration language post. 2nd day in a row. And that too on the front page. It's 2024 and the software industry has not solved the problem of configuration yet. Umpteen solutions every year - languages, formats, etc - all for just doing configuration. Just wow! It amazes me. It would be so much better if all the great minds focused on real issues than keep spinning on the hamster wheel of config file formats and languages.

It's 2024 and the software industry has not solved the problem of configuration yet. Umpteen solutions every year - languages, formats, etc - all for just doing configuration. Just wow! It amazes me. It would be so much better if all the great minds focused on real issues than keep spinning on the hamster wheel of config file formats. Just look at the # of comments here.

I mean you still need to learn the material but you cannot pass these interviews without memorizing.

I've 20 yrs of work experience in small to large tech companies and thinking of switching to a new company. Even I'm expected to be swift with leetcode style questions. Now, it's not like I can't do it; I've been an IC for most of my career and have a good background in DS and algo (Master in CS), but it takes time and effort and above all it's terribly boring. I've practiced 200 questions (including 150 from neetcode.io) so far but still don't have the confidence because I need to resolve them; repetition is the key. If you lose touch for even 2 weeks due to work/family commitments, you lose the streak/form. It's particularly tough for senior people. Some say, move to management, but then this is first not a good reason to move to mgmt, and secondly, if you think you can escape leetcode by moving to mgmt, you're in a shock.

Our industry is in a weird phase. I undersand that it's difficult to weed out thousands of candidates without these tests and quite frankly these tests are independent of the domain you work in which can be both good and bad.

I moved to Joplin a few months ago. The editor is not as good as Evernote but does the job. I can use it on as many machines as I want but I always remember to manually sync to avoid loss. Overall, Joplin is decent and functional without the polished interface.

"Open"AI and for-profit. This company is a troubled mess and if it were not for the "potential" money, employees wouldn't be putting up with this nonsense. Sad to see Ilya getting sidelined as shown by this "...are discussing how he can continue his work at OpenAI".

I'm sorry, impressed by what?

The media and the VCs are treating Sam like some hero and savior of AI. I’m not getting it. What has he done in life and/or AI to deserve so much respect and admiration? Why don’t top researchers and scientists get equivalent (if not more) respect, admiration and support? It looks like one should strive to become product manager, not an engineer or a scientist.

Viaweb was acquired by Yahoo and rebranded as Yahoo Stores. Happened to read his code when I was at Yahoo Stores. Lisp at its best! He wrote the templating engine running behind the UIs. It was used until 2008 when I left. Not sure if Yahoo Stores is still around.

Is BM25 still used by "modern" search engines? I wasn't aware.

Nit: use "enum class". See https://isocpp.org/wiki/faq/cpp11-language-types#enum-class.

[deleted]

This is just "one" experience, certainly not the norm. Even as an experienced engineer of 15 yrs I'd to solve leetcode (LC) style problems on the whiteboard a few yrs go. For better or worse (depending on whose perspective you see), LC allows companies to judge you based on a common framework of solving algorithmic problems using computer science fundamentals (data structures and algorithms) in a language of your choice. Obviously, the problems vary in difficulty and many are trick problems which is what makes them frustrating, but it's the unwritten sad truth of this industry and I believe it's here to stay _if_ you're vying for very high salaries.

Also see this comment of mine to get the full picture: https://news.ycombinator.com/item?id=36697404#36700085

This is amazing. One curious question: Why C? Why not standard C++?

Is this for educational purposes only? Based on the success of llama.cpp and this one it appears that the industry is going in a direction of separate source code for every model that is released instead of general purpose frameworks like pytorch/tensorflow/onnxruntime?

How does one keep going so long with the same passion, energy and excitement? Is it because of working in academia? Corporate life with its politics has exhausted me and sucked all the passion out of work. My cognitive abilities are declining due to the constant pressure to show (fake) impact and tout my own horn to move up.