4,517 karma · joined June 15, 2012
"The tyrant will always find a pretext for his tyrany, and it is useless for the innocent to try by reasoning to get justice, when the oppressor intends to be unjust."
Aside: I would pay real currency for an official Brøderbund t-shirt. Probably not possible now. I always knew I would enjoy whatever game it was I was starting when I saw that ship logo and the 'funny O'.
2.5 Pro went ahead and summarized it (but completely ignored a # reference so summarised the wrong section of a multi-topic page, but that's a different problem.)
The special sauce is in parsing, tokenizing, enriching etc. There is no value in re-scraping, and massive cost, right?
Just do it.
Hypothetical: Take a large short position on NVDA, announce the market that you trained a massive model without using 10s of millions of rare-as-hen's-teeth NVDA-sentsitive resources. Settle postition then quietly settle giant compute bill. Difficult to know either way, but the market seems have taken the team at face value. I guess we'll know if and only if this reduced training cost methodology is replicated.
I can't seem to find any evience beyond the team's statements. What have I missed?
The code itself is surprisingly small/tight. I'm been playing with llama.cpp for the last few days. The CPU only archive is like 8Mb on gitlab, and there is no memory allocation during run time. My ancient laptop (as in 2014!) is sweating but producing spookily good output with quantized 7B models.
(I'm mainly commenting to have someone correct me, by the way, since I'm interested in this question too!)