39 karma · joined December 21, 2022
But I am sure many people on the margins will move along when the opportunity comes along.
Also, with a crypto coin, I bet the risks of significant price swings would greatly challenge people who attempted this as a retirement vehicle.
I am looking forward to celebrating this in 2026, if our country still exists.
Ok, “What I wrote was true before Deepseek and their non-human reinforcement learning Breakthrough”.
Right, I did make a general statement that could be applied pre- and post-Deepseek. I think I get your point. But, you are stating: that “So you’re worried that LLMs have stopped scaling even though the biggest breakthrough from DeepSeek is scaling RF learning without humans?” I’m not worried about it, but I am waiting to see continued LLM performance improvement due to HW scaling as opposed to algorithmic improvements. This seems to happen in industries, like in weather forecasting, model is developed, sucks up all resources, new model is developed, HPC company goes bankrupt, new super computer purchased, new model rolled out, new performance gains, sucks up all computer resources, rinse and repeat. But it takes a long time to release a new upgrade of a model. Now, regarding algorithmic improvements, the way I think about it is to break it down into two areas: a) throughput/efficiency improvement (faster/more_efficient) and b) performance improvement (better predictions). I’m not following this as close as I would like, but it seems Deepseek is more aligned with faster/more_efficient. My statement I wrote, I think what has changed is the realization that, as applied to LLM, investors have been neglecting the efficiency side of the problem. It seems many of the promises of performance around the corner are more investment/funding driven. The other option, of focusing on efficiency would leave more stakeholders with less wealth, so they have a nature bias to promote this technology.
So, with the Deepseek approach/revelation, my thoughts are:
Before Deepseek announcement: Established/large LLM producers: Resources: More hardware, data centers, power distribution, tax credits. Challenges: making a profit, establishing a true moat (but not publicly recognized) Moat: Significant cost challenges to new market entrants limited who could compete. New_entrant/small LLM producers: Resources: License large-scale LLMs, tune them for bespoke requests. Moat: Significant cost challenges to new market entrants limited who could compete. HW producers NVIDIA is dominant with CUDA and established HW products
After Deepseek announcement: Established LLM producers: Called into question the excess resources: More hardware, data centers, power distribution, tax credits. Need to recognize and acquire new entrants that may pose a down-stream challenge. This will be tough as many companies will spring up.
New_entrant/small LLM producers: Resources: New companies should sprout up as barrier to entry is reduced. Moat: Small vendors can specialize, or build business to be acquired by large LLM vendor. HW producers NVIDIA is dominant with CUDA and established HW products Increased GPU demand and high margins of established HW players will bring in new market entrants (competition). Numerous small LLM producers will increase HW sales. Margins are high with NVIDIA, so other HW suppliers will see this as an opportunity to enter the market. Also, since NVIDIA margins are so high, large-scale LLM vendors will welcome competition.
If general LLMs do not show continued performance improvement, then there is a lot of excess HW that needs to be utilized somehow. If LLMs continue to show performance improvement, then the hardware can be used more efficiently.
Exercise. Get a little better definition on you. Food. Start a healthy diet. Learn to cook if you have too. Cutout fast food. No alcohol. No sugary drinks. Sardines on Toast. Do some single road trips! Social events: Hiking clubs, volunteer to help the homeless, Toastmasters Public Speaking is great (find the right club however) When you have some vacation, take a week trip to Canada, Europe, of somewhere wild in the US.
I look back at the time I was "dumped" and I wish I had spent the time on more fitness activities and more solo trips.
But really appreciate the free time you now have.
a) The CNA program sounds great and several of my friends went that route and it worked well for them. Also, there is something similar, the Radiological program for X-rays etc also offered at local colleges. b) I know a few people starting out as electricians, plumbing, and something called steam fitting plumbing. Some of these jobs are hard on the knees and back as you get older. c) The fireman is nice, I’ve known a few fireman who worked on business investment during their off work cycle.
For any job I’ve always had, I’ve always worked a plan B option to prepare myself should I leave my current job. Work always got my 100-pct commitment, so plan B preparation would involve off work study, but I was able to transition successfully across several different industries with substantially different required skill sets. I would not manipulate work to prepare for my new career but I could often find some of my news skills helping me in my current job.
You did not well articulate your current skill set. So, it’s a little hard to help nail down areas that match your skillset. But, your response seems to indicate you want to follow the rules. There are probably some areas of inspection or audit work that you would align with. So, fire inspection, etc?
But the box fans are so ubiquitous. For this year, I settled on adding a timer to the AC line and only run the fan periodically and my energy bill is noticeably lower.
But here was always my problem, it is really hard to differentiate between the smart slackers at home and the hard working ones. And more than once, I was burned by really smart people who wanted to use their super powers to slack off.
BTW, great book: "The Sun Does Shine: How I Found Life and Freedom on Death Row" Mr. Hinton was released after 28 yrs.
That said, the on-line puzzles from chess.com or lichess.com are great. Puzzle books are great, better than sudoku, and you have an easy metric to see how well you perform.
Be careful not to play speed chess (its fun) but probably not the best for development.
I recently found: http://www.billwallchess.com/. what is nice, he has a lot of chess books in PGN notation, so you can get the book, then follow thru the whole book on a chess viewer, it saves a lot of time setting up pieces. So, books on endgames, etc are much easier to study.
At the early steps, I'd suggest not to waste time in studying openings and work on combinations, endgames. You just need enough opening to muddle thru and then you can win in later stages.
I am putting together a small binder of the openings I will play. If it is not in the binder, I will not play it. I've been far too whimsical playing things like Kings Gambit, but I need to focus on more specific openings, at least playing them more often.