HNHacker News
TopNewBestAskShowJobs

astromaniak

72 karma · joined June 2, 2024

submissionscomments
astromaniak··on OpenAI working on reasoning tech under code name 'Strawberry'
Interpretation of "reasoning" looks to be a matter of opinion, like AI and AGI. If it's sequential application of some rules, then there is a lot of 'reasoning' software around. Almost all of it. There is no strict boundary where it becomes 'AI'. However, even stochastic parrots like ChatGPT can be extremely useful and outperform humans on some tasks. So, OpenAI talking about reasoning actually didn't say much. Their GPT is already doing it at some level, it can even spell it out step by step.
astromaniak··on Reasoning in Large Language Models: A Geometric Perspective
With GPT4/o there is a trick for math problems. You can ask it to write the python code. This solves for example famous problem of counting letters in string. Sure model can be trained to use python under the hood without being explicitly asked. Pretty sure it can be trained to interpret code/algorithm step by step printing out intermediate results. Important in loops. Generating algorithm is easier for known problems, they learn it from github already. So, it looks like it's not that difficult to make model better/good at math.
astromaniak··on C++ patterns for low-latency applications including high-frequency trading
Just in case you are a pro developer, the whole thing is worth looking at:

https://github.com/CppCon/CppCon2017/tree/master/Presentatio...

and up

astromaniak··on C++ patterns for low-latency applications including high-frequency trading
Under the carpet deals would make it less transparent. It would be hard to detect that top manager sold all his stock to competitors and now is making decisions in their favor.
astromaniak··on C++ patterns for low-latency applications including high-frequency trading
> Warren Buffett proposed that the stock market should be open less frequently

This will result in another market where deals will be made and then finalized on that 'official' when it opens. It's like with employee stock. You can sell it before you can...

astromaniak··on AMD Is Becoming a Software Company
Finally they realized why NVidia wins. It's the whole coherent ecosystem, not just hardware with minimalist support in form of buggy drivers.
astromaniak··on New Research Finds Differences Between Male and Female Brains
The difference has two components: genetic, personal. Genetic does not depend on self identification. Personal is very similar these days. Same families, same schools.

As for trans. Humans, unlike most animals, cannot even have sex without being taught. The reason is humans for many generations, million years probably, lived in groups and learned how to do it. Those who didn't have genetically hardcoded knowledge how to make kids by the time they grew up they knew it any way. It wasn't necessary and with the time it was almost lost. The same with gender identification. Everywhere boys and girls where brought up differently. So, we lost hadcoded self identification. Today human kids may grow up thinking they are dogs, or wolfs, or sheep. If they happened to grow up with animals.

Conclusion is it's parents responsibility to give kids the right identity. Failure to do it, some brainwashed wokes don't do it intentionally, results in miss self-identification. Add to that 'doctors' multi-billon industry preying on them and some schools playing along to keep parents uninformed. There was a couple of months back interesting article about navy seal who had mental problems. He was brainwashed into believing he was a woman, and needs treatment and surgeries, payed by government. Later he realized he was just used to make money, and became a man again. The same happens to kids en mass. Because they are easy targets.

astromaniak··on Apple poised to get OpenAI board observer role as part of AI pact
it's very limiting probably too. likely they cannot have side contacts with competitors while having insider info in oai. also they likely cannot develop competing products themself. and obviously non disclosure. all this makes it a strong connection from both sides.
astromaniak··on Getting 50% (SoTA) on Arc-AGI with GPT-4o
There was a report about training small model on eventset completely generated by GPT4. Small stories using kids vocabulary. Probably (half) a year back. So it's possible. My idea was to mix in significant portion of generated texts on logic and reasoning. Which would be expensive to create using humans, but much cheaper using GPT. But you are right, process is unstable and will (likely) collapse without some extra efforts. Mixing is one way. That will make it still respond correctly on original data.
astromaniak··on Safe Superintelligence Inc. – Ilya Sutskever
> So if Superintelligence depends on AGI,

Not sure, is superintelligence generic, alive. Does it have motivation, goals? Sounds like a big calculator which he personally will control. Technically it's possible. LLMs aren't the end of AI evolution.

> To me, AGI still feels a long ways off.

It depends on how you define it. Just a couple of years back current LLMs' level was like from sci-fi. But here we are and progress is accelerating. I wonder how many labs and individuals are working on AGI trying to avoid any attention. It feels like any time now. May be something subhuman first.

astromaniak··on Getting 50% (SoTA) on Arc-AGI with GPT-4o
> First, LLMs are not AGI.

It's the most generic thing we have right now, right?

> Never will be.

If there is no other breakthrough anytime soon we can engineer AGI-like things around LLMs. I mean LLM trained to use different attachments. Which can be other models and algorithms. Examples will be image recognition models and databases for algorithms. Even now ChatGPT can use Bing search and Python interpreter. First steps done, others will follow. The result will be not a true AGI, but still a very capable system. And there is another factor. Next models can be trained on high quality data generated by current models. Instead of internet random garbage. This should improve their spacial and logical abilities.

astromaniak··on Google DeepMind shifts from research lab to AI product factory
I'm afraid this is going to be another Everyday Robots or Boston Dynamics. Google is ruled by managers, not visionaries. Strategy is 'try and see if it works in 4 years. if not cancel'. They followed it in many cases. So, DeepMind's cancellation is long overdue. A couple of years back one of Google's top managers talking about AGI said it's most likely to happen in DM. But current LLM boom happened elsewhere. Likely managers are disappointed in DM.
astromaniak··on Amazon-powered AI cameras used to detect emotions of unwitting train passengers
BTW, while EU laws protect personal data. From being exported, for example. Raw video and images should be ok to export and do actual recognition somewhere else, where laws are more permissive. No border crossing of personal data.
astromaniak··on Amazon-powered AI cameras used to detect emotions of unwitting train passengers
I had even bigger "brother" for significant part of my life. That was more than enough.
astromaniak··on Creativity has left the chat: The price of debiasing language models
LLMs aren't humans. you can be pushy without being rude. In cases like this I simply ask for the full version. Usually ChatGPT produces it. GPT4o is more verbose, so this should be less of a problem.
astromaniak··on DJI ban passes the House and moves on to the Senate
Will it be as good. I mean control, video recording and signal. Compatible with some HD goggles? I really doubt, but if you can explain...
astromaniak··on DJI ban passes the House and moves on to the Senate
> Some Autel drone are made in the USA

You mean are assembled in USA. Most soft and hardware is still made in China.

astromaniak··on Amazon-powered AI cameras used to detect emotions of unwitting train passengers
That's only official part. Having cameras you can track a lot. 1. recognize people 2. track who is interacting with whom 3. track who personally pays attention to what ads on the screen 4. get some clues about health and wealth. personalized and average 5. if cameras come with microphone arrays, 'for gunshot detection', you can listen selectively. +recognition, remember? 6. Read smartphones' screens.

Now all this in hands of private company. Ready for sale.

astromaniak··on Amazon-powered AI cameras used to detect emotions of unwitting train passengers
> "use a range of advanced technologies across our stations to protect passengers"

Total surveillance. Of course, that's for your own good. Do they guarantee that after 'smile detection' image is deleted. Or they keep images 'only for testing'?

astromaniak··on OpenAI and Microsoft Azure to deprecate GPT-4 32K
it can pretend, which often looks indistinguishable. so that you can't say if it's real or not.
astromaniak··on OpenAI and Microsoft Azure to deprecate GPT-4 32K
just wonder, do you know any opens source LLM? that can be reproduced?
astromaniak··on OpenAI and Microsoft Azure to deprecate GPT-4 32K
good weights are the key, but it has python interpreter and bing search. and likely more in development.
astromaniak··on OpenAI and Microsoft Azure to deprecate GPT-4 32K
It can't be, it's too big to die.
astromaniak··on New algorithm discovers language just by watching videos
babies do a lot more. they have feelings. like pain, pleasure. and different verities of them. then they have a lot of things hardcoded. and they have control of their bodies and the environment. for example they quickly learn that crying helps getting what they want.
astromaniak··on Nvidia Warp: A Python framework for high performance GPU simulation and graphics
doing business is hard this days. you can't be just a rich a*hole while working with people. have to care about your image. and this is one of the ways of doing it. hanging out free stuff. sort of selfless donations. but in fact this rises the bar and makes competitors' life much harder. of course you can be rich and narrow minded, like intel. but then it's hard to attract external developers and make them believe in you future. nvidia's stock rise is based on the vision, investors believe in it. while other giants are being dominated by carrier managers. who know the procedures, but absolutely blind when it comes to technology evaluation. if someone comes to them with a great idea they first evaluate how it fits in their plans. sometimes they their own primitive vision, like in facebook. which proved to be a... not that good. so, all this sort of managers can do is look at what is _alrady_ successful and try to replicate it throwing a lot of money. it may be not enough. like intel still lags behind in GPUs.
astromaniak··on Nvidia Warp: A Python framework for high performance GPU simulation and graphics
Exactly. and that's why it's valued at $3T++, about 10x of AMD and Intel put together.
astromaniak··on Claude's Character
They have the right to have their opinion and build it into their products. But how about having other opinions and products too? Imagine in hospital, or care houses, patients will be more comfortable with human-like AI. Or AIG when it happens.

As for trust, is it a bad thing? Anyway, humans' mind is speculative, biased, and prone to brainwashing. Looks like common thing with machines. So, trust, if it's bad, can be corrected by a few movies picturing evil AI. Pretty much like fear of clowns was created. Actually Terminator already created a wave of AI doomers.

astromaniak··on A ChatGPT mistake cost us $10k
Easy enough, ChatGPT can write verification code along the main line. Just ask.
astromaniak··on Keylogger discovered in image generator extension
No, they cannot work with large code base, not yet. And have very limited talent for logic and debugging. They may improve at some point, probably will be hooked up with external tools.
astromaniak··on Ask HN: Machine learning engineers, what do you do at work?
It's probably easier to reinstall everything anew from time to time. Instead of fixing broken 18.04 just move to 22.04. Most tools should work, if you don't have huge codebase which requires old compiler...

Conda.. it interfere with OS setup and has not always the best utils. Like ffmpeg is compiled with limited options, probably due to licensing.

← PreviousPage 2 of 3Next →