shihab

May I ask what does “very fast” mean in the context of an issue tracker?

Bias more often hides in the news you don’t see, not the ones you do.

For example, many people have heard about 40 beheaded babies. How many have actually heard of Zaka? An ultra-right first responder volunteer group that made up this and several other stories that were plastered all over western media with zero attempt to verify it. Even Israeli media extensively reported on this group’s activities, but NYTimes and WSJ has been weirdly silent about all this up until very recently.

You all saw Nytimes’ investigation into hamas’ systematic use of rape. How many of you saw the news from NYTimes that both the parents and kibbutz of one of the central victims of the story said there was no sexual assault. And this also is a fabrication of Zaka.

Again, these facts are extensively reported in even Israeli media, several months ago. US media have recently started talking about this, and even now barely scratched the surface.

[deleted]

After seeng your comment, I just went ahead and watched the doc, and I frankly I find myself in a state of rage right now. From my limited understanding, I had this impression this was an engineering failure. And you know, when you have a complicated machine, sometimes shit happens.

But it wasn't that at all. Boeing knew clearly what the dangers of MCAS system were, they went to great lengths to completely hide the presence of the system from the world before delivery of the planes. Within days of the first crash, they knew it was MCAS, and kept trying to blame uneducated "foreign" pilots, kept trying to go on and tell the world again and again it was safe to fly, until that second crash happened. I understand greed, we all have that, but I don't understand how a company-wide culture can get so toxic, how utterly devoid of humanity do you have to be that your first concern after that crash and knowing there might be more deaths coming, is keeping wall street happy.

And what the hell FAA? 1) they didn't regulate properly before the plane was delivered, 2) After first crash they knew how dangerous the plane is, but didn't ground it (TAMARA report), 3) After second crash, you had the transportation secratary basically saying 737 Max was "innocent untill proven guilty" so let it fly before China forced its hand, 4) No criminal proescution in the end for those fanatic executives, just a cash fine.

And today this happens.

I have been looking for a "Harry Potter for adults" for quite a while now. This series came the closest.

I have read all 20 books!

I agree about ROCm.

When it comes to comparison to SYCL, HIP is much closer to the spirit of SYCL than ROCm is. Both aim to help writing a single codebase that'll run across multiple hardwares. For now though, the trajectory of SYCL appears much more promising to me than HIP. HIP is already split in two parts for CPU and GPU, which is baffling, and neither part seems to receive much love from AMD.

The thing about modern AI, it's that operations involved here (e.g. Dense matmuls) are lot simpler and GPU friendly than what you'd find in a typical HPC applications. This means you can get pretty close to peak hardware performance using high-level languages like Python or OpenAI's Triton. I think it's unlikely that the push to improve ROCm's standard libraries will come from an AI-focused startup

Appreciate it, will do.

Yeah. In this instance, I was talking about the same algorithm (phillox), the difference is purely in implementation.

> Generating random numbers is a bit complicated!

I know! I just wrote a whole paper and published a library on this!

But really, perhaps not as much as many from outside might think. The core of a Philox implementation can be around 50 lines of C++ [1], with all the bells and whistles maybe around 300-400. That implementation's performance equals CuRAND's , sometimes even surpasses it! (the API is designed to avoid maintaining any rng states on device memory, something curand forces you to do).

> running the same PRNG with the same seed on all your cores will produce the same result

You're right. Solution here is to utilize multiple generator objects, one per thread, ensuring each produces statistically independent random streams. Some good algorithms (Philox for example), allow you to use any set of unique values as seeds for your threads (e.g. thread id).

[1] https://github.com/msu-sparta/OpenRAND/blob/main/include/ope...

But you can't support Pytorch without a proper foundation in place. They don't need to support zillion _end_ libraries, sure, but they do need to have at least a very good set of standard libraries, equivalent of Cublas, Curand etc.

And they don't. My work recently had me working with rocRAND (Rocm's answer to Curand). It was frankly pretty bad- the design, performance (50% slower in places that don't make any sense because generating random numbers is not exact that complicated), and documentation (God it was awful).

Now, that's a small slice of the larger pie. But imagine if this trend continues for other libraries.

> Don't really see anyone writing anything in SYCL though

My work involves writing software that runs on many GPU platforms at once. So far we have been going through the Kokkos route, but SYCL is looking pretty good to me recent days. There is some consolidation happening in this space (Codeplay gave up working on their own implementation and merged with Intel). It was pretty easy to setup on my Linux machine for Nvidia card. Documentation is very good and professional, unlike AMD's, which can be frankly horrible at times. And Intel has a good track record with software.

I genuinely believe if someone is going to dethrone CUDA, at this point SYCL (oneAPI) is a far more likely candidate than Rocm/HIP.

Oh, I trust them alright-

+ "We are now rolling out the Gaza Nakba" - Agricultural Minister of Israel.

+ “We are fighting human animals, and we are acting accordingly...We will eliminate everything - they will regret it" - Yoav Gallant, Defence Minister.

+ "dropping a nuclear bomb on the Gaza Strip an option" - Heritage Minister.

+ "Nakba? Expel them all,” Nissim Vaturi, deputy speaker for Israel’s parliament.

+ "There will be no electricity and no water (in Gaza), there will only be destruction. You wanted hell, you will get hell." Maj. Gen. Ghassan Alian.

+ "only solution left is "voluntary" evacuation of Gazans to countries around the world" - Finance Minister Bezalel Smotrich.

+ "If it [Hezbollah] makes mistakes of this kind, the ones who will pay the price are first of all the citizens of Lebanon. What we are doing in Gaza we know how to do in Beirut," - Yoav Gallant, Defence Minister.

+ "You must remember what Amalek has done to you, says our Holy Bible. And we do remember" - Prime Minister Benjamin Netanyahu. (that verse goes on to command King Saul in the first Book of Samuel to kill every person in Amalek, a rival nation to ancient Israel)

Please, go through the images first. Then explain to me, how bulldozing a park aids in Israel's effort to fight Hamas?

Again, Israel has the right to fight and fight hard, anyone would do that in their place. But I think many people in the west are awefully unaware of just the scale and magnitude of the destruction Israel has unleashed.

Israel absolutely has the right to fight Hamas. But on the question of whether it's really defense vs avenge on entire population, I urge you to go through recent nytimes article titled "Gaza After Nine Weeks of War" with an open mind [1]. Entire neighborhoods has been bombed to rubbles, parks and roads have been bulldozed. Every single civilian structures, hotels, homes, playgrounds, port- on a large stretch beside sea has been utterly destroyed.

That's not a picture of a moral army fighting insurgents embedded in Civilian population, it's the picture of a fight against the entire civilian population- or "mowing the grass" in Israeli military's parlance.

https://www.nytimes.com/interactive/2023/12/12/world/middlee...

But this also means if another AI winter were to come, Nvidia will be hit on two fronts.

I also watched it last night, and it is my top pick for the year. It felt like a fantasy fulfillment film. For a nation with profound martial pride, the defeat in WW2 must have been a deep wound. But then there's Godzilla, an enemy that Japan can finally triumph over.

It's not a criticism. As long as the story is well-executed, who cares.

This article is not about Jews co-ordinating, it's about foreign govt agents in military uniforms coordinating with powerful sillicon valley leaders to punish, among other things, American citizens for holding wrong-think.

Among all these feel-good stories, how about one with a bit different ending?

During my masters, I created a ML library that dealt with noise in dataset [1]. I implemented bunch of papers, but unlike your usual research code, I spent a long time obsessing about it's API, performance, created documentation, CI- the whole shebang. But then, like avg research code, I moved on and promptly forgot about it.

One day about a year ago the cofounder of a very new, small startup working on something similar texted me about the project on linkedin. We chatted for a bit, but as a guy who thinks he's too cool for linkedin, I next logged in and saw his last message about wanting to collaborate about 3/4 months after the fact.

Well they raised $25 million dollars a few months ago :(

[1] https://github.com/Shihab-Shahriar/scikit-clean

How do you get started with that?

1. Hamas says over 7,300 killed in war; UN backs toll [1]

2. Despite Biden's doubts, humanitarian agencies consider Gaza toll reliable [2]

[1] https://www.timesofisrael.com/liveblog_entry/hamas-says-over...

[2] https://www.reuters.com/world/middle-east/despite-bidens-dou...

Here's another one: Israeli think tank lays out a blueprint for the complete ethnic cleansing of Gaza [1]....

"The Misgav Institute is headed by former Netanyahu National Security Advisor Meir Ben Shabbat, who remains influential in Israeli security circles. The Institute’s former chairpersons and founding associates include Yoaz Hendel (chair 2012-19), a right-centrist who was Minister of Communications intermittently in the years 2020-22; Moshe Yaalon, former Defense Minister (note that both Hendel and Yaalon have become opposed to Netanyahu in the recent years); Moshe Arens, also former Defense Minister — and other top political personas."

[1] https://mondoweiss.net/2023/10/israeli-think-tank-lays-out-a...

The ground invasion hasn't even begun, they have already killed 6 times more people than Hamas did. [1]

[1] https://www.cnn.com/2023/10/27/middleeast/gaza-death-toll-re...

Just so everyone understands the scale - Russia killed 550 Ukrainian children in 2.5 yrs of war.

In less than 3 weeks, Israel has killed 3000. [1]

[1] https://www.pbs.org/newshour/show/un-official-warns-hell-is-....

Edit: Could someone please explain why this comment has been flagged?

The feature I want most from hackernews: I want to make sure I don't miss any frontpage post in a topic of my interest.

It could be a browser extension that shows a little star beside the title, or maybe a program on my machine that emails me a bunch of those links at the end of everyday. Either way, no ML or trying to predict what I want - I'm just going to give it some keywords.

Now matching a keyword to a post can benefit from some nlp, and that'd be fine. Something simple like tf-idf should probably be enough. As long as the recall is close 100%, low precision is okay.

I think it boils down to which GPGPU camp you are in, AI or HPC.

AI has relatively simple workflow, less thread divergence, so the SIMT abstractions add very little value. HPC workflow on the other hand is lot more complex. Writing a good simulation program for example, is going to get inhumanly complex with just SIMD.

My understanding is that Google search is a lot more than just Pagerank (Map reduce for example). They had lots of heuristics, data, machine learning before anyone else etc.

Whereas the underlying algorithms behind all these GPTs so far are broadly same. Yes, OpenAI does probably have better data, model finetuning and other engineering techniques now, but I don't feel it's anything special that'll allow themselves to differentiate themselves from competitors in the long run.

(If the data collected from a current LLM user in improving model proves very valuable, that's different. I personally think that's not the case now but who knows).

I do not disagree that this was a peaceful move, I rather disagree that Yasser Arafat is an example of someone getting the peace prize despite acting against American/Western interest.

You're mistaken about Yasser Arafat. He wasn't awarded the Nobel Peace Prize for fighting Israeli apartheid; rather, he received it for ceasing that fight in line with the Oslo Accords- a deal brokered by the United States.

Here's a visual representation of why: https://en.wikipedia.org/wiki/Oslo_Accords#/media/File:Bill_...

> things that cannot be expressed that way tend to not be a good fit for GPU computing anyway

I'll have to disagree with you a little bit here. SIMT model of GPUs are quiet a bit more expressive than the numpy's SIMD model. As an obvious example, you'll have to manually maintain a mask to implement if/else i.e. code path divergence in SIMD. GPUs automatically does this and many more to make your life easier. And frankly, I find it lot more easier to reason about what should happen to one data point than a bunch of them together.

An interesting article I read recently that has some relevance to this discussion. https://pharr.org/matt/blog/2018/04/18/ispc-origins