Hacker News Reader

Comment by rad_gruchalski | Hacker News Reader

> Add MPI to the mix, and you can distribute that work to multiple machines. Potentially to thousands of them.

My understanding is that coarrays are a modern replacement for MPI and that coarrays abstract the notion of "machines", they bundle that under "multiple CPUs". I'm not very fluent in either of those, only know as much as the "Modern Fortran" book explains but from the examples I have seen, coarrays can do anything MPI can and they're simpler to work with.

> So, having one trick is not a bad thing here.

Definitely not. Personally, I would imagine myself using it if integration with other technologies over the network was available out of the box.

View on HN

> My understanding is that coarrays are a modern replacement for MPI

Well, yes and no. Co-arrays are a higher level abstraction, belonging to the category of Partitioned Global Address Space (PGAS).

Depending on the implementation, co-arrays might very well be implemented on top of a MPI library (as there has been a huge amount of work making MPI fast over all kinds of fancy interconnect fabrics).

Aren’t coarrays only for single machine CPU parallelization? I‘d be surprised if you could abstract a whole network topology over it. The MPI communicator is really where it’s at when you want to drive a whole cluster (and if you’re using Fortran, you probably do).

A quick glance at Coarray Fortran [0] shows that Coarray library is built on top of MPI instead of replacing it.

MPI and InfiniBand are irreplaceable technologies for HPC clusters as of today, both in terms of speed and latency. Lastly IB is not a connectivity layer. It's a HBA which carries information from memory space of one application to another. So it's properly "Magick" in terms of programming and research.

[0]: https://en.wikipedia.org/wiki/Coarray_Fortran

not necessarily. But at least one of the major Coarray implementations (Intel Fortran compiler) translates the Coarray syntax to MPI so that the Intel MPI library can be used underneath. As a counter-example, the NAG Fortran compiler implements Coarrays for shared-memory architecture, and apparently has nothing to do with MPI.

Reply on news.ycombinator.com