HNHacker News
TopNewBestAskShowJobs

jrichardshaw

279 karma · joined April 11, 2020

<https://jrs65.github.io/>
submissionscomments
jrichardshaw··on A Formal Mathematical Investigation on the Validity of Kellogg's Glaze Claims
The author does indeed do that via their definition of the volume equivalent sphere radius r_s.
jrichardshaw··on How to Lose a Library
The same happened to the Toronto Public Library around the same time, probably coincidence rather than connected. It has made me reflect on the breadth of non-traditional public services provided by libraries. I noticed because I was looking for practice questions for the Canadian citizenship test, and one of two non-profit sets is from the TPL (the other is from Richmond Public Library), and now it's no longer available anywhere.

It's not clear to me whether moving this role to the lowest level of government is a good idea or not: citizenship is one of the key responsibilities of the federal government, but it probably is better facilitated via new immigrant welcoming programmes which are usually community based. However, it seems pretty clear that if that is being done then we need to provide the resources to do so properly.

Also libraries are great.

jrichardshaw··on Python: Just Write SQL
I'd definitely like to second how great peewee is. It's been a core part of running our telescope for the last 8 years. It strikes a nice balance between power and simplicity, a significant set of useful extensions and great documentation.

Sometimes I find it impossible to believe that @coleifer is just one person. Peewee has 2300 issues and 500 PR's none of which are open and outstanding, and almost all of which he has personally responded too in a genuinely helpful way. He pipes up on Stackoverflow for peewee questions too.

jrichardshaw··on UnicodePlots
If you happen to use `iTerm2`, then https://github.com/daleroberts/itermplot works very well. I've used it before and can recommend it pretty highly.
jrichardshaw··on A beginners guide to Esperanto (2003)
I imagine you'll kick yourself for not figuring this one out.

It means homepage (constructed from hejmo = home, and pago = page)

jrichardshaw··on A beginners guide to Esperanto (2003)
I have bursts of progress trying to learn Esperanto, also with Duolingo. I guess the unfortunate aspect of Esperanto is that you don't meet a lot of other learners in real life so it's a bit of a solo endeavour.

I give a lot of credit to whoever put together the Duolingo course, there's a lot of amusing innuendo with Adamo kaj Sofia and apt sentences like "Li trinkas bieron, cxar li estas malfelicxa".

jrichardshaw··on It’s time to leave the leap second in the past
Actual research astronomer here, and as a (radio) astronomer I would love to get rid of leap seconds. Assuming that UTC = UT1 (the time measure based on Earth rotation) is not accurate enough for most calculation such that you already need to use UT1 tables/forecasts and leap second tables in your ephemeris calculations so there isn't really much benefit in trying to keep UTC close to UT1. And the reality is that for us they actually make things worse: we stop data acquisition at the telescope over the leap second period because we timestamp our data in UTC dealing with the changing interval would be a pain.

There are some good arguments for keeping leap seconds, but I don't think research astronomy is really one (it might be more useful for amateurs), particularly on ~100 year timescales where you don't expect things to slip that much. I think this sentiment is shared by most of my peers, particularly those who actually have to implement data acquisition and analysis pipelines!

jrichardshaw··on Imap-backup: Backup Gmail or other IMAP accounts to disk
Backing up my gmail has been on my list for a while (as step 1 of a migration away from gmail). Does anyone haver any experience with this tool, and could compare it to offline-imap (https://github.com/OfflineIMAP/imapfw) or mbsync? For something important like email, I'd rather use something older with more battle testing. I guess beyond a backup I would hope to use the offline copy to migrate to a new provider.
jrichardshaw··on Best Pens for 2022: Gel, Ballpoint, Rollerball, and Fountain Pens
That's a great description.
jrichardshaw··on Best Pens for 2022: Gel, Ballpoint, Rollerball, and Fountain Pens
Sounds like you moved from one nice system to another!

I pretty much moved over to a 12.9" iPad Pro + Pencil when they first came out. It replaced my "system" of doing derivations on the blank side of the leftover cover pages from the department printer. They were then "filed" into a giant pile in the corner of my desk.

Some part of the chaos of this system was deliberate - unbound sheets that you only write on one side of are great for derivations as you can lay out many of them on a desk to see what you wrote a few pages ago. Still the iPad is a vast improvement for me, even if you can't see everything at once.

Also I don't think the iPad Pro would improve things for you, it's great if you're used to the wonderful Bic Cristal, but you definitely won't get the precision of a super fine pen, though maybe the newer generation is better on that front.

jrichardshaw··on Best Pens for 2022: Gel, Ballpoint, Rollerball, and Fountain Pens
I'd like to add a bit of love for the timeless classic, the Bic Cristal. Reliable and consistent, and sufficiently cheap you can have them scattered all over home and office so there's one nearby when you need it. Apparently ~5 billion are sold each year.

Thinking about it now makes me a little sad that I've switched entirely onto an iPad instead of paper and pen.

jrichardshaw··on Zotero: Free, easy-to-use tool to collect, organize, cite, and share research
Thanks, that's good to hear! I'll give it another look next time I look at switching things up.
jrichardshaw··on Zotero: Free, easy-to-use tool to collect, organize, cite, and share research
I've tried to use Zotero over the years, and I always stumble with it because it didn't have a good handling of arXiv id's. The arXiv is one of the primary way of finding papers in my field (cosmology), and I really want to support ingestion via them, looking up actual paper details from them (while retaining the arXiv id), and including them in bibtex exports. I check back from time to time, but I don't think that's massively improved, but I would be very happy if anyone else knows otherwise.

Although it's gotten a little maligned here, I've actually switched to Readcube Papers recently, it supports everything I list above, and has been pretty good for everything else. It's a closed source and subscription which isn't ideal, but in the end I'm willing to pay for something that supports my workflow. I do worry a little about getting locked in, but ultimately, provided I'm willing to ditch any annotations, I think I can just export everything as bibtex and import to something else.

jrichardshaw··on The Scientific Paper is Obsolete (2018)
The GP is making a completely legitimate point here that broad sharing of large raw datasets is pretty hard, but I don't think anyone is arguing we should give up. Here's a few thoughts, though they're more directed at the general thread than the parent.

In my case I'm currently finishing up a paper where the raw data it's derived from comes to 1.5 PB. It is not impossible to share that, but it costs time and money (which academia is rarely flush with), and even if it was easy at our end, very few groups that could reproduce it have the spare capacity to ingest that. We do plan to publicly release it, but those plans have a lot of questions.

Alternatively we could try to share summary statistics (as suggested by a post above), but then we need to figure out at what level is appropriate. In our case we have a relevant summary statistic of our data that comes to about 1 TB that is now far easier to share (1 TB really isn't a problem these days, though you're not embedding it in a notebook). But a large amount of data processing was applied to produce that, and if I give you that summary I'm implicitly telling you to trust me that what we did at that stage was exactly what we said we'd done and was done correctly. Is that reproducibility?

You could also argue this the other way. What we've called "raw data" is just the first thing we're able to archive, but our acquisition system that generates it is a large pile of FPGAs and GPUs running 50k lines of custom C++. Without the input voltage streams you could never reproduce exactly what it did, so do you trust that? Then you're into the realm of is our test suite correct, and does it have good enough coverage?

I think we have a pretty good handle on one aspect of this, is our analysis internally reproducible? i.e. with access to the raw data can I reproduce everything you see in the paper? That's a mixture of systems (e.g. configs and git repo hashes being automatically embedded into output files), and culture (e.g. making sure no one things it's a good idea to insert some derived data into our analysis pipeline that doesn't have that description embedded; data naming and versioning).

But the external reproducibility question is still challenging, and I think it's better to think about it as being more of a spectrum with some optimal point balancing practicality and how much an external person could reasonably reproduce. Probably with some weighting for how likely is it that someone will actually want to attempt a reproduction from that level. This seems like the question that could do with useful debate in the field.

jrichardshaw··on Canadian Hydrogen Intensity Mapping Experiment
Cylinders are great in a sense. As you say the efficiency is awesome, but the standing waves make life complicated!

The GPU boom is causing big issues. Future projects are targeted at where we think GPUs will be in a few years, but you can never predict the crypto induced demand, and at the moment the price and availability is causing issues.

We already do make a quick full sky image, but unfortunately it’s not public. It’s actually a way easier problem than it is for MWA. Our antennas are on a regular grid, so it’s just a dense 1D FFT in each direction and we’re done. As the CHIME FoV is so narrow we tend to actually show just one column along the meridian against time, and that produces a lovely quick map of the sky.

The FRB boom has definitely helped the funding for everyone, and it’s been very successful for CHIME. Next stop, real time localization!

jrichardshaw··on Canadian Hydrogen Intensity Mapping Experiment
Unfortunately cosmology and astrophysics is basically all passive measurements. Doing a controlled experiment would be more useful, but would probably remove half the fun!
jrichardshaw··on Canadian Hydrogen Intensity Mapping Experiment
Just commenting to say that I work on this project. So let me know if anyone has any questions about it!
jrichardshaw··on PyInstrument – A statistical Python profile that focuses on the slow parts
I'm a big fan of pyinstrument. Many of the newer profilers, (e.g. py-spy) attach to a process externally via SYS_PTRACE and though that seems great in many ways, it is very much a no-go when you're running code on an HPC cluster and you don't have root access.
jrichardshaw··on Zoom Earth: Website lets you look at live satellite photos of earths surface
Oh, that's interesting. ESA says they distribute the Sentinel data free of charge as far as I can tell. So I guess the issue is that you'd need to download and host the data yourself, rather than just do an API call to someone else's archive?

Anyway, it's a cool website, nice work!

jrichardshaw··on Zoom Earth: Website lets you look at live satellite photos of earths surface
Can you use ESA Sentinel satellite imagery as an intermediate step? It's 10m ish resolution updated on a roughly weekly cadence.

I use it frequently (via https://apps.sentinel-hub.com/sentinel-playground/) to help plan backcountry trips around here, as it's great for seeing the local snow conditions.

jrichardshaw··on Astronomers detect regular rhythm of radio waves, with origins unknown
I mean, I sit around wearing headphones a lot, but that's about the closest it gets I'm afraid :)
jrichardshaw··on Astronomers detect regular rhythm of radio waves, with origins unknown
Yeah, that's definitely one of the main hypotheses. There aren't any other repeating FRBs known to do this yet, so how general a mechanism this is, is not known.
jrichardshaw··on Astronomers detect regular rhythm of radio waves, with origins unknown
There is some possibility of gravitational lensing of FRBs and people are definitely searching for it. However, in this case it is refraction caused by variation in the density of the ionised gas between us and the source (within our galaxy, the host galaxy, and at lower densities in the intervening medium).
jrichardshaw··on Astronomers detect regular rhythm of radio waves, with origins unknown
Good question. For many FRBs there is access to the original antenna time streams (which are essentially voltages samples at 800 MHz), so superficially that might give you 1.25ns resolution. However, the intrinsic width of the pulses seem to be more like ~1ms. That tells you something about the emission source, giving you a rough upper bound on it's size of c * 1ms ~ 300km.

However, lots of interesting plasma physics effect occur between us and the FRB. The dominant thing that happens is that low frequencies arrive later than high frequencies (as they travel slow in a plasma). This causes the FRB to be smeared over many seconds rather than a millisecond. There's also multi path interference effects and an whole bunch of other stuff that happens. So actual the temporal structure of the burst tells you much more about the intervening medium than it does about the source.

jrichardshaw··on Astronomers detect regular rhythm of radio waves, with origins unknown
To be slightly fair, the policies of the journals have a lot to do with this. I'll try and explain:

This paper was submitted to Nature as it would be fairly high profile, and Nature does now allow you to put in on the arXiv at submission, which was done in January. Since then it has been going through peer review, and being queued up to get published in the journal which finally happened on June 17th. However, during that whole time there is a press embargo. So although you may have seen it back in January, that was because a few outlets picked it up by scanning the arXiv themselves, and no one within the collaboration has been allowed to talk about it to the press, and no universities to publicise it in the intervening time. That embargo has presumably just been lifted which is why this is all coming out now.

Because of the embargo you wouldn't have seen quotes and comments from people involved in the initial coverage back in January, and even if I'd noticed it getting posted to HN back in January I would have not been allowed to comment on it like I'm doing now.

jrichardshaw··on Astronomers detect regular rhythm of radio waves, with origins unknown
Many.

I'm not super involved on the FRB side of CHIME, so I'm not 100% clear what is public and what isn't. But you can an idea from public info around the internet. I think the last total number made public was over 700 in March this year, and the previous one 30 in October 2018 (https://aasnova.org/2020/03/13/chime-detects-even-more-repea...).

jrichardshaw··on Astronomers detect regular rhythm of radio waves, with origins unknown
This is a good question. FRBs pose a lot of challenges for follow up because most of them are not observed to repeat (this doesn't mean they don't repeat, just that they haven't been seen to). So you see them for a few seconds and then they're gone. To follow up, you need to know where exactly to look, and most of the instruments like CHIME used to discover FRBs don't have the resolution to see exactly where on the sky it was. You can maybe pin point it to within 1/4 degree, but need more like 1000th degree resolution to meaningfully follow up in other wavebands.

The most useful follow up has been for repeating FRBs. What happens there is that the discovery telescope tells you were it is roughly, and you know it repeats, so you can point a high resolution radio telescope (something like https://www.evlbi.org) to get a more precise location and then you can follow up with other telescopes.

One thing telescopes like CHIME are trying to do in the near future is to build their own long baseline station to give much higher resolution, such that they can get localisation on bursts which don't repeat, and do better follow up.

jrichardshaw··on Astronomers detect regular rhythm of radio waves, with origins unknown
That's a fair comment. I mostly think the MIT press release is pretty good and doesn't go down that route, except for the title, which is definitely hinting at it.

Also agree that it would make sense to replace the link with the actual paper, or an article about it. University press releases are mostly there to play up their own contribution.

jrichardshaw··on Astronomers detect regular rhythm of radio waves, with origins unknown
Actually looks like Shriharsh, one of the folks in the collaboration has already done it! https://www.youtube.com/watch?v=oc8FsImLUEU

I guess he probably didn't talk about this because of the press embargo though.

jrichardshaw··on Astronomers detect regular rhythm of radio waves, with origins unknown
There's a few ways to do it (and the press release is surprisingly good and mentions most of them), but certainly one of the more obvious explanations is that the emitting object, is in a binary system with some other object, and that modulates the emission mechanism somehow.

I don't think either needs to be a black hole though. What I consider the most plausible candidate for emission is probably magnetars (i.e. neutron stars with extremely strong magnetic fields), and there's no reason the companion would need to be a black hole either, you just need a companion that gives a 16 day orbit and that's very easy to do with another star or neutron star.

Page 1 of 2Next →