Show HN: I shot high-res stitched panoramas in Iceland using a thermal camera
petapixel.com
petapixel.com
I used a Seek RevealPro which outputs TIFF files that contain 32-bit floating point values. I created a script that takes in a Seek TIFF and outputs an 8-bit greyscale integer TIFF:
https://github.com/dheera/iceland-thermal/blob/master/script...
I then panoramically stitched those 8-bit TIFFs together (some with the help of hugin, and some manually with GIMP) and distortion-corrected them as best as I could to a black-and-white visible light image. I also created an artistically-chosen color map for each image. For the final output image, hue and saturation are fully based on thermal data, and lightness is a combination of thermal and visible data. Scripts to generate the final output images, along with the panoramically pre-stitched data, and the color maps I used:
https://github.com/dheera/iceland-thermal
Also, my Instagram, which is mostly astrophotography of late, but I did post thermal images there before and I may do so in the future again if I can find another good set of interesting thermal subjects to do this in!
The Lepton 3 seems to be decent at 160x120 though, which is probably good enough for a project like this, so if I were doing this again I'd probably use a Lepton 3 and a 2-axis servo scanner with a RPi, and maybe even combine it with an RPi HQ camera to automate the entire process into a single push button.
The Seek RevealPro is slightly annoying in that it doesn't have programmatic access so I had to press a button to take every piece of the panorama. It's a great general-use device though. I use it when camping or doing astrophotography in remote locations for some peace of mind since I can spot any potential wildlife and people threats from a distance, and I can easily identify whether a parked or seemingly abandoned car has been recently occupied. (My fears may be unfounded, but either way I'm much more at ease when I can see in the dark.)
The Boson seems like it has great clarity and refresh rate, but at that price I might as well just buy a purpose made device (outside my price range).
I also had to stand there for a good 15 minutes in the biting cold before they stopped being interested in me and kind of just stood there.
They still occasionally turned their heads though so I quickly snapped my visible light image with a DSLR in one hand on a tripod and scanned over the horse part with the thermal camera in the other, before patiently scanning the rest of the scene. The horses in the distance though still did move, as you can see in the separate thermal/visible images in the repo.
I had to do a similar thing for the erupting geyser. 2 quick thermal shots in rapid succession for the eruption in one hand, DSLR in the other, then scanned the rest of the scene. Took about maybe 20 tries at least.
I bought a Therm-App Pro 640x480 a while back and it's quite good - and reasonably priced compared to Flir - along with a github repo for different false color palettes. But what's really weird is it seems to not be available anymore. I'm guessing export restrictions or massive demand for thermal cameras during Covid along with supply chain issues. IIRC it is also 25 frames a second, which is unusually high for thermal cameras due to export restrictions.
Edit: Here's a post on creating panoramic images with therm-app. https://www.flickr.com/groups/therm-app-users/discuss/721576...
> Author here. The camera was a Seek RevealPro which has 320x240 resolution. The thermal data in the panoramas are stitched together from raw data exported by the camera and represented as color (hue+saturation, as per scale in upper right, represents temperature data).
The brightness channel is piecewise-linearly combined with a corresponding visual image taken with a regular SLR to provide a visual reference of what you're looking at.
Sounds like you have a science background and field, but I’d encourage you to think of these as art and chat to a few galleries about an exhibition. At the very least it would be fun, and pretty amazing to see big blowups of your own imagery. They may be able to do a virtual exhibition during Covid.
I would love to! I'm a physics/EE major by training and career-wise I'm focused on ML and robotics, but I love art and especially using art to visualize science in ways that are understandable to the general public. (I'm also doing an astrophotography project to show the visual sizes of various nebulae. Your usual NASA photos don't really provide any sense of scale, and many people have the misconception that you need insane magnification to see them, but there are actually a whole lot of objects that are visually much bigger than the moon, just too dim to see.)
Being an engineer by background my network is mostly engineers -- I don't really have any strong connections with galleries and media, but I'll be on the lookout for them! I welcome intros if anyone would be so kind. :) TIA!
Your images look almost like they came out of James Cameron's vivid imagination. If you had told me these were computer-generated images of Pandora at night[a] from the upcoming Avatar sequel, I would have believed it.
[a] E.g., see https://www.google.com/search?tbm=isch&q=avatar%20pandora%20...
>I also simultaneously shot a black-and-white photo with a regular camera and a wide-angle lens for comparison. I then wrote my own program to color the black-and-white photograph with the actual thermal data, using a false-color scale which you see in the upper-right corner of every image.
Amazing drawings, but these are not actually thermal images.
I'm curious what resolutions you've worked with, if you don't mind sharing. High frame rate thermal cameras (above 9hz) are ITAR restricted. Hi-res above 640x480 is not common on the consumer market and is restricted to embargoed countries. Cooled thermal cameras are restricted too IIRC.
As an example of what I would have expected, this product brief (not the device we were using, but similar) has a picture of the white house https://www.lockheedmartin.com/content/dam/lockheed-martin/m...
Sounds like super interesting work!!
They're right around the corner from FLIR and Seek Thermal is right down the street.
Lots of amazing tech in this little town.
Yes, there is no debate about that.
As for the price per pixel: I don't know from memory.
A major limiting factor in camera sensor resolution is signal to noise ratio. It is well known that if you bump up the "ISO" (light sensitivity) to make photographs at night, you see more noise. The higher the sensor resolution, the smaller each photosite and therefore the less signal (fewer photons) captured in the short time of one exposure.
Larger sensors can solve this problem but these are CMOS devices whose cost increases superlinearly with area (like microprocessors, see die yield). Most customers won't accept dead pixels.
Economics is also a major enabler of kilobuck 50 MP visible light cameras, miracles though they are. Industrial users aren't going to re-buy all their cameras every few years like DSLR users do.
I'd really like a monocular, but anything decent is very expensive.
The major market so far seems to have been tactical/military, so they have focused on framerates rather than resolution. And then the US blocked high framerates for civilian use...
(edit: the US blocked civilian exports.)
[0]: https://www.bhphotovideo.com/c/product/1194041-REG/flir_431_...
So I guess they only blocked civilian exports from the US.
[0] https://www.hikvision.com/en/products/Thermal-Products/Comme...
The technologies behind thermal cameras are very different because they need to be sensitive to wavelengths 10x longer than visible light (the silicon in CMOS is basically completely insensitive to light above 2 um, whereas thermal cameras need to image at ~10 um). The pixels are effectively microbolometers and rely on more exotic materials like Germanium.
Mike did a real teardown on a Flir E4 many years ago, and saw (with an oscilloscope), even on the cheap camera with the low resolution, the chip has the full resolution. I think one week later the camera was hacked.
To put it one dimension higher, in Pix4D we work on 3d models based on the thermal images: https://www.youtube.com/watch?v=x-jp9a1bpVU Example: https://sketchfab.com/3d-models/thermal-model-of-pix4d-headq...
Any thoughts on why the photographer reversed the spectrum (red cold, blue hot) for the fumarole? https://petapixel.com/assets/uploads/2019/07/image10-1.jpg (just looked cooler?)
Or why the distant horses have breath showing, but the closer ones do not? https://petapixel.com/assets/uploads/2019/07/image1.jpg (maybe a resolution/compositing issue?)
I took some artistic liberty in choosing color scales for each photo (a) to make them look unique (b) to make people actually look at the color scale (c) because as someone with a physics background it bothers me deeply that people associate hot with red and cold with blue and even go so far as to call 6000K "cool white" and 3000K "warm white" when those are literally blackbody temperature equivalents. So I flipped it around on one shot :)
There’s some reason for encouragement however. I bought a Seek Pro, with 320x240 resolution, on sale for $350 earlier this year. The app is pretty terrible unfortunately and the camera physical construction is flimsy, but the imager seems to be of reasonable quality for the price point.
Couple of examples: https://imgur.com/a/ZGsOwUm
Will we ever see chap(ish) IR cameras? Is there an alternative to germanium lenses on the horizon?
I didn't really have a use in mind for it, I just thought it was interesting and thought I'd find uses for it after I owned it, but the resolution was too low to be able to do anything useful.
Here's the only picture I have of it working: https://img.jes.xxx/1047
As you can see, you can't see anything.
Thank you.
I wanted to get one to (a) find creatures outside at night while camping, and (b) fix my house energy leaks. But that rez seems awfully low. So amazed at the OP for doing such an amazing job stitching images!
I even used it to try to find a friend's lost cat once. I didn't succeed in finding the cat with it, but I did end up finding a few other stray cats and racoons. (For anyone wondering, the pet cat was found later and was taken to a shelter by some good samaritan.)
This is not completely correct. Glass tends to reflect infrared radiation. For example if you view a car windscreen from the air with a thermal camera, you'll see a reflection of the sky.
It's more complicated than that, because you'll also detect the emitted blackbody radiation from the glass (for whatever temperature).
I'm used to thermal cameras being so lo-res you can barely tell what they are.