zetalemur

Hi HN,

showcasing my project over the last years (again). The updated LC-Product works now pretty streamlined and it makes pretty interesting (and surprisingly good to compress) maps.

Stack is a collection of adjustable U-Nets that make predictions that are merged together to derive the final map.

Happy to answer questions.

Happy holidays and happy hacking.

Interesting read - there's a lot of progress in the open map styling scene and OSM maps with good data can make amazing maps and it has many different features [0].

It's also interesting to make maps directly from raw data (in this case that would be aerial imagery with mostly elevation data). E.g. if you find good training data you can easily make "land-cover" maps and although my example (of Austria) [1] does not have annotations (addresses, etc.), it's still nice to look at and has the benefit of being extremely compressible (compared to aerial raw imagery).

[0] https://wiki.openstreetmap.org/wiki/Map_features [1] https://turmfalke.httpd.app/test.html

Interesting default rendering choice for `()` in their demo pretty printer. It renders a space before each opening parenthesis.

Isn't what you describe a PID-controller: https://en.wikipedia.org/wiki/Proportional%E2%80%93integral%...

AFAIK that is the common approach to solve this problem, but it still needs some degree of sensor accuracy?

SEEKING WORK | Part-Time | Remote | Europe

Senior Software Engineer specialized in Django, Pipeline-Development, GIS and applied machine learning in the context of earth observation, sensor mapping in general and remote sensing in particular.

e-mail: freelancer-hn@zetalabs.io

Stack:

    - Django
    - Python (with eco-system: numpy, pytorch, etc.)
    - Linux
    - Godot
    - GDAL
    - OpenStreetMap
    - Rust
    - Bash-Voodoo

Available 20 to 100 hours/month (@110e VHB).

Example work: https://turmfalke.httpd.app/test.html

Happy coding and nice to meet you!

Interesting. Came to similar conclusions when analyzing my (httpd) access logs for https://turmfalke.httpd.app/demo.html ... but so far nothing really out of the ordinary.

Yes, I am aware of Sentinel-2 10m data (RGBN), there are even commercial offerings. Actually the storage requirements are not that big for 10m, like ~4TB for the entire (non-water) world. Napkin math:

  - 15000 Sentinel-2 scenes over land
  - 10980^2 pixels per scene
  - 50% lossless compression per scene
  - 4 channels (RGB and infrared)

This results in 15000 * 10980^2 * 4 * 0.5 / 1024*4 ~ 3.3TB. This matches commercial offerings like in https://cloudless.eox.at/#data. Of course we have to add lower-scale imagery that is often used to provide XYZ tiling that would further increase the storage requirements.

Thanks for the link to OpenTopography, it's an interesting project and elevation data is extremely valuable.

It's a nice start but what we also need would be an "OpenRasterMap" project - a project where we collect raster data (more and more data gets available) and store the entire planet (RGBN aerial imagery) in let's say 1m/Pixel.

It might be feasible to store entire planet's raster tiles in 10 years in a (beefy) desktop machine.

That's actually a nice idea. I guess we will see more software in the source code dependencies analysis space. There's so much code and often it's nice to have some kind of metrics (LOC, PageRank, ...) to get a grasp of what's important in a codebase.

Wow never heard of GBIF, but you seem to offer useful data. Am I correct that you are in essence providing georeferenced animal/plant population data across the globe in mostly CC license?

So, good luck!

Other HN discussion: https://news.ycombinator.com/item?id=30410077

> I feel like if I am worried about those issues, when would I ever use sqlite instead of Postgres?

Sometimes you do not want to run an additional process/daemon like postgres. Your state is in essence now a file on some file system that you can atomically (full ACID) update using multi processing without the need for more complex machinery - you can get very far with this architecture.

That would have never worked because such a license would be at odds with free and open source licensing and Docker wouldn't have gotten any traction in these communities (that provide the infra backbone of the whole stack).

I get your intention, but monetizing infrastructure and systems code is pretty hard.

"Working" can be interpreted differently. 75% accuracy (?) is not that great for predicting a specific class (depending on distribution on course).

If you need high accuracy, let's say for e.g. estimating eco system performance based on specific plant distribution, 75% is very low (especially if you want to feed it into another predictor) compared to a professional field biologist.

Probably because it is mostly compared to Python - which is arguably a low bar to beat.

> GHC'ss linear types don't give you uniqueness types in the same way rust does

Why, though?

Is it because GHC's linear types are a superset of Rust's linear types? I guess that could rule out some features the compiler is able to prove (or not).

Yeah and hosting it by yourself is slightly non-trivial as the storage requirements are in the PB range.

That's a good one, did not know that. Interesting read.

That's why we have this bloated over-engineered multi-node applications: People just underestimate how fast modern computing is. To serve ~2^6 requests/sec is trivial.

It's easily served by a simple server.

You are technically correct. The best kind of correct. :)

Yes, I may have worded that wrong, it's certainly possible. But is it reasonable? By that, I mean can it compete in performance with C/C++/Rust?

It's interesting to see that many long-standing members of the Haskell community take a look into (or even heavily use) Rust and add it to their repertoire. This is really a good sign for Rust (Haskell folks normally have high expectations from a PL).

It makes sense, as (currently) it's pretty much impossible to tackle some important domains (e.g. image de/encoding) in Haskell while in Rust we already have libraries for that. Also: Idiomatic Rust is already extremely fast, while in Haskell it is non-trivial to implement high-performing code.

Prime example: The sieve of Eratosthenes (and I think we can agree that this is a prime example). In Rust you can implement a trivial solution that performs extremely well. In Haskell you will probably reach for the ST monad and I think it's controversial if that's idiomatic or not (and maybe non-trivial to grasp - as far as I know ST is implemented via compiler magic).

Note that "Umwelt" is just the german word for "Environment" (or "Surrounding") - which actually fits in this context.

That's true, but there is also cloud.hetzner.com. It is rather newish and lacking most features the big 3 offer, but it might be getting there.

It's true, I don't have any problem with using SPACE via left thumb, but I have never encountered a layout or keyboard that let's me use the thumb for modifier keys. Do you have an example?

Many years ago I too had pain in my wrists while doing lots of programming work. For me the game changer was using Vim and mapping ESC to jj in both the editor and the shell (via .inputrc). In fact I mostly use Vim because of the provided ergonomics, the fast editing capabilities are just the cherry on the cake.

In my opinion the main culprit are modifier keys (e.g. by default the shell uses emacs bindings and you do a lot of ^A, ^E, ^R, etc.), but using jj mostly solves the issue as you just have to reach for Ctrl when you require SIGINT or copy/pasting in different environments that do not support vi keys. There are also people that remap it to Caps-Lock, but I just don't like to use my pinky that often.

Of course, everybody is different, but it makes sense to think about a setup that suits you and your health.

Very true.

Part of the reason is probably that you need the proprietary drivers to use CUDA efficiently and as they are not in the (upstream) kernel you have to use some other tools, like unofficial repositories or the native installer (which doesn't always play well with the OS package manager, system upgrades, etc.). It's a real PITA.

For a long time, I thought awk was just an abbreviation for "awkward" (in fact it is named after its inventors, Alfred Aho, Peter Weinberger, and Brian Kernighan) which seemed fitting as its syntax looks arcane (compared to modern languages) - I really thought the name was some kind of elaborated joke ... :)

However I learned to like it and use it often in CLI one-liners (mostly to cut out or reformat specific columns, probably the most common usage).

> you can go one step above the suggestion in this deck with `set -o vi`

Highly recommended if you use Vim regularly (and you can define the same escape key(s) for your terminal and vim instance). For me that was one of the biggest productivity boosts when doing editing and command line work.

Great! And a big thank you for managing the site!

Btw. TIL that you can use `comments > $x` in Algolia's search. That's a cool feature (didn't know about that) or use popular search engines' `:site` ...