HNHacker News
TopNewBestAskShowJobs

carstonh

15 karma · joined May 8, 2023

data + maps
submissionscomments
carstonh··on A heap overflow and SSO misconfiguration to compromise OpenAI internal repos
agreed… why can an ID token for a separate client application be used to read and write to GitHub? that’s the story here.
carstonh··on Is GitHub Down?
Seeing the same. Tried to log a support ticket at https://support.github.com/, but that's down too :)
carstonh··on DuckDB is probably the most important geospatial software of the last decade
Based on my reading of the GeoParquet spec, the main difference is that geometries are stored as WKB using Parquet's byte array type. Byte arrays can be delta-encoded. There is also some additional metadata stored like CRS and a bounding box.

When using EPSG:4326 lat/lons, I don't think GeoParquet would give you any benefits over just having separate columns (this is what I typically do, and it's plenty fast).

If you are using range requests to fetch only parts of parquet files at a time, you could potentially sort your data using a hilbert curve, which could limit the number of row groups that need to be fetched to execute a query.

carstonh··on DuckDB is probably the most important geospatial software of the last decade
Here's an example building on @maxxen's work - because DuckDB (+spatial extension) can compile to Wasm, I built an in-browser Shapefile to CSV converter tool: https://www.honeycombmaps.com/tools/shapefile-to-csv-convert...