tobilg

The SQL Workbench is built upon DuckDB WASM, Perspective.js and React.

It supports the querying remote and local data (Parquet, CSV and JSON), data visualizations and the sharing of multiple queries via URL.

There‘s also a tutorial blog post at https://tobilg.com/using-duckdb-wasm-for-in-browser-data-eng... that explains common usage patterns.

Happy to answer any questions!

Have a look at https://www.serverlessmaps.com/ which uses PMTiles to generate the tiles from OSM data. It's also possible to host the PMTiles directly on S3 and use HTTP range requests to retrieve the desired bounding boxes. Under the hood, it uses CloudFront as CDN, Lambda@Edge functions and S3 (see architecture at https://github.com/serverlessmaps/serverlessmaps/#architectu...)

It's a very cost-effective solution as CloudFront has a 1TB/Month free tier, compared to hosted solutions.

Thanks you for the kind feedback, loading spinners definitely make sense (have a look in the lower right corner, there's a small indicator already at the moment, but it should be bigger.

Query history is already built in, but not yet exposed. Will think about how this can be integrated in the UI the best way.

I guess AWS CloudFormation

Thanks for the feedback! DuckDB can handle JSON data via the JSON extension, but this hasn't landed yet in the DuckDB-WASM package itself which is the basis of the adhoc querying features.

The intended audience of this little tool is more in the direction of data engineers or data analysts, which search for a quick and easy way to analyze datasets up to a few million records...

I also wrote a blog post as introduction: https://tobilg.com/serverless-maps-for-fun-and-profit

We've had quite some success with deploying "serverless" maps, leveraging PMTiles. Have a look at https://github.com/serverlessmaps/serverlessmaps if you're interested to deploy this on AWS CloudFront/Lambda@Edge/S3...

I‘d rather just use DuckDB and write a few SQLs, and be done.

This can be done in the terminal as well.

Using a decent IaC framework such as Serverless Framework or the CDK instead of the AWS CLI would make the deployment pretty easy.

https://tobilg.com Pretty new, started blogging again after many years, focussing on data and AWS topics

- Using DuckDB in AWS Lambda https://tobilg.com/using-duckdb-in-aws-lambda

- A poor man's data lake in the cloud https://tobilg.com/casual-data-engineering-or-a-poor-mans-da...

- Gathering and analyzing public ip address data from cloud providers https://tobilg.com/gathering-and-analyzing-public-cloud-prov...

My 1TB version doesn't get as warm as yours, but also randomly unmounts from MacOS as well.

I don't think this is correct, or I didn't really understand your use case. Could you give an example for "any kind of operation on the underlying data"?

The main use case for me for DuckDB is in Data Lake-related tasks where cloud providers often do not provide great/cost-effective/otherwise limited services.

In the case of AWS, repartitioning Parquet files in S3 via Athena CTAS statements in limited to 100 active partitions, which is a bummer to work around. Therefore, I’m using DuckDB with repartitioning queries, because it doesn’t have the 100 partition limit.

I wrote a blog post about it at https://tobilg.com/casual-data-engineering-or-a-poor-mans-da... Additionally, to get started with using DuckDB serverlessly in Lambda functions, you can have a look at https://tobilg.com/using-duckdb-in-aws-lambda

Plus members of the AfD party, which is currently in the Bundestag, and under scrutinity for far-right / Nazi connection.

Yup, Not usable on an iphone

That’s not correct. Creating a UG will set you back hundreds of EUR for notary fees, commerce registry entries etc. And you have to prepare your annual accounts, which, if you let a professional handle it, will easily cost you hundreds more

Honestly, I don’t get the messaging. What is Deta Space from your pov?

I bet this will be web3 / crypto / etc.

If you’re running on AWS, you could have a look at https://ownstats.com

Yeah, that should be possible I guess. I slightly had another idea in the back of my head with LSH.

E.g. see https://davidwells.io/blog/rise-of-embarrassingly-parallel-s...

I built something similar 2.5 years ago in case you're interested: https://github.com/tobilg/lsh

This came out three days ago already. Apparently a premature launch, but it’s still in the changelog of the AWS JS SDK: https://github.com/aws/aws-sdk-js/blob/master/CHANGELOG.md

To provide this service for free can get quite costly I assume https://aws.amazon.com/ecr/pricing/ applies (e.g. $0.10/gb stored in public repos)

Or use https://github.com/tobilg/serverless-aws-static-websites with the Serverless framework

Debezium is used for Change Data Capture, and created database changes event streams: https://debezium.io/documentation/reference/1.5/connectors/i...

It's not exactly what you're searching for, but might be worth a look.

Grew up in the area as well, but we had „Matschbrötchen“ which uses white rolls instead of Laugenbrötchen

I live in the Hamburg area, and none of the local bakeries is offering black bread. It‘s common in northern Frisia, and eventually some areas in Schleswig-Holstein.

Let me guess, you’re from Swabia?

Funny thing is Butter Lindner originates from Berlin, and Franzbrötchen are a Hamburgish sweet treat.

As a German, I think this is a myth. Black bread/pumpernickel are only to be found in some regions of Germany, and even there, it’s not very popular among people younger than retirement age.