rywalker

CoreDB has raised a $6.5M seed round to building a managed Postgres service: * Use any extension, even custom or private extensions * Provide UI for popular extensions, and a framework to include the community in those efforts * Solution Kits - packaging of extensions, tools and configurations, to make it easy to get started using Postgres for specific new use cases * An intelligent advisor that helps you to better use the features that you’re already using in Postgres

pl/rust will be available on CoreDB when we launch, along many other popular and interesting Postgres extensions. We’re a new company, closed beta - but join our waitlist @ https://coredb.io if you’d like a shot at early access

Definitely not a complete list - companies missing

I’d say bank stocks with biggest price drops would be big indicator of which banks are most at risk.

I wouldn’t be surprised if all bank stocks are halted with the market open, to contain the contagion.

I tweeted that today :)

https://twitter.com/rywalker/status/1634614103586078721?s=46...

Monday is going to be a shit show.

All banks are going to see large depositors pull funds, to diversify risks. They will have incoming deposit activity too, but the weaker ones may have a cash crunch that causes a widespread run, as dominos begin to fall.

Hopefully govt takes quick actions like this one, to minimize effect - but we are definitely getting more pain before relief :(

The bank formerly known as SVB is no longer, it's now called "Deposit Insurance National Bank of Santa Clara" as a sort of temporary organization.

What's the background on the project? Is it used in production somewhere? Why was it just made open source?

New view https://ossrank.com/fast — attempting to answer which OSS projects are moving up the fastest (over past 30 days).

Is this system compatible with existing DAGs that I may have written? If not, is that planned?

This is interesting, but how does it compare to Pulumi and Terraform? Is Cloudknit intending to compete with these?

We're happy to add it, email support@ossrank.com :)

My interpretation of the charts is that they are in a good duel, but Phoenix seems to be pulling away lately as Actix activity is waning.

I've never used either framework; would you agree with that assessment from other signals you've seen?

Looks like Actix dropped off a lot since Nikolay Kim stepped away from the project (no commits for past year https://ossrank.com/p/1906-actix)

Yeah, you can't even add projects when you sign in yet — super early!

I added it for you though @ https://ossrank.com/p/2037 (1000 isn't the real rank, will take a few hours to get ranked, we rescore projects every 3 hours)

#MVP

We add projects as they catch our eye, or upon request, because we manually categorize and try to clean up the contributor list, mark bot committer as bots (and exclude them), and identify a few of the top developers as we add them.

We've added Gladys Assistant @ https://ossrank.com/p/2035

I'd put Github stars in the very weak category :)

Combining commits + contributors is my favorite (obviously!), especially when considered over a long time range.

Yes, some (usually smaller) teams make small incremental commits, others have more ceremony and commits tend to be less frequent and bigger. And you could easily game the system theoretically, but not easily in a project of important and substance.

We've added a voting system, where we give every dev 20 votes, and we'd give more notable OSS contributors a higher weighting, but it's very early days for that — but we'd mix that data into the score if we had it.

How would you do it? We're open to suggestions :)

ah sorry - thanks :)

The designer talks about it in this video https://youtu.be/WJL00d1JB4Y?t=70

We've outlined some of the key new features of Airflow 2.0 here - https://www.astronomer.io/airflow - and it's available on Astronomer Cloud today.

firing your devops person? maybe wait a few weeks to be sure!

service never came up; also can't delete it :(

"Environments with CREATING status must complete previous operation before initiating a new operation."

can't email support for help (i only have basic plan)

any AWSMWAA ppl on this thread and can help? the instance name is `airflow-ry-test`.

if you like YAML-based DAGs, you can do that in Airflow with the dag-factory extension https://github.com/ajbosco/dag-factory

fyi airflow 2.0 ships in the next few weeks, we're made a lot of improvements https://www.youtube.com/playlist?list=PLCi-q9vYo4x-PESoBcXN0...

i'd let you know if their service came up :) been waiting an hour after hitting the "create" button

disclosure: co-founder of astronomer

You could certainly execute a Terraform script from an Airflow DAG, but I wouldn't say it's a common use case.

Yes, we need to improve the backfills in Airflow.

We're working on making the scheduler HA and more performant, reach out to me if you'd like to collaborate on your use case (ry at astronomer dot io)

1) An official Helm chart is coming very soon. We (Astronomer) have a commercial platform that aims to solve this completely including observability, configuration and deployment. Happy to team up to improve Airflow's open-source k8s story if you have some ideas.

2) Yes the UI is outdated, and not responsive. We're going to kick off a process to build a new modern UI in Q3 (a full-featured Swagger API is being built now, which the new UI will rely upon.)

3) I personally think catchup true is a fine default, but whatever. Generally when I launch a new DAG I want to generate some historical data using the DAG.

4) Airflow has tags now since 1.10.8 https://airflow.readthedocs.io/en/latest/howto/add-dag-tags.... - we decided not to do folders.

5) That's true, but it also provides a low bar to entry. There are some guides written on unit testing DAGs, but I agree we should be a test-first community. On my roadmap.

6) Celery w/ KEDA is pretty nice - check out https://www.astronomer.io/blog/the-keda-autoscaler/

7) I personally love the PythonOperator for simple DAGs. Agree that DockerOperator (KubernetesPodOperator if you're running Airflow in K8s)

8) Yes, logging UI will be improved in the UI rewrite. What's your favorite UI for this?

9) That feature is in the queue https://github.com/apache/airflow/issues/7911

We were a very small company when we discovered Airflow, just saying, and it provided a lot of value to us vs. alternatives.

We fell in love with Airflow's capability to allow us to write one small python program that generated hundreds of tailored dags by iterating over the configuration of each of our customers. This dynamism is very powerful for similar use cases.

re: ETL framework - you can get a lot done with the built-in Airflow Operators, including the PythonOperator (and bring in any python dependency you like) and BashOperator (call any CLI, etc.) - it's not drag-and-drop, but I've found it to be quite versitile.

re: idempotency - yes, make your workflow tasks idempotent.

re: latency - this is being worked on very actively. Ash (PMC member) has committed to working on task latency almost exclusively until it's resolved

re: sensors, there is some great work from Airbnb to improve: https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-17+A...

It's not quite "open source", better labelled as "source available"