vovavili

It's definitely better than raw 500+ lines of SQL composed with 300+ lines of Python for some bespoke business transformation without clean versioning, which is what SQL transformations tend to converge towards without something like dbt.

Different tools for different tasks.

What an enormously tendentious and underinformed take.

Embedded databases like DuckDB are just as suited for dbt work.

At the minimum, it's just Jinja2 templates in your SQL queries - meaning, you can do pure SQL transformations with conditional logic in your templates. In addition to being able to run tests, specify custom macros, having version control and having some constrained way to organize your tables, you're turning SQL into a proper programming language with just one library.

OpenCode Desktop + Muse Spark 1.3 Free is actually surprisingly good.

Global productivity down 90%.

You should be using dbt instead of string manipulation for serious query building.

Altair and Positron should be just as good for your Polars @ Python needs. With software like Marimo notebooks and VegaFusion, Polars/Python experience starts beating R by quite a substantial margin.

It's almost like running a trillion-dollar business with neck-to-neck competition against other frontier labs and even state-sponsored efforts requires some ethical trade-off.

Location: Netherlands, The Hague/Amsterdam, CET

    Remote: Yes. Hybrid in The Hague/Amsterdam/Randstad also works.
  
    Willing to relocate: Open within the EU+EFTA for the right role. US/UK/HK/SG only with serious relocation support.
  
    Technologies:
      Core: Python, SQL, R
      Data engineering: PySpark/Spark, Databricks, dbt, Airflow/Dagster/Prefect, Kafka, Polars
      Warehouses/lakes: BigQuery, Snowflake, PostgreSQL, DuckDB
      Cloud/infra: Azure, GCP, AWS, Docker, Kubernetes fundamentals, Terraform
      Data quality: Great Expectations, Pandera
      ML/NLP: XGBoost, Keras, PyTorch, SetFit
      Also some Go, Rust, Scala
  
    Résumé/CV: https://drive.google.com/file/d/1qRsq9QoQF0hZ2FSmhaidGTUd1JmHSb-M/view?usp=sharing
  
    LinkedIn: https://www.linkedin.com/in/v-vilimaitis/
  
    Email: vladimirvilimaitis _at_ gmail _dot_ com

Senior data/platform engineer, around 5 years of experience. I build data systems where the output has to be trusted. Recent work includes validation frameworks for EU regulatory reporting at ESMA, Spark/Databricks pipelines for logistics use cases for SHV Energy, ESG reporting for KPMG, healthcare migration/data quality work around openEHR, and BigQuery/Airflow pipelines for logistics analytics. I’m strongest in messy-source-data problems: ETL/ELT, data quality, warehouse/lakehouse modeling, pipeline reliability, cloud data platforms, and making analytical systems debuggable by people who were not there when they were built.

Looking for: data engineering, data platform, backend/data infrastructure, analytics engineering with real engineering depth, machine learning/data-heavy DS roles, ML/LLM infrastructure, or small technical teams building data products. Open to both full-time positions and contracting.

Available immediately.

_That_ Oklo? This is wild, god bless your work.

The fact than an app like this can be vibe-coded is actually mind-blowing. I'd love to see your prompt history here.

>company running out of money, not by investor pressure

Potato potato

Darklang is probably the closest thing that comes to mind - https://blog.darklang.com/goodbye-dark-inc-welcome-darklang-...

I'd rather have an established company give broad autonomy to PL developers at a loss (Go at Google, Swift at Apple) than risk eventual squeeze when VCs ask for their money back.

Every time:

   import polars as pl
   
   from polars import col, lit

I'd put you in the "relatively niche and senior" bucket without even thinking.

I wonder if the Python-to-Mojo overhead is significant enough where language-native bindings make more sense. I'd be interested in seeing some benchmarks.

Can't you just use Numpy directly in Mojo?

That's quite promising - https://www.modular.com/blog/modcon-announcements#:~:text=Wi...

The innovative potential of Mojo would be constrained to relatively niche and senior dev circles until they get a Windows release, which probably won't happen anytime soon. Python keeps the throne for now.

>As a person, unfortunately accursed with an ability to read Chekhov in original

I'd argue that this is one of the better gifts life has given me, don't be too harsh on yourself.

Thank God for the Brave browser. For those disliking their built-in adblocker, there is a Manifest v2 opt-out specifically for uBlock if you need it.

>Most stuff works pretty well in Europe

Bold thing to say.

t. European

Leaving money on the table is never easy.

I don't exactly see how these two statements are contradictory. Policy is about conflicting interests.

This goes to show that the assertion that cookie banners are just "malicious compliance" isn't quite correct. These are significant trade-offs here.

I am obviously referring to a scenario where tracking cookies would be highly beneficial to expanding the business, e.g. e-commerce.

>it's an example of malicious compliance

So how would you do ePrivacy Directive compliance/risk avoidance in a non-obnoxious way?