Making PyPI's test suite 81% faster

blog.trailofbits.com

11 pointswoodruffw2 comments

Great post! Regarding the database, would the fixture possibly benefit from creating a single database in postgres, and then making copies of it for each worker using https://www.postgresql.org/docs/current/manage-ag-templatedb...? Then it doesn't need to run the migration lots of times. Possibly even faster than the squashed migration?

Excellent idea, and something I tried a little while back. The `pytest-postgresql` plugin used has the ability to do this natively, but when we tried it out we found that we had other issues with developing on a Linux machine.

Attempt: https://github.com/pypi/warehouse/pull/15365

Revert: https://github.com/pypi/warehouse/pull/15444

If you've got experience with making this kind of thing work on Linux development machines, it'd be great to have some help getting that back.

Reply on news.ycombinator.com