Hacker News Reader

Comment by mattashii | Hacker News Reader

That seems strange, the only incompatibilities between major versions are generally only the catalogs.

I don't remember any version whose storage format is cannot be read by the next versions (none since 2010). Could you add some more info what issues you had?

View on HN

In not the person you've responded to but I've never been able to get `pg_dump -Fc` and restore to work across versions. It always errors out for me, saying it's an invalid/broken backup. Super annoying because now the workflow is 1. Start old version just to restore, remove old version and start new version for upgrade.

You need to use pg_dump from the new version, not from the old version.

I think you found a common stumbling block. The tutorial people follow may say to run pg_dump and many people would assume you're running it from the old version.

Wait, what? Explain please.

OK upon further thought, what you're saying is to use the pg_dump tool that comes with the pg version you are upgrading to.

I read it as "use pg_dump instead of pg_restore"...

Yes. Put concisely: Use the client tools from the newest version involved for all steps.

Isn't that impractical for most Linux distros? You'd need to manually install the new client.

Probably? Certainly if you rely on distro packaging for it, yes.

I was just trying to simplify the guidance here. :)

On Debian (and probably most of its derivatives), the package manager will not remove any running PostgreSQL versions and will let you have multiple versions side by side. It also has its own tool pg_upgradecluster, which can perform the upgrade using pg_dump+pg_restore or pg_upgrade (optionally with link or clone options).

Yes, and usually, it means you need to use the full binary path unfortunately (because debian wrappers embedded in the package select the version from your 5432 cluster).

I've used dumps as backups and never experienced this issue, although they would stop prematurely from time to time. The solution was just to check the string at the end and repeat the dump if it wasn't there.

Considering that -Fc is a binary format, how would i check a string at the end of it?

If you do an SQL dump, it will end with "-- PostgreSQL database dump complete".

If you use -Fc, you can make an SQL file from the dump using pg_restore like this:

  pg_restore -f db.sql db.dmp

Or straight to stdout like this:

  pg_restore -f - db.dmp | grep "database dump complete"

Although I guess if it's corrupted pg_restore won't work.

It is really fast, but might not be practical if your database is too big.

My issue was indeed the mishmash of versions, as the restore succeeded with the mentioned steps (installing old version, restoring, upgrading).

nonetheless, interesting way to validate a backup, though it would probably take too long on most dumps

Reply on news.ycombinator.com