Well... maybe you could go old-school and just put down a physical server in your local network which hosts the DB?

So basically you have the same setup as with your AWS instance, minus the network latency.

Everyone wants to go fancy and host everything in the cloud nowadays, but a local server for development can be very useful still!