Hacker News Reader

You should provide more info regarding your environment. If you're running this in public cloud tell us which one. Every provider has native several queue services for different needs and makes things easier to work with and worry less about setting things up.

View on HN

For workers we run only Java and run everything on AWS. We have an existing production system that uses a combination of SQS, DynamoDB, and Postgres, and EC2s to achieve something very similar to this. Just want to check all the boxes before we dive into building out something for a new system coming into production that shares many of the same requirements.

SQS-FIFO should let you process task once & only once. Just make sure you configure timing parameters correctly.

DynamoDB has triggers that get fired upon changes. That would strongly help with eventual consistency implementation (which i strongly recommend). But with this you should write Lambdas. Check how well is Lambda Java supported.

Are you sure you want to use EC2 directly? Why not to use ECS? This would let you focus more on the business and less on infrastructure

Reply on news.ycombinator.com