acstorage

We developed Accelerated Cloud Storage to offer an object storage system with high performance (up to 10X better than S3 Express One Zone in latency and throughput) and global availability that scales and moves data based on demand. The service is accessible through an S3 compatible Go/Python SDK. ACS has enterprise-grade security compliance (SOC 2 Type 2 pending), and a transparent pay-for-usage pricing model with no egress fees.

You can sign-up on the website or schedule a call with one of our engineers to discuss further.

You can bring data in and out of the GPU quickly and improve utilization.

One is speed, ACS provides up to 5X better performance (latency/throughput) than S3 Express One Zone. We have benchmarks repo here: https://github.com/Accelerated-Cloud-Storage/Benchmarks. Please let me know if you have any questions on this.

Another aspect of this is that ACS buckets are modeled on the traditional S3 bucket structure not the directory buckets of S3 Express One Zone. ACS buckets are not stored in only one availability zone and can be accessed in a performant manner from a region different than the region/az of bucket creation.

One difference is the engineering effort for integration. If an SWE was using Redis they would have to create custom polices on when to move the data between S3 and Redis, how to store it, for how long and when to move newly written data back to S3. This can impose a significant amount of engineering effort for a team. Redis is also mostly single-threaded whereas ACS is designed from the ground up to be multi-threaded.

Another difference is the interface. ACS is accessible through an S3 compatible Python/Go SDK or a high-performance FUSE mount for a POSIX-like file system interface. With Redis, you would still have to build an interface around it for other engineering teams or customers to use.