HNHacker News
TopNewBestAskShowJobs

zzsheng

33 karma · joined November 2, 2024

submissionscomments
zzsheng··on Removing fsync from our local storage engine
we manage memory instead of relying on page cache
zzsheng··on Removing fsync from our local storage engine
sorry, typo. data will *not* be lost.
zzsheng··on Removing fsync from our local storage engine
check s3 express one zone
zzsheng··on Removing fsync from our local storage engine
journal file was pre-alloacated and we use direct-io for journal write so no need to call fsync.
zzsheng··on Removing fsync from our local storage engine
nop. we will not ack any write which is not in data or journal. please check the put details in the blog.
zzsheng··on Removing fsync from our local storage engine
actually both crash consistentcy and durability. after we ack, we make sure data will be lost due to crash, restart or power loss.
zzsheng··on Removing fsync from our local storage engine
we also use direct-io for reads.
zzsheng··on Removing fsync from our local storage engine
thanks for feedback. actually it was pointed out in blog that we do not use append only log to avoid fsync due to size change. what we use is preallocate fixed size log file and we do write journal data and space reclaim by 4KB unit, also with direct-io.
zzsheng··on Removing fsync from our local storage engine
Author here. This is not a general argument against fsync; the design depends on SSD-only deployment, preallocated files, O_DIRECT, single-key atomicity, and device write guarantees.