"these microseconds add up to real latency"

While I love Ruby, if performance is your main motiviation, you would not be using a scripting language.