Yeah, I looked up the method and agree that if most of your tables are small, it's worth those simple ifs.
I only meant to store it in addition because the alternative, storing an index into the list of divisors (and thus reciprocals) might be slower due to an extra indirection.