Your example is faulty.
> I'd ask you if this set intersected with [0, 1] has a lower bound / 'inf' that's contained in it, and if so, did I just describe that lower bound with language?
The "indescribable numbers" are dense in [0,1], and so (if the set exists) the inf of the set of indescribable numbers which are between 0 and 1 is 0. Perfectly describable.