All this time, the agency is taking a % cut for providing the original cleaner. After that, the additional value they add is zero.
So yes, it may be unethical to disintermediate the agency, but by this time you have been working with the cleaner for weeks/months, so you get a fairly good idea as to what sort of person they are.