That's the problem, nobody is going to test the new software unless they have to, it will sit unused until the end of the pilot period as long as the old software is available too. Those people are no cs nerds who like testing new software, they are office people and learning new tools is stressful for (most of) them. I have been there.