Hold your breath. I've done that with a fingertip pulse oximeter I have.
Actually I just tried it and yeah for me at least the full-lungs version is obviously longer but takes less discomfort for my SpO2 to start to drop (like well before contractions start), whereas on exhale I get more discomfort (around 15s before contractions) before a similar drop.