Caffeine is very soluble. You can quickly decaffenate tea by "rinsing" it, or more accurately, throwing away the first, short, steeping.
In other words, if you want to remove the caffeine, leave your teabag in 1/2 a cup of water for 30-60 seconds, dump out the water and then you are good to go.