It could be wasteful if hooked up to the whole house, but it's unlikely an under-sink reverse osmosis system will have a meaningful impact on your water consumption. Accurately identifying where to implement it matters.
If you have hard water, I suggest a whole-house water softener and reserve reverse osmosis for the kitchen.
Re: remineralization. Ick, I just skip these. They taste awful to me.