Seems to me it should be safer to block the cycle lane to avoid having traffic pass on the right, so you really only have to monitor in front and to the side when making the turn. Cyclists behind will then simply either have to adjust their speed, or decide whether to cross into the car lane and overtake on the left.
This thread made me realize I don’t actually know the rules for this here in Sweden. I’ve inquired with traffic authorities, because unfortunately when searching on their site for cycle lane rules you only find a picture of what cycle lanes look like. :o(