Ok, let’s try extreme analogies.
Let’s say I am hanging around actively arranging plans to murder my neighbors for fun. In the middle of this, I decide I would like to have some sex. I find an amenable person and am talking to them as we walk to my home. However, during this conversation it happens to come up that they think murdering people for fun is bad. This makes me not want to have sex with them anymore, so I don’t.
I get to do that!
The thing I am doing wrong in this situation is ‘arranging plans to murder my neighbors’. This is bad. I shouldn’t do that. I can in fact legitimately be arrested for it. (As far as I remember law things). It does not mean I should experience rape, because literally nothing of the sort means that.
I can be doing something bad, which I shouldn’t do, and decide not to have sex with someone for a reason entirely stemming from that fact, and I still get to not have sex with them, because I always get to not have sex with people for any or no reason.
The bad thing I am doing is bad, and I still get to not sleep with people when I don’t want to.