If you murder someone, it is your fault. If you rape someone, it is your fault. There is no other interpretation. You are solely responsible for your actions. No one, no matter what they wear or look like to you can drive you to commit a violent act against them. No matter how provoked you feel, that doesn’t make it ok or somehow more excusable for you to harm another person.
Why is this an issue? Why does that even need to be clarified?