How important is touch for you?
I hate being touched unless I'm being intimate/in a relationship. Even in a relationship, there is a time and place for everything.
What can I say..... I'm weird.
There is a reason behind it I suppose. And it doesn't mean you are weird.
I have a very similar experience.