It's possible that they don't like you due to your complaining about little things (neg rep, ect)
But why should you care what people think of you here? I know I wouldn't care if someone told me they don't like me on this site. If anything, it'd add to my ego.