Do people like invaders?

I've seen people who hate being invaded and some who seem to like it. I personally don't enjoy invading if it's going to annoy someone. I know different people enjoy different things, but in general what is your opinion on being invaded?