That is literally exactly what it means. Back to the books.
I'm sure you'd have no problem if I walked into your house while you and your wife are eating dinner, grope her, eat your food, then leave, or maybe stay..depends on how good the fung shui of your joint is. I mean I wasn't invited so I am obviously not invading..
It's actually not exactly what it means. Just as killing someone is not necessarily murder, being on someone's property uninvited is not necessarily invading and/or violating their property right.
Property rights are claim-rights; claim-rights have correlative duties. That is, if someone has a legitimate claim-right, others have a legitimate duty to refrain. Yet, duties have stringencies; i.e., there exist priority of duties, so some duties do not hold if higher duties compete with them. Private property rights have correlative duties that are quite stringent, yet not absolute; public property rights have correlative duties that have very weak stringency.
Here's an example of where my entering your house uninvited would neither be invading nor violating your private property right: I'm coming home late at night, I walk by your house and see all the lights are off, presumably everyone is asleep. Yet, I also notice a lot of smoke and some flicker of flames through on of the lower floor windows.
Here I not only do not have a duty to not break your door down and enter your house uninvited, but I have a duty to break down your door and enter your house uninvited in order to save you, so long as I think it reasonable to believe that I can succeed in doing so.
Thus, being on someone's private property uninvited cannot be seen as necessarily entailing invading or violating any right; however, if you want to hold on to the term 'invade', well, now it loses any and all moral grip you want it to possess.
You might want to move away from your unreflective 'common sense' near-sighted view of the world and reflect on the concepts you employ to sort out the vast intricacies involved in what, on the surface, appear to be simple moral terms such as property, rights, duties, etc.
Oh, and try to avoid thinking that just because I used an example in which your life was going to be saved that the only justifying reason for entering someone else's property without an invite is to save that person's life. I used the example to clearly demonstrate the disconnect in your thought. I did not use it because it is the only example that shows such a disconnect.
Anyway, it's my birthday, and I'm going to start making some carnitas so they are ready by the time the guests arrive and the game starts (I have at least 2 friends...maybe as many as 3).