Up, Over, or Down?

WARNING - This post is not triathlon related. Scary, I know, but I bet you can deal with it.
Living in Tex-ass, I usually tell foreigners people in other places to "come down" when they visit. This is because they are usually above me on a north-oriented map. I was just emailing a guy in San Antonio about coming down and realized he actually lives slightly below and to the west of me, lattitudenally. To be geographically correct, I went back and changed my wording to "come over" instead. Yes, I'm a geogeek.
Do you take the other person's planetary position in account when asking them to come over, down, or up? What do you say?

