Guy uncomfortable when I look at him?

Roommates and I had a bunch of friends over. One of them, who is very difficult to read and has a snarky sense of humor, was talking to a friend and I. I was pretty stoned and when I smile while stoned it looks a bit "", my lids are half open and I have a wider-than-usual grin on. Anyway, he tells me to stop looking at him like that because it was making him uncomfortable (he said this with an awkward grin). I thought it was pretty rude, what do you think?