I can be rather offended by actions towards me or a lady near me (chivalry, what can I say?) but if it's just a stoner or a drunk I tend to ignore it
My school is rather loose with the racism being offensive. One of the black guys always takes my hat and pretends to use it as a condom, call me whitey etc., and I call him Kanye, and we both "lol" afterwards