If a user has less than 10 reputation points (i.e. is a n00b or on any level lower), they CANNOT actually alter your reputation. Their comment, whether intended to be good or bad, will be accompanied by a grey box, meaning they've given 0 points to you... or taken 0 points away, if that is the case.