If a User doesn't have a high enough reputation to give or remove any points from you, then their rating just shows up as a grey box and it doesn't change your Rep Points rating, but...

If that same User then gets a high enough reputation themself to start to change other people's reputation with their ratings - do the ratings they've given you previously then make a difference?

In other words: Does the rating system work retrospectively when a user become able to influence other's ratings, and points they've given that didn't do anything to your rep score then start to change your rep score now, no matter how long ago that particular rating was given?