It shouldn't really make a difference.

The people voting that it matters I'm willing to bet are all younger, when 1-3 years difference is a pretty big deal as far as maturity, etc. As a person ages, the difference in, say, 5 years doesn't mean as much.