user voting reset

I'm making a user voting system, I'm thinking if I should allow the user to take back their up vote or down vote.

Obvious reasons for allowing users to do that would be because they changed their opinion.

Any other reasons I should consider to sway me to either allow or disallow?