Let's watch the terminology there. Every is "allowed" to vote. Show up at your assigned polling station with ID in hand and there is no problem 99.9999% of the time.
If you want/need an absentee ballot, you are accepting that the risk of error goes up. Your problem was administrative, no one was attempting to limit your right to vote.