Down votes are not violence. No one is forced to do anything, your metaphors are all over the place. We vote against the highest self voters, and we don't even fully counter further self votes, we only down vote to 85%.

Everyone is free to vote as you say, recognize that works both ways.