Each ward shall constitute an election precinct and the Common Council shall establish a voting place in each, and the election of councilmen shall be by wards. No voter shall be entitled to vote at any Town election except in the ward in which he resides, and if any voter shall vote for any person for Common Council who is not a resident of the ward in which he voted, such vote or votes shall not be counted for such person or persons.