A member of the Civil Service Commission or the City Planning Commission may be removed by the Mayor for neglect of duty, incapacity, incompetency, or malfeasance in office, but only after opportunity has been given for a public hearing before the Mayor, to be held at least ten (10) days after written charges have been made and notice thereof been given to the accused member. Such member shall be heard in person or by counsel; and the order of the Mayor on such removal shall be final.