The Civil Service Commission shall also provide by rule for the hearing of appeals from the action of any officer in any case of reduction, removal, or in the giving and grading of competitive examinations. In addition to making its own rules, the Board shall have the power to choose its own officers and to subpoena witnesses and to require the production of records. The decision rendered by the Civil Service Commission in the hearing of an appeal shall be final.