Upon receipt of such application for a license, accompanied by the proper fee, if approval by another officer or department is not required, the Clerk-Treasurer, by and with the written approval of the Mayor, or other chief administrative officer, shall forthwith deposit the fee in the treasury and issue to the applicant a proper license certificate signed by the Clerk-Treasurer and Mayor, or other chief administrative officer. If for any reason the license is not issued, this fee less $5 to cover expenses of considering such application, shall be returned to the applicant.