Any person or organization denied a permit, or whose permit is revoked, or is required to pay a fee for a permit shall have the right to appeal such denial, revocation or demand for a fee to the council. Such appeal shall be filed with the town clerk within ten days of such denial, revocation or demand.