Whenever this chapter or an agreement shall set forth any time for an act to be performed by or on behalf of the grantee, the time shall be deemed of the essence and any failure of the grantee to perform within the time allotted shall always be sufficient grounds for the town to invoke an appropriate penalty including possible revocation of the franchise.