The applicant shall post with the Clerk a penal bond in the minimum sum of five thousand dollars ($5,000.00) issued by a surety company authorized to issue such bonds in the State. The bond shall guarantee the permittee’s payment for any damage done to the City or to public property, and payment of all costs incurred by the City in the course of moving the building or structure.