Any sign altered, placed or erected after the effective date of this chapter for which a permit has not been issued, shall be removed by the owner or person, firm or corporation having control thereof immediately upon receipt of written notice sent by certified mail by the Zoning Inspector. If such party fails to remove the same within five days thereafter, the same may be removed at the direction of the Inspector at the expense of such owner or person, firm or corporation having control thereof.