It shall be unlawful for any person to violate any of the provisions of this chapter or the fire prevention code hereby adopted, or fail to comply therewith, or violate or fail to comply with any order made thereunder; or building in violation of any detailed statement of specifications or plans submitted and approved thereunder, or any certificate or permit issued thereunder, and from which no appeal has been taken or fail to comply with such order as affirmed or modified by the governing body of the municipality or by a court of competent jurisdiction, within the time fixed herein. The application of a penalty under the general penalty clause for the city code shall not be held to prevent the enforced removal of prohibited conditions.