No wall, building, structure or part thereof shall hereafter be built, enlarged or altered until a plan of the proposed work, together with a statement of the materials to be used, is submitted to the Building Inspector or other designated official, who shall, pursuant to this chapter, issue a permit for the proposed construction. Structures hereafter constructed or erected without a permit, or not in conformity with this chapter, shall be removed. No building shall be removed until a permit has been obtained from the Building Inspector or other designated official. The Building Inspector or other designated official shall not issue such a permit if, in his or her judgment, the proposed location of the building would seriously increase the fire hazard to the surrounding buildings.