Any nonconforming building or structure damaged more than fifty percent (50%) of its then fair market value, exclusive of foundations, shall not be restored or reconstructed, used or occupied as a nonconforming use. If such damage amounts to fifty percent (50%) or less of the fair market value, the nonconforming building or structure may be restored, provided such restoration shall begin within six months from the time of damage.