To avoid undue hardship, nothing in this title shall be deemed to require a change in the plans, construction or designated use of any building on which actual construction was lawfully begun prior to the effective date hereof and upon which actual building construction has been carried on diligently. (Ord. 40, 10-1978, rev. 9-1980)