Nothing in this Ordinance shall be deemed to require any change in the plans, construction, or designated use of any building upon which actual construction was lawfully begun prior to the adoption of this Ordinance, and upon which building actual construction has been diligently carried on, and provided, further, that such building was completed within two years from the date of passage and publication of this Ordinance.