The regulations prescribed in §§ 154.04 and 154.05 shall not be construed to require the removal, lowering, or other change, or alteration, of any non-conforming use, or otherwise interfere with the continuance of any non-conforming use, except as otherwise provided in § 154.08(B).