There shall be no limitation of height, except that any building or structure shall be set back from a required yard line one foot for each foot of building or structure height above thirty-five feet where such required yard is contiguous to or across the street from a residential zoning district. (See Chapter 1161 for height exceptions.)