If a building permit is refused by the Clerk of Building Permits, the applicant may appeal to the Board of Zoning Appeals for a public hearing. If the Board in their discretion believes a permit should be granted, the Building Permit Clerk shall be ordered to issue the permit.