Whoever moves any building upon and over the streets, alleys, avenues and public grounds of the City without having first obtained a permit to do so from the Mayor, and without having deposited the fee and bond as provided, shall be fined not more than one hundred dollars ($100.00) for each offense.