It is unlawful for any person to deface or injure any grave, vault, tombstone, or monument or any building, fence, tree, shrub, flower or anything belonging to a cemetery, or to dig any grave therein, or interfere with any grave, lot, street or alley therein, without the permission of the Mayor or City Administrator.