No person, except a peace officer shall wear or in any manner carry concealed upon their person, any loaded or unloaded gun, pistol or revolver, or any other dangerous or deadly weapon permitted to be carried by law without having, at the same time, actually in their possession, and upon them an unexpired permit so to do issued by the Board of Police Commissioners.