No person, except a peace officer shall wear or in any manner carry concealed upon his person, any loaded or unloaded gun, pistol or revolver, or any other dangerous or deadly weapon permitted to be carried by law without having, at the same time, actually in his possession, and upon his person an unexpired permit so to do issued by the Board of Police Commissioners.