No penalty imposed by and pursuant to this title shall interfere with the right of the city also to apply to the proper courts of the state for a mandamus, an injunction or other appropriate action against such person, firm or corporation. (2015 Code § 5-1004)