The Director of Finance or other officer of the city designated by the City Manager shall keep, or cause to be kept, for and on behalf of the city a complete bond registry and books showing all bonds, warrants and certificates of indebtedness issued, the date and amount thereof, the rate of interest, maturity and other information pertinent thereto, of all bonds or other indebtedness surrendered and all other transactions of the Council having reference to the refunding of the indebtedness surrendered and all other transactions of the Council having reference to the refunding of the indebtedness of said city. When bonds or their coupons are paid, their payment or cancellation shall be noted in said registry. The books shall be safely kept among the records of the city.