The department shall retain money so paid until twelve days after it shall be made to appear to it or some proper officer thereof, by satisfactory affidavit, that the party or parties, or his, her or their agent for the collection of any such rent or compensation, who, but for the provisions hereof would have been entitled to receive the same, has had written notice of such payment being made; and if at the end of such twelve days such party or parties, so notified, have not instituted suit to recover such money, then it shall, by the department be paid to the commissioner of finance.