In any proceeding for accounting under this chapter, there may be joined originally or by amendment, either before or after appeal, all such officers, depositories, banks, and securities on bonds of any of them as shall be necessary or proper for the full determination of any matter in controversy, and especially, but without limiting the generality of the foregoing, for determining the respective liabilities as between an officer and some other officer, between an officer and a bank or depository, between them or any of them and the sureties of any of them, or between sureties of any of them. The proper authority or any court which shall have acquired jurisdiction in any proceeding for accounting by appeal or otherwise shall have the jurisdiction to determine completely the respective liabilities of the parties as among themselves, as well as the liability of any officer, bank, or depository and the sureties, to the public body or bodies involved. The jurisdiction given in this chapter shall extend not only to the compelling of an officer and his sureties to account for taxes or other public money which he has in fact collected, but for money which it was his duty to collect and which, in the exercise of good faith and ordinary diligence, he should have collected; and such jurisdiction may be exercised against any public officer who has received or collected the money of any public body, whether or not it was a part of his official duty to receive it or collect it.