Fiat is backed by banks collecting debt in conjunction with courts and the sheriff. Its basic contract law, just like any other agreement.
Mind you, under this system, what if the sheriff decides to take out loans on behalf of the people he polices, then he collects "taxes" to pay the interest because "it's for the common good"? This is what #bitcoin fixes.