I think what you’re leaning towards is dynamic trust scores based on content not user. But, this just ultimately boils down to a user score. If people like your content and don’t forget to label it, it would just add to your credibility or subtract from it.
A content score doesn't "boil down" by itself to a user score. Users or clients who want a simpler WoT can boil it down and lose some precision in their modeling, but settling for less granularity across the board seems retarded in the literal sense