Using them as data points in a personal algorithm to build up a subjective worldview about many accounts and many contexts, taking in other data points as well. 

Not "using a house to build a house", using numbers to build other numbers. AKA "math". 
(Or if you prefer your strange analogy context "using rooms to build a house")