It’s just feasible now on commodity GPUs (mid-range gaming ones) to perform semantic analysis and retrieval of documents using a persistent vector database. 

Where this is gaining traction right now is businesses (and individuals) semantically indexing their own private document stores, to be able to search and retrieve on them in a similar way to how Internet search engines do the public Internet on a much larger scale.

A decentralized version of this is conceivable in concept, but there are all the usual issues of trust, authentication, data integrity, etc. that arise in the context of multi-agent systems with bad actors.