The lesson of Google is, 
NEVER jump on board with the centralized corporation just because it’s “convenient”.

It will ALWAYS come back to bite you in the ass, and put you under a boot. 

Imagine if the community built crawlers and indexers had continued to grow from then until now. 

If you are stupid enough to think mega corporations are a feature of a free market, you will always end up a slave.