Yeah, it is heart-breaking to think that there could be technologically better solutions available which unfortunately bite the dust due to lack of adoption. Your point about "no-one has it figured out" makes me wonder if that is partly down to barking up the wrong tree! (e.g. ever more convoluted layers built on a fundamentally slow and expensive base layer.)