Damn, you're way deep on this rabbit hole.
yeah... I really liked woit's QM book which goes into the group theory of quantum information. a lot of this started to make more sense once I learned the language of symmetry and its relation to particles. "Quantum information science" was also a nice hands-on engineering approach to learning and building quantum algorithms. https://www.math.columbia.edu/~woit/QM/qmbook.pdf