You should check out this book called The Blocksize Wars - it will give you a whole history of why small blocks are preferable. If you don’t have time for that the HBO documentary on Bitcoin is supposed to have a section dedicated to describing this time in Bitcoin history (small vs large blocks). 
Yes, not everyone cares about privacy on the surface; ask them to put a camera in there bathroom and everyone changes their toon.