We already have this today in a way, only a few people have commit access to Bitcoin core repo. Have they done any harm so far? No. 
You're over thinking my proposal way too much. Every software project on the planet is lead by a set of people or a foundation. It's a natural thing to do, in Bitcoin's case it's still technically core devs but they have much less power in the sense that they're too scared to make any bold decision. 
All I'm saying is, we raise the pool of people who can be the "core" and then start enforcing better rules. 
All the code is public anyway, they cannot go do insane things like changing supply cap to 42m from 21m. It's all public.