I feel the same way. Major cities overwhelm me. The same energy that makes me more alert and active also prevents me from focusing on doing deep work/thinking. The biggest benefit is the much larger pool of people to meet and talk to, specially when one has more niche interests. I think the best balance is to live in a secondary city and visit a nearby major city for a couple days straight every month or so.