I spent 2 years building soil before I planted the first tree. The soil I was starting with was compacted over farmed soy and corn field.
Patience is certainly a big part of it. I moved a rock the other day and saw a worm. It made me so happy!