Yes it take some time to build a circuit but hidden services will always be slower even afterwards since there are not only your hops but also the hidden services ones.