Currently, when gossip is enabled, are used all relays in user lists (there isn't a relays score at the moment). This will be improved in the next versions where will be kept a relays and gossip state into the database.

But anyway, it's weird that it require hours to complete. Can you share a code example?