It may be the number of follows. Anything over 2000 follows creates a very large filter for relays and many are now blocking the request.