Twitter solved this resource problem easily, their closed source client and their single central relay is usually very fast..but it does need a database.😉