The protocol uses channel IDs and generated keys that are visible to the servers. Those can be used to track you around. Especially if both users use the same server, which is common for the default setting of the app.