For clearnet IPv6, that could be an issue.  But just as with IPv4 - use a VPN if you want to obscure your IP.  The Linux IP6 stack will listen on a stable IP, but make outgoing connections on a random one that changes periodically.   So at least that obscures which machine on the LAN is making to connection.