Much harder to build in a performant way, but technically possible using the `difference` operator. You just might download the universe if you're not careful. 

 That's a fair point. Would almost need to require anyone using a negative prompt like that to choose at least one additional limiting factor.