Yes, the VPS is paid for anonymously via prepaid debit card and is tied to an anonymous email account.

The primary problem in both situations is that the VPN endpoint knows your real origination IP address. With a dedicated VPS that isn't being shared with a large number of people doing naughty things, you're far less likely to draw scrutiny from authorities.