VPS is a virtual private server, or a tiny cloud, 1 or 2 CPUs and RAM.  Then you can host services like your website, your email, your files on the cloud, your private messengers such as Matrix or XMPP.  So then you are in control 

 Thanks for the clarification. I wondered if you meant hosting directly on vps (cloud) or hosting on own hardware.