People use the words web and internet interchangeably. Nostr uses the web in the sense that it runs over the http protocol, but it is not necessarily the web, and it will expand beyond it for example it does not rely on https for its security, and it may (it needs to) move beyond DNS.