Some clients have a local relay so the notes might still show up for you until you clear the cache. You can use nak to verify if other relays are still serving the events.