I used nak to pull down all of the events on a relay from a particular npub, then I broke it up into 100-event chunks, published a kind 05 for each of those chunks, and then broadcasted the kind 05 to the whole list. 

 Some clients have a local relay so the notes might still show up for you until you clear the cache. You can use nak to verify if other relays are still serving the events.