It could be a bug. It could be a DM from someone you've muted & is hidden from you, but it is still showing the notification. Who knows? 🤷

Mark all as read will usually clear the notification