Create a playlist, feed playlist to yt-dlp, --extract-audio, wait, done
This is the way. And I was about to suggest this very thing.