Oddbean new post about | logout
▲ ▼
semisol | 3 months ago (raw) | root | parent | reply | flag 
 Multi-file upload is a hard one
▲ ▼
jb55 | 3 months ago (raw) | root | parent | reply | flag +1 
 Tar uploads 😅
▲ ▼
jb55 | 3 months ago (raw) | root | parent | reply | flag 
 We would probably want to start uploading right away though, so probably a bad approach
▲ ▼
semisol | 3 months ago (raw) | root | parent | reply | flag 
 Tar is a streaming format.

But why not multiple parallel requests
▲ ▼
jb55 | 3 months ago (raw) | root | parent | reply | flag +1 
 From what I can tell this is no standard protocol for HLS uploads. Maybe we should spec that 🤔 this would save the media hosts from having to do all the transcoding.

I’m actually surprised there isn’t anything like this already.
▲ ▼
chad | 3 months ago (raw) | root | parent | reply | flag +1 
 Kinda related - Twitch is starting to push local transcoding for streamers.

https://blog.twitch.tv/en/2024/01/08/introducing-the-enhanced-broadcasting-beta/
▲ ▼
jb55 | 3 months ago (raw) | root | parent | reply | flag 
 I was googling this and couldn't find anything. interesting! thank you.
▲ ▼
The Fishcake🐶🐾 | 3 months ago (raw) | root | parent | reply | flag +1 
 I think it’ll be easier for all of us if you just uploaded a semi-optimized media and media host do all the VBR transcoding and packaging for distribution. While transcoding is ongoing, we can serve the initially uploaded video, and the redirect to m3u8 manifest when it’s done 🐶🐾🫡
▲ ▼
semisol | 3 months ago (raw) | root | parent | reply | flag +1 
 the m3u8 could be dynamically updated with transcoded parts and the rest just referring to the original file, no?
▲ ▼
jb55 | 3 months ago (raw) | root | parent | reply | flag 
 that would be interesting. imagine doing a really quick initial upload using the lowest quality, then higher quality versions could be uploaded in the background *after* the note as been posted.
▲ ▼
ben | 3 months ago (raw) | root | parent | reply | flag 
 I see no reason this couldn’t work. m3u8 is just a metadata file pointing to other files.
▲ ▼
The Fishcake🐶🐾 | 3 months ago (raw) | root | parent | reply | flag 
 Yes 🐶🐾🫡
▲ ▼
jb55 | 3 months ago (raw) | root | parent | reply | flag 
 that works for me too, I was just trying to help the process since I don't think the redirect is working yet right? cloud transcoding pipelines are complex and I was just trying to make it easier for hosts by pushing all the compute to the edge.