https://sohilladhani.com/blog/tags/distributed-processing/Recent content in Distributed-Processing on Sohil Ladhani BlogHugoen-usMon, 16 Mar 2026 00:00:00 +0000https://sohilladhani.com/blog/post/2026-03-16-transcoding-pipelines/Mon, 16 Mar 2026 00:00:00 +0000https://sohilladhani.com/blog/post/2026-03-16-transcoding-pipelines/A user uploads a 4K video. Your system needs to produce: 4 resolution variants, 3 audio codec versions, thumbnails at 10-second intervals, and subtitle extraction. That’s not one job. That’s a directed acyclic graph of dependent tasks. The Pipeline as a DAG Transcoding isn’t a linear process. Some steps depend on others. Some can run in parallel. graph TD U["Upload: raw video"] --> V["Validate format"] V --> S["Split into segments"] S --> T1["