← Extractions

Orchestrating Video Transcoding in Ruby (wroclove.rb 2019)

Michal Matyas recounts building a video-transcoding pipeline for a Ruby/Rails media platform, describing the painful evolution from CarrierWave-plus-callbacks to multi-model-per-file to a simple top-to-bottom worker using ffmpeg. The talk delivers nine concrete tips on ffmpeg transcoding (copy streams, optimize for streaming, bring your own args, pick the right download strategy, use presets, pick H.264 profiles, force YUV 4:2:0, collect metadata, trust-but-verify outputs) and ends with a Q&A on ffmpeg vulnerabilities.

Model

claude-opus-4-7

Ingestion

3035c083

Input tokens

437,225

fresh: 337,352
cached: 92,865
cache write: 7,008

Output tokens

15,799

Duration

228.9s

Roundtrips

Tool calls

Cost

$0.00

Nodes/edges extracted

32 / 57

Read set (nodes/edges)

181 / 2

Nodes (32)

create Docker tool

kind (empty) → tool

name (empty) → Docker

slug (empty) → docker

attrs (empty) → {"category" => "platform"}

description (empty) → Container platform. Not used in the media platform project because, at the time, Docker was not yet popular and was n...

short_description (empty) → Container platform for packaging and running applications.

create YUV 4:2:0 concept

kind (empty) → concept

name (empty) → YUV 4:2:0

slug (empty) → yuv-4-2-0

attrs (empty) → {"category" => "format"}

description (empty) → Pixel format that should be used for web video because all browsers support it. Other pixel formats (e.g. YUV 4:2:2 p...

short_description (empty) → Chroma-subsampled pixel format universally supported by browsers.

create Apple QuickTime tool

kind (empty) → tool

name (empty) → Apple QuickTime

slug (empty) → apple-quicktime

attrs (empty) → {"category" => "platform"}

description (empty) → Apple media container and framework. The ISO base media format (and thus MP4) is derived from QuickTime. Referenced a...

short_description (empty) → Apple's media container, progenitor of the ISO base media format.

create H.264 concept

kind (empty) → concept

name (empty) → H.264

slug (empty) → h-264

attrs (empty) → {"category" => "codec"}

description (empty) → Video codec featuring named 'profiles' — sets of codec features with varying device support. Higher profiles yield sm...

short_description (empty) → Widely-supported video codec with profile-based feature sets.

create MP4 concept

kind (empty) → concept

name (empty) → MP4

slug (empty) → mp4

attrs (empty) → {"category" => "format"}

description (empty) → MPEG-4 Part 14 container format, based on the ISO base media format which itself derives from Apple's QuickTime. Not ...

short_description (empty) → Container format (MPEG-4 Part 14) wrapping video, audio, and metadata.

create WebM concept

kind (empty) → concept

name (empty) → WebM

slug (empty) → webm

attrs (empty) → {"category" => "format"}

description (empty) → Open container format that was historically required alongside MP4 for cross-browser playback. The talk's team origin...

short_description (empty) → Open web video container format, historically needed alongside MP4.

update Orchestrating video transcoding in ruby talk

description Talk at wroclove.rb 2019. → wroclove.rb 2019 talk by Michal Matyas (his 4th wroclove.rb, first time speaking). Originally titled 'Transcoding in ...

short_description Talk at wroclove.rb 2019. → wroclove.rb 2019 talk on building a Ruby/Rails video-transcoding pipeline with ffmpeg.

update Michal Matyas person

description Conference speaker. → Ruby developer; wroclove.rb 2019 speaker who gave 'Orchestrating video transcoding in ruby'. His 4th wroclove.rb atte...

short_description Conference speaker. → Ruby developer and wroclove.rb speaker.

create FFmpeg tool

kind (empty) → tool

name (empty) → FFmpeg

slug (empty) → ffmpeg

attrs (empty) → {"category" => "tool"}

description (empty) → Ubiquitous open-source command-line tool for video/audio transcoding and processing. Used as the transcoding engine t...

short_description (empty) → Command-line tool for transcoding and processing audio/video.

create streamio-ffmpeg tool

kind (empty) → tool

name (empty) → streamio-ffmpeg

slug (empty) → streamio-ffmpeg

attrs (empty) → {"category" => "library"}

description (empty) → Ruby gem wrapping the ffmpeg command line. Offers a custom DSL for transcoding, but the talk recommends ignoring the ...

short_description (empty) → Ruby wrapper around ffmpeg with a DSL and progress tracking.

create carrierwave-video tool

kind (empty) → tool

name (empty) → carrierwave-video

slug (empty) → carrierwave-video

attrs (empty) → {"category" => "library"}

description (empty) → CarrierWave extension that wraps ffmpeg to process video uploads. Used in the MVP and second iterations of the media ...

short_description (empty) → CarrierWave extension for transcoding videos with ffmpeg.

create carrierwave_backgrounder tool

kind (empty) → tool

name (empty) → carrierwave_backgrounder

slug (empty) → carrierwave_backgrounder

attrs (empty) → {"category" => "library"}

description (empty) → Companion gem that lets CarrierWave spawn background workers for processing instead of blocking uploads. Used in the ...

short_description (empty) → CarrierWave companion gem that moves processing to background workers.

create Sidekiq tool

kind (empty) → tool

name (empty) → Sidekiq

slug (empty) → sidekiq

attrs (empty) → {"category" => "library"}

description (empty) → Ruby background job framework. Used in the final rewrite of the media platform to run processing and upload workers o...

short_description (empty) → Ruby background job processor backed by Redis.

create AWS Lambda tool

kind (empty) → tool

name (empty) → AWS Lambda

slug (empty) → aws-lambda

attrs (empty) → {"category" => "service"}

description (empty) → Amazon's FaaS platform. Considered for video transcoding but rejected because of its 15-minute maximum execution time...

short_description (empty) → Amazon serverless function-as-a-service platform.

create Zencoder tool

kind (empty) → tool

name (empty) → Zencoder

slug (empty) → zencoder

attrs (empty) → {"category" => "service"}

description (empty) → Commercial hosted video transcoding service. Evaluated for the media platform but considered too expensive for the ex...

short_description (empty) → Hosted cloud video transcoding service.

create Amazon Elastic Transcoder tool

kind (empty) → tool

name (empty) → Amazon Elastic Transcoder

slug (empty) → amazon-elastic-transcoder

attrs (empty) → {"category" => "service"}

description (empty) → AWS-managed transcoding service. Rejected alongside Zencoder for cost reasons when building a proper media platform a...

short_description (empty) → AWS hosted media transcoding service.

create ffprobe tool

kind (empty) → tool

name (empty) → ffprobe

slug (empty) → ffprobe

attrs (empty) → {"category" => "tool"}

description (empty) → Companion tool shipped with FFmpeg that inspects and reports media file metadata. In some formats duration informatio...

short_description (empty) → FFmpeg companion tool that reports media file metadata.

create Avoid Active Record callbacks for media processing takeaway

kind (empty) → takeaway

name (empty) → Avoid Active Record callbacks for media processing

slug (empty) → avoid-active-record-callbacks-for-media-processing

attrs (empty) → {"type" => "lesson-learned"}

description (empty) → Callbacks make transcoding code hard to reason about and hard to isolate, slowly turning the codebase into a codepend...

short_description (empty) → Callbacks turn media processing code into a codependent mess.

create Avoid CarrierWave for non-trivial media processing takeaway

kind (empty) → takeaway

name (empty) → Avoid CarrierWave for non-trivial media processing

slug (empty) → avoid-carrierwave-for-non-trivial-media-processing

attrs (empty) → {"type" => "warning"}

description (empty) → CarrierWave (and CarrierWave versions/DSL) are fine for simple cases like resizing a thumbnail. For anything more com...

short_description (empty) → CarrierWave is fine for thumbnails but breaks down for complex video workflows.

create Prefer a simple top-to-bottom worker takeaway

kind (empty) → takeaway

name (empty) → Prefer a simple top-to-bottom worker

slug (empty) → prefer-a-simple-top-to-bottom-worker

attrs (empty) → {"type" => "recommendation"}

description (empty) → The simplest solution is often the best. The team avoided a lot of pain once they stopped doing things 'the Rails way...

short_description (empty) → A plain processing worker beats gem-slapping and Rails callbacks.

create Hindsight is 20/20 — don't judge past code takeaway

kind (empty) → takeaway

name (empty) → Hindsight is 20/20 — don't judge past code

slug (empty) → hindsight-is-20-20-don-t-judge-past-code

attrs (empty) → {"type" => "insight"}

description (empty) → It's easy to look at old code and ask how it ever shipped, but the knowledge and experience needed to do better are u...

short_description (empty) → Don't judge old code or other developers harshly; experience is earned over time.

create Copy streams when transcoding takeaway

kind (empty) → takeaway

name (empty) → Copy streams when transcoding

slug (empty) → copy-streams-when-transcoding

attrs (empty) → {"type" => "recommendation"}

description (empty) → When producing multiple variants of a video that share characteristics (e.g. identical audio across different resolut...

short_description (empty) → Copy unchanged streams (e.g. audio) across variants instead of re-encoding.

create Optimize MP4 for streaming with faststart takeaway

kind (empty) → takeaway

name (empty) → Optimize MP4 for streaming with faststart

slug (empty) → optimize-mp4-for-streaming-with-faststart

attrs (empty) → {"type" => "recommendation"}

description (empty) → By default ffmpeg writes MP4 metadata at the end of the file in a single pass. Use the movflags/faststart flags so ff...

short_description (empty) → Use ffmpeg flags that move MP4 metadata to the front of the file.

create Bring your own ffmpeg arguments takeaway

kind (empty) → takeaway

name (empty) → Bring your own ffmpeg arguments

slug (empty) → bring-your-own-ffmpeg-arguments

attrs (empty) → {"type" => "recommendation"}

description (empty) → Libraries like streamio-ffmpeg ship a DSL for transcoding, but the talk recommends ignoring it and passing custom ffm...

short_description (empty) → Bypass library DSLs and pass custom ffmpeg args for control.

create Download first vs transcode from URL is not universal takeaway

kind (empty) → takeaway

name (empty) → Download first vs transcode from URL is not universal

slug (empty) → download-first-vs-transcode-from-url-is-not-universal

attrs (empty) → {"type" => "warning"}

description (empty) → ffmpeg can transcode from a URL (downloading only what it needs), which is theoretically faster than download-then-tr...

short_description (empty) → URL-based ffmpeg transcoding can be 50× slower for some inputs.

create Use ffmpeg presets takeaway

kind (empty) → takeaway

name (empty) → Use ffmpeg presets

slug (empty) → use-ffmpeg-presets

attrs (empty) → {"type" => "recommendation"}

description (empty) → ffmpeg ships presets from ultrafast to ultraslow covering common configurations. Use fast presets for the lowest-reso...

short_description (empty) → Offload encoder tuning to ffmpeg's ultrafast…ultraslow presets.

create Pick the highest H.264 profile you can afford takeaway

kind (empty) → takeaway

name (empty) → Pick the highest H.264 profile you can afford

slug (empty) → pick-the-highest-h-264-profile-you-can-afford

attrs (empty) → {"type" => "recommendation"}

description (empty) → H.264 profiles are feature sets; higher profiles give smaller, better-looking videos but reduce device support. Pick ...

short_description (empty) → Higher H.264 profiles mean smaller/better videos but fewer compatible devices.

create Always output YUV 4:2:0 takeaway

kind (empty) → takeaway

name (empty) → Always output YUV 4:2:0

slug (empty) → always-output-yuv-4-2-0

attrs (empty) → {"type" => "recommendation"}

description (empty) → All browsers support the YUV 4:2:0 pixel format. Other pixel formats (e.g. YUV 4:2:2 coming from Apple QuickTime hand...

short_description (empty) → Force YUV 4:2:0 so every browser plays the video.

create Collect as much video metadata as you can takeaway

kind (empty) → takeaway

name (empty) → Collect as much video metadata as you can

slug (empty) → collect-as-much-video-metadata-as-you-can

attrs (empty) → {"type" => "recommendation"}

description (empty) → Persist every scrap of metadata you can get from both input videos and every output variant. This makes it possible t...

short_description (empty) → Grab metadata from every input and output to enable cross-analysis.

create Trust but verify ffmpeg output takeaway

kind (empty) → takeaway

name (empty) → Trust but verify ffmpeg output

slug (empty) → trust-but-verify-ffmpeg-output

attrs (empty) → {"type" => "recommendation"}

description (empty) → ffmpeg can report success while producing a cut/incomplete file that is still technically valid. Validate outputs — f...

short_description (empty) → ffmpeg can lie; validate output files (but beware ffprobe duration guesses).

create Isolate ffmpeg due to its vulnerability history takeaway

kind (empty) → takeaway

name (empty) → Isolate ffmpeg due to its vulnerability history

slug (empty) → isolate-ffmpeg-due-to-its-vulnerability-history

attrs (empty) → {"type" => "recommendation"}

description (empty) → ffmpeg has a documented history of vulnerabilities that can compromise the host server. When rebuilding the system to...

short_description (empty) → Sandbox ffmpeg because it has had server-compromising CVEs.

create Protecting against ffmpeg vulnerabilities question

kind (empty) → question

name (empty) → Protecting against ffmpeg vulnerabilities

slug (empty) → protecting-against-ffmpeg-vulnerabilities

attrs (empty) → {"answer_summary" => "They didn't at the time (trusted input); today he would sandbox ffmpeg and deny it access to th...

description (empty) → Audience question after the talk: how did/would the speaker protect the system against ffmpeg vulnerabilities? Answer...

short_description (empty) → How do you protect against vulnerabilities in ffmpeg?

Edges (57)

create Michal Matyas → uses → Amazon S3

context (empty) → Final pipeline uploaded all derivatives to S3.

relation (empty) → uses

source_node_id (empty) → 4a70c303-c4d2-4d05-ae5c-b9c6dcb647aa

target_node_id (empty) → 594c0c6b-0a58-4e01-91ef-f4185be0190f

create Michal Matyas → uses → CarrierWave

context (empty) → Used CarrierWave (and carrierwave-video/backgrounder) in early iterations.

relation (empty) → uses

source_node_id (empty) → 4a70c303-c4d2-4d05-ae5c-b9c6dcb647aa

target_node_id (empty) → e67c4ddf-6686-464e-a1f7-e6eb5823e969

create MP4 → related_to → Apple QuickTime

context (empty) → MP4 is based on the ISO base media format, which derives from QuickTime.

relation (empty) → related_to

source_node_id (empty) → 1dafa315-659a-4835-ab37-a527881d0a92

target_node_id (empty) → 7ba408af-4c30-4d3f-9fd4-d3daff12b1c2

update Michal Matyas → authored → Orchestrating video transcoding in ruby

context (empty) → Speaker and author of the wroclove.rb 2019 talk.

update Orchestrating video transcoding in ruby → presented_at → wroclove.rb 2019

context (empty) → Delivered at wroclove.rb 2019.

create Michal Matyas → attended → wroclove.rb 2019

context (empty) → Speaker at the 2019 edition; his 4th wroclove.rb overall.

relation (empty) → attended

source_node_id (empty) → 4a70c303-c4d2-4d05-ae5c-b9c6dcb647aa

target_node_id (empty) → 8bcc988a-785d-4dfa-a063-1daa7ba349c0

create Orchestrating video transcoding in ruby → about → FFmpeg

context (empty) → The pipeline uses ffmpeg as the transcoding engine; most tips are ffmpeg-specific.

relation (empty) → about