How to Set Up Custom FFmpeg in OBS Studio

Setting up custom FFmpeg output in OBS Studio allows content creators to utilize advanced encoding formats and container options beyond the standard presets. This guide provides a direct, step-by-step walkthrough on how to enable the advanced output mode, select the custom FFmpeg recorder, and configure your video and audio settings for tailored high-quality recording.

Step 1: Access the Advanced Output Settings

To begin, launch OBS Studio and open the settings menu.

  1. Click on Settings in the bottom-right Controls dock, or go to File > Settings in the top menu.
  2. Select the Output tab from the left sidebar.
  3. At the top of the Output menu, locate the Output Mode dropdown menu and change it from Simple to Advanced.

Step 2: Enable Custom FFmpeg Output

Once in Advanced mode, you need to redirect your recording settings to use the FFmpeg engine.

  1. Click on the Recording tab at the top of the window.
  2. Locate the Type dropdown menu.
  3. Select Custom Output (FFmpeg) from the list.

Step 3: Configure Destination and Container Format

With FFmpeg enabled, you must specify how and where your file will be saved.

  1. Under FFmpeg Output Type, choose Export to File (or select Output to URL if you are streaming to a specific custom server).
  2. Click Browse next to the File Path box to choose the folder where your recordings will be saved.
  3. Select your desired Container Format (such as mp4, mkv, mov, or ts) from the dropdown list.

Step 4: Select Encoders and Bitrates

This step defines how your video and audio are compressed.

  1. Video Bitrate: Enter your target bitrate (e.g., 10000 Kbps for high-quality 1080p recording).
  2. Keyframe Interval: Set this according to your requirements; 250 frames is standard, or you can set it to a specific time interval.
  3. Video Encoder: Choose your preferred video codec. For standard compatibility, select libx264 (CPU) or an available hardware encoder like h264_nvenc (Nvidia) or h264_amf (AMD).
  4. Audio Bitrate: Set your target audio bitrate (typically 160 Kbps or 320 Kbps for high-fidelity sound).
  5. Audio Encoder: Choose an audio codec, such as aac or ac3.

Step 5: Apply Custom Muxer Settings (Optional)

If you require highly specific codec behavior or custom flags:

  1. Locate the Muxer Settings or AMF/FFmpeg Options text field.
  2. Enter your custom command-line arguments separated by spaces (for example, preset=slow profile=main). Leave this blank if you do not have specific command-line requirements.

Step 6: Save and Test

To finalize your custom configuration:

  1. Click Apply in the bottom-right corner.
  2. Click OK to close the Settings window.
  3. Perform a short test recording to verify that the file renders correctly and that your system can handle the encoding load without dropping frames.