Composite 3D Render Over Live Action in Blender

Compositing a 3D object over live-action footage in Blender requires preparing your 3D scene with a transparent background, capturing realistic contact shadows, and merging the elements inside the Blender Compositor. By matching camera perspectives, using shadow catchers, and utilizing the Alpha Over node alongside basic color grading tools, you can seamlessly integrate CGI elements into real-world video or photography.

Step 1: Match the Live-Action Camera and Scene Settings

  1. Set Dimensions and Frame Rate: Go to the Output Properties tab and set the resolution and frame rate to match your live-action footage exactly.
  2. Align the Camera: Select your scene camera, go to Camera Properties, and set the Focal Length to match the camera lens used during filming.
  3. Add Background Reference: In the Camera Properties, check Background Images, click Add Image, and choose Movie Clip (for video) or Image (for a photo). This allows you to align your 3D objects to the perspective of the plate directly in the 3D Viewport.

Step 2: Enable Transparency and Shadow Catchers

To place your render over a background, the world background must be transparent while still interacting with the floor or surrounding objects.

  1. Enable Film Transparency: Go to the Render Properties tab, expand the Film section, and check Transparent.
  2. Create a Shadow Catcher: Add a mesh plane beneath your 3D model where ground shadows should fall.
  3. Activate Shadow Catcher Property: Select the ground plane, navigate to the Object Properties tab, open Visibility, and check Shadow Catcher. The plane will turn invisible in the final render while retaining realistic contact shadows and ambient occlusion.

Step 3: Match Lighting and Reflections

  1. Go to the World Properties tab and use an HDRI environment map taken at the filming location (or one with similar lighting conditions) to provide accurate ambient light and reflections.
  2. Add manual light sources (Sun, Area, or Point lights) to align with the primary light directions in your live-action plate.

Step 4: Composite Using Nodes

  1. Switch to the Compositing workspace and check the Use Nodes box at the top of the editor.
  2. Add the background footage by pressing Shift + A and selecting Input > Movie Clip (for video) or Input > Image (for a photo). Open your live-action file.
  3. Add an Alpha Over node (Shift + A > Color > Alpha Over).
  4. Connect your nodes:
    • Connect the Image output of the live-action node to the top Image input of the Alpha Over node.
    • Connect the Image output of the Render Layers node to the bottom Image input of the Alpha Over node.
    • Connect the Image output of the Alpha Over node to both the Composite node and a Viewer node.

Step 5: Color Match and Blend

To blend the CGI realistically with the live-action plate, place corrective nodes between the Render Layers output and the Alpha Over node:

  • Color Balance / RGB Curves: Adjust the lift, gamma, and gain to match the black levels, highlights, and color temperature of the real footage.
  • Blur / Defocus: Match any natural camera depth of field or slight lens softness.
  • Lens Distortion: Add subtle dispersion or barrel distortion if the real lens exhibits optical imperfections.