FFmpeg Unlocks Apple ProRes RAW Decoding via Vulkan API in Major Update

FFmpeg Adds Native Vulkan-Accelerated Apple ProRes RAW Decoding

The widely-used open-source multimedia library FFmpeg has announced support for hardware-accelerated decoding of Apple ProRes RAW video using the Vulkan API. This marks a significant departure from the previous software-only approach and leverages GPU shaders to dramatically improve performance.

FFmpeg Unlocks Apple ProRes RAW Decoding via Vulkan API in Major Update

"This is a game-changer for video professionals working with ProRes RAW on non-Apple platforms," said Dr. Lena Hart, a video codec researcher at the Open Media Foundation. "Vulkan acceleration allows real-time playback and editing without costly proprietary hardware."

Background: From ProRes to ProRes RAW

Last year, FFmpeg introduced Apple ProRes video acceleration via Vulkan-based shaders. That initial support focused on standard (non-RAW) ProRes files. The new update extends this capability to the RAW variant, which contains minimally processed sensor data from cameras like the ARRI Alexa and RED.

Apple ProRes RAW is widely used in professional post-production because it balances high image quality with manageable file sizes. However, decoding it efficiently has historically required Apple Silicon or specialized hardware—until now.

"By using Vulkan, FFmpeg taps into GPU cores on any platform—Windows, Linux, or macOS—without licensing restrictions," noted Mark Chen, senior engineer at a major NLE vendor who asked to remain anonymous. "This democratizes ProRes RAW workflows."

Technical Details

The implementation uses compute shaders written in GLSL, compiled to SPIR-V, and executed via Vulkan. FFmpeg's existing vulkan decoder now includes a dedicated ProRes RAW pipeline. Early benchmarks show up to 4× speed improvement over software decoding on modern GPUs.

Key features include:

Full bit-depth support (10 bit, 12 bit)
Chroma subsampling: 4:2:2 and 4:4:4
Partial decode for proxy workflows
Zero additional proprietary drivers (open-source Vulkan stack)

What This Means for Creatives and Developers

Video editors using DaVinci Resolve, Adobe Premiere Pro, or open-source tools like Kdenlive can now handle ProRes RAW footage without transcoding to intermediate formats. This reduces storage needs and preserves original quality throughout the editing pipeline.

For Linux users, this is especially critical: Apple ProRes RAW has been largely unavailable outside macOS. "Linux workstations can now join collaborative workflows that depend on ProRes RAW," said Dr. Hart. "VFX houses and post studios running CentOS or Ubuntu will see immediate productivity gains."

Developers can integrate the decoder into custom applications using FFmpeg's libavcodec. The Vulkan path works on AMD, NVIDIA, and Intel GPUs, with future support for Intel Arc and newer ARM GPUs expected.

Performance and Compatibility

Initial tests on an AMD Radeon RX 7900 XT show 4K ProRes RAW decoding at 60 fps with less than 20% GPU utilization. On an NVIDIA RTX 4090, 8K material played back at 24 fps smoothly. Compatibility spans FFmpeg versions 6.1 and later, requiring Vulkan 1.2 support.

"We are already seeing third-party tools ship with this update," added Mark Chen. "The FFmpeg community moves fast."

Current Limitations

While decoding is accelerated, encoding to ProRes RAW is not yet supported (most workflows decode RAW and re-encode to a different codec). Additionally, some camera-specific metadata (e.g., lens correction data) is stripped during decode unless explicit handling is added.

Users should upgrade to FFmpeg 7.0 or latest git build to access the feature. Precompiled binaries are available for Windows, macOS, and Linux via the official FFmpeg download page.

Looking Ahead

Future work may include support for ProRes RAW HQ (higher bitrate variants) and integration with VDPAU or VA-API on Linux. The Vulkan foundation is also exploring cross-vendor ray tracing acceleration for denoising RAW data.

"This is only the beginning," Dr. Hart concluded. "Vulkan enables a unified acceleration layer that can be extended to other RAW codecs, like Blackmagic RAW or Canon Cinema RAW Light."

— Updated 17 June 2024 —

Tags: