# hwcodec

**Repository Path**: lgsg/hwcodec

## Basic Information

- **Project Name**: hwcodec
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2025-01-23
- **Last Updated**: 2025-01-23

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# A real-time hardware codec library for [RustDesk](https://github.com/rustdesk/rustdesk) based on FFmpeg


## Codec

### Windows

| GPU           | FFmpeg ram        | FFmpeg vram | sdk vram |
| ------------- | ----------------  | ----------- | -------- |
| intel encode  | qsv               | qsv         | Y        |
| intel decode  | d3d11             | d3d11       | Y        |
| nvidia encode | nvenc(nv12->d3d11)| nvenc(d3d11)| Y        |
| nvidia decode | d3d11             | d3d11       | N        |
| amd encode    | amf               | amf         | Y        |
| amd decode    | d3d11             | d3d11       | Y        |

#### Notes

* The reason for discarding the codecs using Cucontext is discussed in the following forum thread: https://forums.developer.nvidia.com/t/cuctxdestroy-causing-system-freeze-and-black-screen/290542/1.
Based on the information above, there are several optimizations and changes made to the codec:
  - FFmpeg encoding AV_PIX_FMT_NV12 directly: The codec is modified to transfer AV_PIX_FMT_NV12 to AV_PIX_FMT_D3D11. This is done because FFmpeg doesn't use Cucontext if the device type is AV_HWDEVICE_TYPE_D3D11VA.
  - FFmpeg decoding with AV_HWDEVICE_TYPE_CUDA acceleration: This functionality is disabled and replaced with AV_HWDEVICE_TYPE_D3D11VA. The decoding process now utilizes D3D11VA acceleration instead of CUDA.
  - SDK decoding with CUDA acceleration: The CUDA acceleration support is disabled.

* amd sdk remove h265 support, https://github.com/GPUOpen-LibrariesAndSDKs/AMF/issues/432

### Linux

| GPU           | FFmpeg ram     |
| ------------- | -------------- |
| intel encode  | vaapi          |
| intel decode  | vaapi          |
| nvidia encode | vaapi, nvnec   |
| nvidia decode | vaapi, nvdec   |
| amd encode    | vaapi, amf     |
| amd decode    | vaapi          |

#### Issue

* vaapi: only tested on intel with `va-driver-all`, and hevc_vaapi encoding not supported on my pc
* remove hevc_vaapi because of possible poor quality
* amf: not tested, https://github.com/GPUOpen-LibrariesAndSDKs/AMF/issues/378

### MacOS

| FFmpeg ram encode   | FFmpeg ram decode   |
| ------------------  | ------------------  |
| h265 only           | Y                   |

### Android

| FFmpeg ram encode   |
| ------------------  |
| Y                   |

## System requirements

* intel

  Windows Intel(r) graphics driver since 27.20.100.8935 version. 

  [Hardware Platforms Supported by the Intel(R) Media SDK GPU Runtime](https://www.intel.com/content/www/us/en/docs/onevpl/upgrade-from-msdk/2023-1/onevpl-hardware-support-details.html#HARDWARE-PLATFORMS-SUPPORTED-BY-THE-INTEL-R-MEDIA-SDK-GPU-RUNTIME)

  https://www.intel.com/content/www/us/en/docs/onevpl/developer-reference-media-intel-hardware/1-1/overview.html

* AMD

  AMD Radeon Software Adrenalin Edition 23.1.2 (22.40.01.34) or newer

  https://github.com/GPUOpen-LibrariesAndSDKs/AMF

* nvidia

  Windows: Driver version 471.41 or higher

  https://docs.nvidia.com/video-technologies/video-codec-sdk/11.1/read-me/index.html

  https://developer.nvidia.com/video-encode-and-decode-gpu-support-matrix-new?ncid=em-prod-816193