From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTP id 38289469AB for ; Mon, 31 Jul 2023 23:06:11 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 79B1868C3A2; Tue, 1 Aug 2023 02:06:09 +0300 (EEST) Received: from out-71.mta1.migadu.com (out-71.mta1.migadu.com [95.215.58.71]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 9F97668C152 for ; Tue, 1 Aug 2023 02:06:03 +0300 (EEST) X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bcheng.me; s=key1; t=1690844762; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=xlFe79oerlvxkCmujUOneAtFNNyF8ocfJCTU0MSkGyM=; b=WTf3z+xqNkS2JyVDbxgMdN9motZ0AwcheJ096uWL0gWcCoirMqK4LtkfRuQyJPy5cAW8uZ OV87rdhMBjdvZ2ElUeCPn0VmZsKC1pYkfiuaAocaHo+kPAL4+2rbLU4C26SLUBIa3ghWWK 1dYp41vpnYU4zzzZ4CAzR/Q1nPuDI/0DeIsaZXAYSn9E8COVfEPu3EAWCBWxCQPVgTgkce 49nUw2507yg7lQubIzypk0It+RY6uyajfZUfWKuYtdOAqWgOHvHnQ+iCu0FmgQQjNmStTH MdvUqo0X7KhCwGIu+C1mCXYFfxHwoF0t/t5X5qKtwiaFYTwmnYx2EYqT0/kiFg== From: Benjamin Cheng To: ffmpeg-devel@ffmpeg.org Date: Mon, 31 Jul 2023 18:53:14 -0400 Message-ID: <20230731225314.9407-1-ben@bcheng.me> MIME-Version: 1.0 X-Migadu-Flow: FLOW_OUT Subject: [FFmpeg-devel] [PATCH] vulkan_h264: fill correct ScalingList8x8 entries X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Benjamin Cheng Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: The Vulkan spec wants ScalingList8x8 as defined by ITU spec. The latter only defines ScalingList8x8[0] and ScalingList8x8[1] when chroma_format_idc != 3. --- libavcodec/vulkan_h264.c | 24 ++++++++++++++++++++---- 1 file changed, 20 insertions(+), 4 deletions(-) diff --git a/libavcodec/vulkan_h264.c b/libavcodec/vulkan_h264.c index 84bcef7933..0d81ae8a3c 100644 --- a/libavcodec/vulkan_h264.c +++ b/libavcodec/vulkan_h264.c @@ -146,9 +146,17 @@ static void set_sps(const SPS *sps, memcpy(vksps_scaling->ScalingList4x4[i], sps->scaling_matrix4[i], STD_VIDEO_H264_SCALING_LIST_4X4_NUM_ELEMENTS * sizeof(**sps->scaling_matrix4)); - for (int i = 0; i < STD_VIDEO_H264_SCALING_LIST_8X8_NUM_LISTS; i++) - memcpy(vksps_scaling->ScalingList8x8[i], sps->scaling_matrix8[i], + if (sps->chroma_format_idc == 3 /* yuv444 */) { + for (int i = 0; i < STD_VIDEO_H264_SCALING_LIST_8X8_NUM_LISTS; i++) + memcpy(vksps_scaling->ScalingList8x8[i], sps->scaling_matrix8[i], + STD_VIDEO_H264_SCALING_LIST_8X8_NUM_ELEMENTS * sizeof(**sps->scaling_matrix8)); + } else { + /* All other chroma formats have only 2 scaling 8x8 matrices. */ + memcpy(vksps_scaling->ScalingList8x8[0], sps->scaling_matrix8[0], STD_VIDEO_H264_SCALING_LIST_8X8_NUM_ELEMENTS * sizeof(**sps->scaling_matrix8)); + memcpy(vksps_scaling->ScalingList8x8[1], sps->scaling_matrix8[3], + STD_VIDEO_H264_SCALING_LIST_8X8_NUM_ELEMENTS * sizeof(**sps->scaling_matrix8)); + } *vksps_vui_header = (StdVideoH264HrdParameters) { .cpb_cnt_minus1 = sps->cpb_cnt - 1, @@ -251,9 +259,17 @@ static void set_pps(const PPS *pps, const SPS *sps, memcpy(vkpps_scaling->ScalingList4x4[i], pps->scaling_matrix4[i], STD_VIDEO_H264_SCALING_LIST_4X4_NUM_ELEMENTS * sizeof(**pps->scaling_matrix4)); - for (int i = 0; i < STD_VIDEO_H264_SCALING_LIST_8X8_NUM_LISTS; i++) - memcpy(vkpps_scaling->ScalingList8x8[i], pps->scaling_matrix8[i], + if (sps->chroma_format_idc == 3 /* yuv444 */) { + for (int i = 0; i < STD_VIDEO_H264_SCALING_LIST_8X8_NUM_LISTS; i++) + memcpy(vkpps_scaling->ScalingList8x8[i], pps->scaling_matrix8[i], + STD_VIDEO_H264_SCALING_LIST_8X8_NUM_ELEMENTS * sizeof(**pps->scaling_matrix8)); + } else { + /* All other chroma formats have only 2 scaling 8x8 matrices. */ + memcpy(vkpps_scaling->ScalingList8x8[0], pps->scaling_matrix8[0], STD_VIDEO_H264_SCALING_LIST_8X8_NUM_ELEMENTS * sizeof(**pps->scaling_matrix8)); + memcpy(vkpps_scaling->ScalingList8x8[1], pps->scaling_matrix8[3], + STD_VIDEO_H264_SCALING_LIST_8X8_NUM_ELEMENTS * sizeof(**pps->scaling_matrix8)); + } *vkpps = (StdVideoH264PictureParameterSet) { .seq_parameter_set_id = pps->sps_id, -- 2.41.0 _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".