From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTP id 9CC56453E4 for ; Tue, 28 Feb 2023 09:00:30 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 5BA8968A304; Tue, 28 Feb 2023 11:00:28 +0200 (EET) Received: from out203-205-221-221.mail.qq.com (out203-205-221-221.mail.qq.com [203.205.221.221]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id B41E4680CE0 for ; Tue, 28 Feb 2023 11:00:19 +0200 (EET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=foxmail.com; s=s201512; t=1677574815; bh=wF0BO/tKFbu0BUIVXqBp7gCBzy4Zl9vI1HrazjOnyg4=; h=From:Subject:Date:References:To:In-Reply-To; b=J7BhFhHcSJmaM5M0iSIBKVn9TPLUXZp7BRKPNIgYYudzoeQ/LM7BlXWDIWQiQ1ECA Aj5LvVstfOGZx8zMrGeK9fvdWIOAD8Um3eHH9GA1KeRYlW3yPPnURoUgm9U/iuTatT +FdkxmmI80197JpxkOoPYB9FdM3w0Z5WWGKoWMT8= Received: from smtpclient.apple ([113.108.77.56]) by newxmesmtplogicsvrszb9-0.qq.com (NewEsmtp) with SMTP id E050E5; Tue, 28 Feb 2023 17:00:14 +0800 X-QQ-mid: xmsmtpt1677574814tdrmch22e Message-ID: X-QQ-XMAILINFO: Mg/0DM1Zd+nHItQktWwJQNIONlZlFGuFHX/zhz4eEonWlnMrylZ7W37BDvpj5N k1uBmP8iS1RZ8Bs0hKt7DTVDCyC4wzdQsR4++Mo5lTFf5HaQlWOzPCY0fYKR2oirmG1GkH6fIsST +hD0UvsxXrLsQWKYjELwB7qLUv0BJntjXjHVCdMJY6+HzubwASYjz536fDDptMdpUeLHZvIC7JVf gAOXxC3oTshn86TsEe3H3pizdGdbdMDnmaIJ713Y36VvD/7PXHlMbygm9PV6bZ8gOcFt0tqmlwUf dSWmlUsd8MQDdkvhPGRQ1Adgh+bLmzoyYubeBhi1wSGrUGxIcqahfX4b1n6MzkQQAZwW/VjSZonw 8u9dqMKaJpZQJhiencXTxroD6+iNFMF9MrLk489owGHzK4lKQwgXPa8ND2ifjean135BvlzzNUnp 5Ald507MLLBgDxbCpL/uzU28SJ3HOS1iF3dlgAUH8t9eSxQyGP0V43LlrPK3rtRAu0lx8yJPd/d+ cPddOXjFGwDavvwKMoML7H0q1JD3osQF2ffGNWZBCMJI+DLz6v/4rhu3corS8ucc0SqY3uApuV1m fJnRJsaXC4mIhQOc8HGJ90M8XZKNiKMYYvVEhoL9RG6J1UrmCU+QMVWHSPuqYjs1n2c+/JjhrIPW qxmqJ3yDgsvNLKIn/GjAJV6tEaugIo4GUXkvsE9V9HyXZoZDDgjJagUq2FJh3Mi7UOsckpgaGf91 zXVCXnUbakPuQLXxJ8Zi0qTJDEVak6u0LkOicoF2YH0MyzheBjjXgA5o3FMZTwNrRnrr+yFZnzJn GCBLWvRZH+zFLCObcfOpKkNNXwVXQKgIIr31awAR/3yXBMNztRjaj1VDepxRuWciaUGfvZusv7mS fMhJg35cn0miclEkBhzvpI8vRJj6SLQGawuYdSXxCE6i6YUZHLJLN1/73UZXSrMr8TlluHg9yQYi nWAk7CCLjsgo75C8Z0iNOq7vmeoDlKLHGfL/BLM4o2eij+N+40HQ== From: =?utf-8?B?InpoaWxpemhhbyjotbXlv5fnq4spIg==?= Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.1\)) Date: Tue, 28 Feb 2023 17:00:15 +0800 References: To: FFmpeg development discussions and patches In-Reply-To: X-OQ-MSGID: X-Mailer: Apple Mail (2.3696.120.41.1.1) Subject: Re: [FFmpeg-devel] [PATCH v2 0/4] Add hevc alpha layer decoding basic support X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: > On Jan 6, 2023, at 23:52, Zhao Zhili wrote: > > From: Zhao Zhili > > v2: > 1. Check vps_max_layers and vps_max_layer_id inside hevc decoder > 2. Add hevc_extract_layer bsf to do the job rather than modifing hevc_metadata, > 3. Check vps_max_layers_minus1 and vps_max_layer_id inside bsf > 4. Update vps_max_layers_minus1 and vps_max_layer_id when rewrite as base layer > 5. vps_extension should be updated rather than drop entirely, add a TODO Will push soon if there's no objections. > > --------------------------------------------- > 1. Don't drop nal->nuh_layer_id > 0 until decoder. > 2. Make hevcdec able to decode a selected layer. > 3. Add hevc_extract_layer bsf to extract a selected layer. > > Partially fix #7965. There is a sample in ticket #7965 which can be used to test > the patchset. Or use videotoolbox encoder to create a sample (FFmpeg needs to be > patched first, "avutil/hwcontext_videotoolbox: BGRA should be full range" > http://ffmpeg.org/pipermail/ffmpeg-devel/2023-January/305252.html), e.g., > > ./ffmpeg -i cctv.mp4 \ > -i pig.mp4 \ > -c:v hevc_videotoolbox \ > -alpha_quality 0.75 \ > -filter_complex '[1:v]scale=640x480[v1];[0:v][v1]alphamerge[v2]' \ > -map [v2] -an -t 60 \ > -pix_fmt bgra \ > -b:v 4M \ > -tag:v hvc1 \ > alpha.mp4 -y > > > Now it's able to use two decoders to decode the base layer and alpha > layer, and then combine the results, e.g., > > ./ffmpeg -i alpha.mp4 \ > -strict -2 -nuh_layer_id 1 -i alpha.mp4 \ > -frames 60 \ > -filter_complex '[0:v][1:v]alphamerge[vout]' \ > -map '[vout]' -an test-%d.png > > It only works with software decoder. > > hevc_extract_layer can be used together with hardware decoder. The following > example is how to extract the alpha layer and rewrite as base layer: > > ./ffmpeg -i alpha.mp4 \ > -an -c:v copy \ > -bsf:v hevc_extract_layer=nuh_layer_id=1 \ > test.mp4 > > Zhao Zhili (4): > avcodec/hevc_parse: keep nal->nuh_layer_id > 0 > avcodec/cbs_h2645: keep nal->nuh_layer_id > 0 > avcodec/hevcdec: add nuh_layer_id option > avcodec: add hevc_extract_layer bsf > > configure | 1 + > doc/bitstream_filters.texi | 12 +++ > libavcodec/Makefile | 1 + > libavcodec/bitstream_filters.c | 1 + > libavcodec/cbs_h2645.c | 3 - > libavcodec/hevc_extract_layer_bsf.c | 126 ++++++++++++++++++++++++++++ > libavcodec/hevc_parse.c | 2 - > libavcodec/hevcdec.c | 56 ++++++++++++- > libavcodec/version.h | 2 +- > 9 files changed, 197 insertions(+), 7 deletions(-) > create mode 100644 libavcodec/hevc_extract_layer_bsf.c > > -- > 2.25.1 > > _______________________________________________ > ffmpeg-devel mailing list > ffmpeg-devel@ffmpeg.org > https://ffmpeg.org/mailman/listinfo/ffmpeg-devel > > To unsubscribe, visit link above, or email > ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".