From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTP id 6629840C50 for ; Fri, 6 Jan 2023 07:53:28 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 835A668BD08; Fri, 6 Jan 2023 09:52:49 +0200 (EET) Received: from out203-205-221-233.mail.qq.com (out203-205-221-233.mail.qq.com [203.205.221.233]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 5487868BB84 for ; Fri, 6 Jan 2023 09:52:41 +0200 (EET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=foxmail.com; s=s201512; t=1672991551; bh=N0Q0AVgty6bVbAatcuOjPG2ei3S7AmyPjYLZi/fNLk4=; h=From:To:Cc:Subject:Date; b=vChCxbVEGVOhGX/gtoMw3ptUz7B4sSymrZtD6dY7YydHWggqMKnW25jlWkAd2HUCb kYi6YurbN6pzENEyBTFCJRnCjf5v8XmBVhQjihODBy7d5IslVy2fDTgCMVvqCyZ5YK dAzj5GM9QFt5C7PCuC2vwx0RZGjWJdi7LD8C3Azw= Received: from localhost.localdomain ([59.37.125.102]) by newxmesmtplogicsvrsza2-0.qq.com (NewEsmtp) with SMTP id D1E058B1; Fri, 06 Jan 2023 15:52:30 +0800 X-QQ-mid: xmsmtpt1672991550th0nrn2mj Message-ID: X-QQ-XMAILINFO: MC9b57iUs2xBjbKtSlR7oJyd7IDAeKngfrxhM3ClhDpy9NOQnLbtGFa6qnN1NS 3SbhZDB6Uj19QZCg/WJJIepl3FmtdzEkyjcMdj6a9hIh1Aqxh968cKoVQp8cqw88bwZgqLPn6DvI RWARbz8JTPjunfeisJHIIidRkEttGbvI8r+UF1k6uT8dTMS9Ir4aM/hLqIYrbuJdhk0xe/FpSdKq Tft5Q/QN4Dpdd15BDKRXohZs+EB3q9WFFXACn9w0vL0sONsK2WpfqJDhsgMdJsDdC9qPUH9xRs6p QoAtqidlc955e1Y1F300g092PwAmRfmPcDmjKBdRBt9AshkFQ01o8aNpQ5JPDBPjzbsijnrGOw15 RJeaK7jeN2cadedFQJH4Nvo84nfCmmau4LFeZl/Y3r6R8kmkrULGeW6I/0FxR2nyleZOdq8mOjTs Z7VJolYIA+EsztOBUSPCoMWgsPkzhr0rnUx8hpYSZMpTURfdTmA+TKhSfPwg8G/oN7NYmFPCTSK3 +NLLU/276KP+XWsbZqay+0LiJzIfqtCB73PAH33Gd5T0g+ABUjA8YyaaGJpqOKy1WV2VtYfFJAyP mxMmENXJPXr8uKIQtqAddKbX+QFqFjKDMbmGxWQOdraCDumWecj9AWs/NiD7nkkisrpGzwP3lD8B ZmlNwLK3n3Qc8jegA/yjSX67MGfIfEX1XHSN/qlxwK4fDGOFRz/M11GnJ0sXHVs/VoVtNw893uoH k/CetdgN8L6F1K1v+0FU6xJxFd7mTzqX/p03oyuBu3ljqHLpmFgp11/DERXDrwGaYlaJH9gjTyJh WhFgvWuCVXiJd+yL/5vL/jCkswEjB0GPMTa1grtR1OIG4B0JeXNxQFZUeSEm0D0u5HEBtxt/mRgo QOByqxCZxhxRR9+Q5BUK1xLjv7umPGsV7hgxGt9X45UKrgmLHZBsrmTByrEjEVoMmT7obDYW1Q8q 6xsd7WbubAwfwh9tNc+bVeaVrMbvh5PvFjGN+uOJs= From: Zhao Zhili To: ffmpeg-devel@ffmpeg.org Date: Fri, 6 Jan 2023 23:52:26 +0800 X-OQ-MSGID: <20230106155230.487282-1-quinkblack@foxmail.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Subject: [FFmpeg-devel] [PATCH v2 0/4] Add hevc alpha layer decoding basic support X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Zhao Zhili Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: From: Zhao Zhili v2: 1. Check vps_max_layers and vps_max_layer_id inside hevc decoder 2. Add hevc_extract_layer bsf to do the job rather than modifing hevc_metadata, 3. Check vps_max_layers_minus1 and vps_max_layer_id inside bsf 4. Update vps_max_layers_minus1 and vps_max_layer_id when rewrite as base layer 5. vps_extension should be updated rather than drop entirely, add a TODO --------------------------------------------- 1. Don't drop nal->nuh_layer_id > 0 until decoder. 2. Make hevcdec able to decode a selected layer. 3. Add hevc_extract_layer bsf to extract a selected layer. Partially fix #7965. There is a sample in ticket #7965 which can be used to test the patchset. Or use videotoolbox encoder to create a sample (FFmpeg needs to be patched first, "avutil/hwcontext_videotoolbox: BGRA should be full range" http://ffmpeg.org/pipermail/ffmpeg-devel/2023-January/305252.html), e.g., ./ffmpeg -i cctv.mp4 \ -i pig.mp4 \ -c:v hevc_videotoolbox \ -alpha_quality 0.75 \ -filter_complex '[1:v]scale=640x480[v1];[0:v][v1]alphamerge[v2]' \ -map [v2] -an -t 60 \ -pix_fmt bgra \ -b:v 4M \ -tag:v hvc1 \ alpha.mp4 -y Now it's able to use two decoders to decode the base layer and alpha layer, and then combine the results, e.g., ./ffmpeg -i alpha.mp4 \ -strict -2 -nuh_layer_id 1 -i alpha.mp4 \ -frames 60 \ -filter_complex '[0:v][1:v]alphamerge[vout]' \ -map '[vout]' -an test-%d.png It only works with software decoder. hevc_extract_layer can be used together with hardware decoder. The following example is how to extract the alpha layer and rewrite as base layer: ./ffmpeg -i alpha.mp4 \ -an -c:v copy \ -bsf:v hevc_extract_layer=nuh_layer_id=1 \ test.mp4 Zhao Zhili (4): avcodec/hevc_parse: keep nal->nuh_layer_id > 0 avcodec/cbs_h2645: keep nal->nuh_layer_id > 0 avcodec/hevcdec: add nuh_layer_id option avcodec: add hevc_extract_layer bsf configure | 1 + doc/bitstream_filters.texi | 12 +++ libavcodec/Makefile | 1 + libavcodec/bitstream_filters.c | 1 + libavcodec/cbs_h2645.c | 3 - libavcodec/hevc_extract_layer_bsf.c | 126 ++++++++++++++++++++++++++++ libavcodec/hevc_parse.c | 2 - libavcodec/hevcdec.c | 56 ++++++++++++- libavcodec/version.h | 2 +- 9 files changed, 197 insertions(+), 7 deletions(-) create mode 100644 libavcodec/hevc_extract_layer_bsf.c -- 2.25.1 _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".