* [FFmpeg-devel] [PATCH 1/2] avdevice/decklink_dec: add explicit specifier @ 2023-08-31 14:49 Jun Zhao 2023-08-31 14:49 ` [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC Jun Zhao 0 siblings, 1 reply; 7+ messages in thread From: Jun Zhao @ 2023-08-31 14:49 UTC (permalink / raw) To: ffmpeg-devel; +Cc: Jun Zhao, Jun Zhao The explicit specifier used with a single argument constructor to prevent implicit type conversions. Signed-off-by: Jun Zhao <barryjzhao@tencent.com> --- libavdevice/decklink_dec.cpp | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/libavdevice/decklink_dec.cpp b/libavdevice/decklink_dec.cpp index 11640f72ca..671573853b 100644 --- a/libavdevice/decklink_dec.cpp +++ b/libavdevice/decklink_dec.cpp @@ -577,7 +577,7 @@ static void handle_klv(AVFormatContext *avctx, decklink_ctx *ctx, IDeckLinkVideo class decklink_input_callback : public IDeckLinkInputCallback { public: - decklink_input_callback(AVFormatContext *_avctx); + explicit decklink_input_callback(AVFormatContext *_avctx); ~decklink_input_callback(); virtual HRESULT STDMETHODCALLTYPE QueryInterface(REFIID iid, LPVOID *ppv) { return E_NOINTERFACE; } -- 2.25.1 _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". ^ permalink raw reply [flat|nested] 7+ messages in thread
* [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC 2023-08-31 14:49 [FFmpeg-devel] [PATCH 1/2] avdevice/decklink_dec: add explicit specifier Jun Zhao @ 2023-08-31 14:49 ` Jun Zhao 2023-08-31 18:12 ` Zhao Zhili 0 siblings, 1 reply; 7+ messages in thread From: Jun Zhao @ 2023-08-31 14:49 UTC (permalink / raw) To: ffmpeg-devel; +Cc: Jun Zhao, Jun Zhao Enable the HEVC encoder that supports low-latency mode. Signed-off-by: Jun Zhao <barryjzhao@tencent.com> --- libavcodec/videotoolboxenc.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/libavcodec/videotoolboxenc.c b/libavcodec/videotoolboxenc.c index 8e493c4f7a..bfc03787a0 100644 --- a/libavcodec/videotoolboxenc.c +++ b/libavcodec/videotoolboxenc.c @@ -1568,7 +1568,8 @@ static int vtenc_configure_encoder(AVCodecContext *avctx) #endif // low-latency mode: eliminate frame reordering, follow a one-in-one-out encoding mode - if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && avctx->codec_id == AV_CODEC_ID_H264) { + if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && + (avctx->codec_id == AV_CODEC_ID_H264 || avctx->codec_id == AV_CODEC_ID_HEVC)) { CFDictionarySetValue(enc_info, compat_keys.kVTVideoEncoderSpecification_EnableLowLatencyRateControl, kCFBooleanTrue); -- 2.25.1 _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC 2023-08-31 14:49 ` [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC Jun Zhao @ 2023-08-31 18:12 ` Zhao Zhili 2023-09-01 1:13 ` mypopy 0 siblings, 1 reply; 7+ messages in thread From: Zhao Zhili @ 2023-08-31 18:12 UTC (permalink / raw) To: 'FFmpeg development discussions and patches' Cc: 'Jun Zhao', 'Jun Zhao' > From: ffmpeg-devel <ffmpeg-devel-bounces@ffmpeg.org> On Behalf Of Jun Zhao > Sent: 2023年8月31日 22:50 > To: ffmpeg-devel@ffmpeg.org > Cc: Jun Zhao <barryjzhao@tencent.com>; Jun Zhao <mypopydev@gmail.com> > Subject: [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC > > Enable the HEVC encoder that supports low-latency mode. > > Signed-off-by: Jun Zhao <barryjzhao@tencent.com> > --- > libavcodec/videotoolboxenc.c | 3 ++- > 1 file changed, 2 insertions(+), 1 deletion(-) > > diff --git a/libavcodec/videotoolboxenc.c b/libavcodec/videotoolboxenc.c > index 8e493c4f7a..bfc03787a0 100644 > --- a/libavcodec/videotoolboxenc.c > +++ b/libavcodec/videotoolboxenc.c > @@ -1568,7 +1568,8 @@ static int vtenc_configure_encoder(AVCodecContext *avctx) > #endif > > // low-latency mode: eliminate frame reordering, follow a one-in-one-out encoding mode > - if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && avctx->codec_id == AV_CODEC_ID_H264) { > + if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && > + (avctx->codec_id == AV_CODEC_ID_H264 || avctx->codec_id == AV_CODEC_ID_HEVC)) { How about just remove the codec_id check? Is there any unwelcome side effects for encoders other than H264/HEVC? > CFDictionarySetValue(enc_info, > compat_keys.kVTVideoEncoderSpecification_EnableLowLatencyRateControl, > kCFBooleanTrue); > -- > 2.25.1 > > _______________________________________________ > ffmpeg-devel mailing list > ffmpeg-devel@ffmpeg.org > https://ffmpeg.org/mailman/listinfo/ffmpeg-devel > > To unsubscribe, visit link above, or email > ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC 2023-08-31 18:12 ` Zhao Zhili @ 2023-09-01 1:13 ` mypopy 2023-09-01 3:49 ` "zhilizhao(赵志立)" 0 siblings, 1 reply; 7+ messages in thread From: mypopy @ 2023-09-01 1:13 UTC (permalink / raw) To: FFmpeg development discussions and patches On Fri, Sep 1, 2023 at 2:13 AM Zhao Zhili <quinkblack@foxmail.com> wrote: > > > > From: ffmpeg-devel <ffmpeg-devel-bounces@ffmpeg.org> On Behalf Of Jun Zhao > > Sent: 2023年8月31日 22:50 > > To: ffmpeg-devel@ffmpeg.org > > Cc: Jun Zhao <barryjzhao@tencent.com>; Jun Zhao <mypopydev@gmail.com> > > Subject: [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC > > > > Enable the HEVC encoder that supports low-latency mode. > > > > Signed-off-by: Jun Zhao <barryjzhao@tencent.com> > > --- > > libavcodec/videotoolboxenc.c | 3 ++- > > 1 file changed, 2 insertions(+), 1 deletion(-) > > > > diff --git a/libavcodec/videotoolboxenc.c b/libavcodec/videotoolboxenc.c > > index 8e493c4f7a..bfc03787a0 100644 > > --- a/libavcodec/videotoolboxenc.c > > +++ b/libavcodec/videotoolboxenc.c > > @@ -1568,7 +1568,8 @@ static int vtenc_configure_encoder(AVCodecContext *avctx) > > #endif > > > > // low-latency mode: eliminate frame reordering, follow a one-in-one-out encoding mode > > - if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && avctx->codec_id == AV_CODEC_ID_H264) { > > + if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && > > + (avctx->codec_id == AV_CODEC_ID_H264 || avctx->codec_id == AV_CODEC_ID_HEVC)) { > > How about just remove the codec_id check? > Is there any unwelcome side effects for encoders other than H264/HEVC? 1. One reason is that there are now other encoders available, such as prores_videotoolbox. 2. It may be more appropriate to use a strictly qualified check instead of an open condition. _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC 2023-09-01 1:13 ` mypopy @ 2023-09-01 3:49 ` "zhilizhao(赵志立)" 2023-09-01 4:07 ` mypopy 0 siblings, 1 reply; 7+ messages in thread From: "zhilizhao(赵志立)" @ 2023-09-01 3:49 UTC (permalink / raw) To: FFmpeg development discussions and patches > On Sep 1, 2023, at 09:13, mypopy@gmail.com wrote: > > On Fri, Sep 1, 2023 at 2:13 AM Zhao Zhili <quinkblack@foxmail.com> wrote: >> >> >>> From: ffmpeg-devel <ffmpeg-devel-bounces@ffmpeg.org> On Behalf Of Jun Zhao >>> Sent: 2023年8月31日 22:50 >>> To: ffmpeg-devel@ffmpeg.org >>> Cc: Jun Zhao <barryjzhao@tencent.com>; Jun Zhao <mypopydev@gmail.com> >>> Subject: [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC >>> >>> Enable the HEVC encoder that supports low-latency mode. >>> >>> Signed-off-by: Jun Zhao <barryjzhao@tencent.com> >>> --- >>> libavcodec/videotoolboxenc.c | 3 ++- >>> 1 file changed, 2 insertions(+), 1 deletion(-) >>> >>> diff --git a/libavcodec/videotoolboxenc.c b/libavcodec/videotoolboxenc.c >>> index 8e493c4f7a..bfc03787a0 100644 >>> --- a/libavcodec/videotoolboxenc.c >>> +++ b/libavcodec/videotoolboxenc.c >>> @@ -1568,7 +1568,8 @@ static int vtenc_configure_encoder(AVCodecContext *avctx) >>> #endif >>> >>> // low-latency mode: eliminate frame reordering, follow a one-in-one-out encoding mode >>> - if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && avctx->codec_id == AV_CODEC_ID_H264) { >>> + if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && >>> + (avctx->codec_id == AV_CODEC_ID_H264 || avctx->codec_id == AV_CODEC_ID_HEVC)) { >> >> How about just remove the codec_id check? >> Is there any unwelcome side effects for encoders other than H264/HEVC? > > 1. One reason is that there are now other encoders available, such as > prores_videotoolbox. > > 2. It may be more appropriate to use a strictly qualified check > instead of an open condition. Both HEVC and ProRes failed with low_latency on my machine (with or without -allow_sw 1) [hevc_videotoolbox @ 0x61900002a380] Error: cannot create compression session: -12902 [prores_videotoolbox @ 0x61900002a380] Error: cannot create compression session: -12902 kVTParameterErr = -12902, 1. FFmpeg users should have an idea whether or not to set AV_CODEC_FLAG_LOW_DELAY. AV_CODEC_FLAG_LOW_DELAY doesn’t make sense for ProRes, but if user wants to try, let he/she do. 2. I can’t find API to query the capability. Only VideoToolBox framework itself know how to handle the argument. There isn’t much protect to provide for users. Even with H.264, the results is unexpected: the input framerate is 25 but the output framerate is 5, it dropped 80 percent frames silently. > _______________________________________________ > ffmpeg-devel mailing list > ffmpeg-devel@ffmpeg.org > https://ffmpeg.org/mailman/listinfo/ffmpeg-devel > > To unsubscribe, visit link above, or email > ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC 2023-09-01 3:49 ` "zhilizhao(赵志立)" @ 2023-09-01 4:07 ` mypopy 2023-09-01 4:17 ` Richard Kern 0 siblings, 1 reply; 7+ messages in thread From: mypopy @ 2023-09-01 4:07 UTC (permalink / raw) To: FFmpeg development discussions and patches On Fri, Sep 1, 2023 at 11:50 AM "zhilizhao(赵志立)" <quinkblack@foxmail.com> wrote: > > > > > On Sep 1, 2023, at 09:13, mypopy@gmail.com wrote: > > > > On Fri, Sep 1, 2023 at 2:13 AM Zhao Zhili <quinkblack@foxmail.com> wrote: > >> > >> > >>> From: ffmpeg-devel <ffmpeg-devel-bounces@ffmpeg.org> On Behalf Of Jun Zhao > >>> Sent: 2023年8月31日 22:50 > >>> To: ffmpeg-devel@ffmpeg.org > >>> Cc: Jun Zhao <barryjzhao@tencent.com>; Jun Zhao <mypopydev@gmail.com> > >>> Subject: [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC > >>> > >>> Enable the HEVC encoder that supports low-latency mode. > >>> > >>> Signed-off-by: Jun Zhao <barryjzhao@tencent.com> > >>> --- > >>> libavcodec/videotoolboxenc.c | 3 ++- > >>> 1 file changed, 2 insertions(+), 1 deletion(-) > >>> > >>> diff --git a/libavcodec/videotoolboxenc.c b/libavcodec/videotoolboxenc.c > >>> index 8e493c4f7a..bfc03787a0 100644 > >>> --- a/libavcodec/videotoolboxenc.c > >>> +++ b/libavcodec/videotoolboxenc.c > >>> @@ -1568,7 +1568,8 @@ static int vtenc_configure_encoder(AVCodecContext *avctx) > >>> #endif > >>> > >>> // low-latency mode: eliminate frame reordering, follow a one-in-one-out encoding mode > >>> - if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && avctx->codec_id == AV_CODEC_ID_H264) { > >>> + if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && > >>> + (avctx->codec_id == AV_CODEC_ID_H264 || avctx->codec_id == AV_CODEC_ID_HEVC)) { > >> > >> How about just remove the codec_id check? > >> Is there any unwelcome side effects for encoders other than H264/HEVC? > > > > 1. One reason is that there are now other encoders available, such as > > prores_videotoolbox. > > > > 2. It may be more appropriate to use a strictly qualified check > > instead of an open condition. > > Both HEVC and ProRes failed with low_latency on my machine (with or without -allow_sw 1) > > [hevc_videotoolbox @ 0x61900002a380] Error: cannot create compression session: -12902 > [prores_videotoolbox @ 0x61900002a380] Error: cannot create compression session: -12902 > > kVTParameterErr = -12902, > I think you missed the other options, low delay in VT encoder need to co-work with some other options > 1. FFmpeg users should have an idea whether or not to set AV_CODEC_FLAG_LOW_DELAY. > AV_CODEC_FLAG_LOW_DELAY doesn’t make sense for ProRes, but if user wants to try, let he/she > do. > > 2. I can’t find API to query the capability. Only VideoToolBox framework itself know how > to handle the argument. There isn’t much protect to provide for users. > Yes, now FFmpeg VT encoder didn't used the capability query, I think need to used the some API VTCopySupportedPropertyDictionaryForEncoder for capability query, this my next step > Even with H.264, the results is unexpected: the input framerate is 25 but the output > framerate is 5, it dropped 80 percent frames silently. > _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC 2023-09-01 4:07 ` mypopy @ 2023-09-01 4:17 ` Richard Kern 0 siblings, 0 replies; 7+ messages in thread From: Richard Kern @ 2023-09-01 4:17 UTC (permalink / raw) To: FFmpeg development discussions and patches > On Sep 1, 2023, at 12:07 AM, mypopy@gmail.com wrote: > > On Fri, Sep 1, 2023 at 11:50 AM "zhilizhao(赵志立)" <quinkblack@foxmail.com> wrote: >> >> >> >>>> On Sep 1, 2023, at 09:13, mypopy@gmail.com wrote: >>> >>> On Fri, Sep 1, 2023 at 2:13 AM Zhao Zhili <quinkblack@foxmail.com> wrote: >>>> >>>> >>>>> From: ffmpeg-devel <ffmpeg-devel-bounces@ffmpeg.org> On Behalf Of Jun Zhao >>>>> Sent: 2023年8月31日 22:50 >>>>> To: ffmpeg-devel@ffmpeg.org >>>>> Cc: Jun Zhao <barryjzhao@tencent.com>; Jun Zhao <mypopydev@gmail.com> >>>>> Subject: [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC >>>>> >>>>> Enable the HEVC encoder that supports low-latency mode. >>>>> >>>>> Signed-off-by: Jun Zhao <barryjzhao@tencent.com> >>>>> --- >>>>> libavcodec/videotoolboxenc.c | 3 ++- >>>>> 1 file changed, 2 insertions(+), 1 deletion(-) >>>>> >>>>> diff --git a/libavcodec/videotoolboxenc.c b/libavcodec/videotoolboxenc.c >>>>> index 8e493c4f7a..bfc03787a0 100644 >>>>> --- a/libavcodec/videotoolboxenc.c >>>>> +++ b/libavcodec/videotoolboxenc.c >>>>> @@ -1568,7 +1568,8 @@ static int vtenc_configure_encoder(AVCodecContext *avctx) >>>>> #endif >>>>> >>>>> // low-latency mode: eliminate frame reordering, follow a one-in-one-out encoding mode >>>>> - if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && avctx->codec_id == AV_CODEC_ID_H264) { >>>>> + if ((avctx->flags & AV_CODEC_FLAG_LOW_DELAY) && >>>>> + (avctx->codec_id == AV_CODEC_ID_H264 || avctx->codec_id == AV_CODEC_ID_HEVC)) { >>>> >>>> How about just remove the codec_id check? >>>> Is there any unwelcome side effects for encoders other than H264/HEVC? >>> >>> 1. One reason is that there are now other encoders available, such as >>> prores_videotoolbox. >>> >>> 2. It may be more appropriate to use a strictly qualified check >>> instead of an open condition. >> >> Both HEVC and ProRes failed with low_latency on my machine (with or without -allow_sw 1) >> >> [hevc_videotoolbox @ 0x61900002a380] Error: cannot create compression session: -12902 >> [prores_videotoolbox @ 0x61900002a380] Error: cannot create compression session: -12902 >> >> kVTParameterErr = -12902, >> > I think you missed the other options, low delay in VT encoder need to > co-work with some other options > >> 1. FFmpeg users should have an idea whether or not to set AV_CODEC_FLAG_LOW_DELAY. >> AV_CODEC_FLAG_LOW_DELAY doesn’t make sense for ProRes, but if user wants to try, let he/she >> do. >> >> 2. I can’t find API to query the capability. Only VideoToolBox framework itself know how >> to handle the argument. There isn’t much protect to provide for users. >> > Yes, now FFmpeg VT encoder didn't used the capability query, I think > need to used the some API VTCopySupportedPropertyDictionaryForEncoder > for capability query, this my next step That’s a good idea. We don’t have to worry about codec checks or unexpected failures if the HEVC encoder on some devices doesn’t support it. Ideally we can print out a warn message and ignore the low-delay flag. >> Even with H.264, the results is unexpected: the input framerate is 25 but the output >> framerate is 5, it dropped 80 percent frames silently. >> > _______________________________________________ > ffmpeg-devel mailing list > ffmpeg-devel@ffmpeg.org > https://ffmpeg.org/mailman/listinfo/ffmpeg-devel > > To unsubscribe, visit link above, or email > ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". ^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2023-09-01 4:18 UTC | newest] Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2023-08-31 14:49 [FFmpeg-devel] [PATCH 1/2] avdevice/decklink_dec: add explicit specifier Jun Zhao 2023-08-31 14:49 ` [FFmpeg-devel] [PATCH 2/2] lavc/videotoolboxenc: enable low-latency mode for HEVC Jun Zhao 2023-08-31 18:12 ` Zhao Zhili 2023-09-01 1:13 ` mypopy 2023-09-01 3:49 ` "zhilizhao(赵志立)" 2023-09-01 4:07 ` mypopy 2023-09-01 4:17 ` Richard Kern
Git Inbox Mirror of the ffmpeg-devel mailing list - see https://ffmpeg.org/mailman/listinfo/ffmpeg-devel This inbox may be cloned and mirrored by anyone: git clone --mirror https://master.gitmailbox.com/ffmpegdev/0 ffmpegdev/git/0.git # If you have public-inbox 1.1+ installed, you may # initialize and index your mirror using the following commands: public-inbox-init -V2 ffmpegdev ffmpegdev/ https://master.gitmailbox.com/ffmpegdev \ ffmpegdev@gitmailbox.com public-inbox-index ffmpegdev Example config snippet for mirrors. AGPL code for this site: git clone https://public-inbox.org/public-inbox.git