From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTP id 5677A4289A for ; Tue, 5 Jul 2022 13:19:49 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 38F4D68B7F3; Tue, 5 Jul 2022 16:19:47 +0300 (EEST) Received: from NAM12-DM6-obe.outbound.protection.outlook.com (mail-dm6nam12olkn2060.outbound.protection.outlook.com [40.92.22.60]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id B8D1868B7F3 for ; Tue, 5 Jul 2022 16:19:40 +0300 (EEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=epL3Rmv0qI4jBA1KstQtyoYRUsTKQLTJW1sV4SQMUWGmDJIdEgUWUPle+5o110ABmTQI+9mJh9FYwY9m1g1p6JhqVRaT1+nF+SCNBzUdXHPplwFiOfHD1NZRVIyJijBbzj+NSsq0PzZsiJlYjnWYxtx9WOCBzVsx9P/eE/+eOVZAN+oiI0bnqH6oxSBH4WhSQbwRy/GlVrsepfZ03yM75vItRlX5RTRz91fBdvU42dQyT8FwLsa5bknrNhCAJYb6xMOH3JvQSkeexOgNVtd3UOah+7fTPcr8g7JuPzTQAkwgzZxZITr5yZN0MhyQGC2a/yoJWyhT0b2w8CQpfetQJQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=/hXYRwhjciNp4p7mt/E3EEEbzthtJFeghEArRm4Hdw8=; b=dGjdp8D2MK3ectk+9Cj99g/E5Mjt6JRh+vAHC/ws19iaO1IvMA4QNaz4vqyempvOwh/JKKo02oxciW4ZshHTLlu028eo1KE+MON5kDMHElFHe3i1IXaVp+EUNghjEMGcYpyDWQgH+BXhgpxZONoUfaij7IB7FjsjdIUmuOgxBjQxxsNHKqnGTItDO0eZBb4pEXyIHD1lPZNyDmV9t1vw9wtYcjux8YLbDCRdNteRlTtZUZik4dZ0Pn+Aaoo2izoJKw0D/VBVGw6mz4jWyWaDpxgwpp1j5UwiyrE36pLLA5qQIjr60k7oVWTx0i8V7ifcfg5sD/B5Um3I0/rsnHqm9Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=/hXYRwhjciNp4p7mt/E3EEEbzthtJFeghEArRm4Hdw8=; b=DaKff9QZN1W4eAshcnRPtpHzEIi0byZFkwKUY0iN+4xxLcza7Uqw/pJXg7kUemW3tcza+SLp/DMLDlGEUoAGcXeuGKRlnCRwWtujcwOcHJvAvqkgZpaADxabM6DpvJAn5B6CIgSAT11GYEh5PlFkbgHu7mvbKKJK8CZRQbCNQdUb2ImOAOljTx1RG/n0XQeRgXsE441tv0Iy6AL/z/dWXibibgmkGQlAkBq4bglKl+8Sp1uHNWw576ljbNGMoIg/xY49KXq8LaLegq3HqvfbaMdeAMGcf77l3TF7jrOtB7DjknRm+fzNtg5oHgoj2DvJ14HyZgrNJZZqd1FuYaDzxg== Received: from MN2PR18MB3328.namprd18.prod.outlook.com (2603:10b6:208:165::16) by MN2PR18MB3391.namprd18.prod.outlook.com (2603:10b6:208:16b::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5395.21; Tue, 5 Jul 2022 13:19:37 +0000 Received: from MN2PR18MB3328.namprd18.prod.outlook.com ([fe80::a4c1:1a3b:10f3:b1f]) by MN2PR18MB3328.namprd18.prod.outlook.com ([fe80::a4c1:1a3b:10f3:b1f%7]) with mapi id 15.20.5395.021; Tue, 5 Jul 2022 13:19:37 +0000 From: Felix LeClair To: FFmpeg development discussions and patches Thread-Topic: [FFmpeg-devel] filter queue question Thread-Index: AQHYkG9BjkZOjlrRrUuwxTsiVP5Xha1vwAK4 Date: Tue, 5 Jul 2022 13:19:37 +0000 Message-ID: References: <1657024821.546426000.sb0n6ii6@frv55.fwdcdn.com> In-Reply-To: <1657024821.546426000.sb0n6ii6@frv55.fwdcdn.com> Accept-Language: en-CA, en-US Content-Language: en-CA X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [miExf47mj6t5u6SWClbgd1l4LibrSvJb] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: ff4bb5bb-da31-4570-083e-08da5e89028a x-ms-traffictypediagnostic: MN2PR18MB3391:EE_ x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 1JQfQPNrXAIHBq1iBNnofh3gW+m5bO4k9Z6Fbc+SWx28JKigKx87pZB/nOAi6YTdhy0TSwq4x644O0MJiEQrdXia6rLigel4PmVC3ooSJdmo9EZ8JEnlUYLWzYBXoPfENSgO2y8eWuffPnHLV6xUGkEJsD4zR6BTmntaWoTeHe9/NcJuZlVjikU42RExy/1FRgQblCExF5tsLVNia06kCoROUkTb3QCg8B978VJgiUtjgd6gwZBY4LQGCjwmkz9DbTOvy8+JMv2qSPFaRibMwSbs0bXQ9OBnzy0p59obZK7gnbzjwh4flU8g/v+jOphkoLv2B64bXEfZszSR40/hoTp4dCqOHxCknGt1mA3F+K+tnMwfC/Vp+gHIfXdLB1TFkFg1jLY7pHJZdCWDH7u+lpwPai1Phzf+thZ/XJXRrqgFpk2gh2R2q5S6pdVbk3di/cCKCeCUjzX4vzYPovt1O1sDiih0u2A7fAlSQ6Tjk4rpUmWcXP5j7kSw5kSqcXeMDapx+/2CHjVsUnSCj4EloaJBzU4vpa8RsY2mKLhNnECT3bRiu7DIwGZXl+9/qgZc0ns4tiah4SLJ2l8lkvN3DnMjxGcXkxsvtLCQLPKKapr1QgRnM1WPxY0tnNrWw8H1vtFoKLf+u6dzzeChQ8XAhQ== x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?nS8vKJgmJzpZ4PE/7EFGBit+hF52L4u7wp6aGnDy6CMDQ6A544Zi601qcY?= =?iso-8859-1?Q?Vkl4Umaz3NVt4hn60myA8qoOvDhSTOU1+NXJtOqD1G64Do6trTTTfLfkUL?= =?iso-8859-1?Q?BEEh/40GDrSz+gaWN21qEO+LbQLw5raj7E6GmKqLOrSZ9PQXyh8o+VW6HO?= =?iso-8859-1?Q?u/hDj3mONrzq7Y7lMe+farnoOWCxV1U/sv42+ALF3O0eHqktjwVqhe/LE0?= =?iso-8859-1?Q?FqZCJ7W5jyhKKe0qgRLfURINTIClTLZW33e0/8WEbxhh2bD7r0bl5zpNos?= =?iso-8859-1?Q?DDPKimk0aIlVA31ce9tM97Ih6c1EmkY52LqIYWEM2Zf7ndiolOV2Fs/UZ0?= =?iso-8859-1?Q?e5WSBFTf85hHY0R7gQ8pvmihCXx5g6IqcU26JmokA2TlaAjJTQgHw7mcoD?= =?iso-8859-1?Q?tPu8PFWTCfafkxga1baiXyvL50P5jjZKsaALwW7CG0MjPqZ60Yab26TxA3?= =?iso-8859-1?Q?yGXi7+2NVWc/T2M90yofzBRXWm3TEJZ6UmuSCjb3z+mZofbgQUVn5fP5Ia?= =?iso-8859-1?Q?DBN5desvRbhx/rco1KlgOORXnkW+fwzXsrmF5hlgj4kAXg+Es+L85jN0Cp?= =?iso-8859-1?Q?vMxRUlrbXQ9iYxGqLegi+B+GYqR8f3mjd+WYKoqx8cHWr0V+fbIXNOpl/m?= =?iso-8859-1?Q?vQIu8Bq2FfOyX2EGEf7oMyKC3pf0S86fRsdS+SvbuYp2/np4Ze1JWSkCei?= =?iso-8859-1?Q?t7Z1irElRqYmPWX2AQWJTecHpQsFPah7fMHTaQmvwiOvUNwP27wgZ/2knd?= =?iso-8859-1?Q?n25qya1s2ESD4klxqIAhKgv9Q8yLBRBK33lk2CmbAnrvX00UakjKpH5Trc?= =?iso-8859-1?Q?enx7WAaR1d4mxpRC3IMhcrfM+sLpeziPvWx3YKoMU1258HVqWkI/OmIfAN?= =?iso-8859-1?Q?9xS9awVJH48BPyb7ESFyjOCjVptF4ZrVaKinEYhgWHvOEioedm2YtwTIPy?= =?iso-8859-1?Q?ihl0iDHAer8tLTcreYcZEFPY7z3oYlNQuOOHvzvR6HItPIIlZS1LBmoMJV?= =?iso-8859-1?Q?DKFlzyUV54tXZgsoBcofbkfsqHxXxCEY1VOiu2xJcq3VaQo7hVSGGwWVtx?= =?iso-8859-1?Q?VpHz9uxDgo5n/k0WvEI1Xib65Z5NGc4TnW7mod02VGueLXCIxsSLrqcwuC?= =?iso-8859-1?Q?dpYbD9Nb1Aff1IdJkcxGLA4g0e4cXzNybHUqaQN0Qm5L0wCeE+Fzfag3Ky?= =?iso-8859-1?Q?Oc1sL+VjvfgC8stoSzVI/fwCr8gJkijHrrTBeZPqawP6vqqvldqHcAMqhP?= =?iso-8859-1?Q?+suiXvxhxFbeeTppWJU5VwFqA57fmvPdHfrbiONzK/qwSd/5cSIEya1TSW?= =?iso-8859-1?Q?bS6FOrnetdqjNamAN2M1Njo1mw=3D=3D?= MIME-Version: 1.0 X-OriginatorOrg: sct-15-20-4755-11-msonline-outlook-db494.templateTenant X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MN2PR18MB3328.namprd18.prod.outlook.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: ff4bb5bb-da31-4570-083e-08da5e89028a X-MS-Exchange-CrossTenant-originalarrivaltime: 05 Jul 2022 13:19:37.2165 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR18MB3391 X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [FFmpeg-devel] filter queue question X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: From: ffmpeg-devel on behalf of Alex <3.14pi@ukr.net> Sent: July 5, 2022 9:00 AM To: FFmpeg development discussions and patches Subject: [FFmpeg-devel] filter queue question Hi! I developing custom GPU filter that require lot of time to process frames and as result overal fps is low ( around 20 fps): ffmpeg -i 720p.mp4 -filter_complex "format=rgb24,myfilter" -f null - But then I added actual encoding part to ffmpeg command, result fps is down to 16 fps (-4 fps, around 20%!!!): ffmpeg -i 720p.mp4 -filter_complex "format=rgb24,myfilter" -c:v h264 -y out.mp4 If I look at timeline of overla process in each cycle: |----decoding time---| ---> |------------------------------filtering time-------------------------| ---> |---encoding time---| So, basically can I process frame in my custom filter without waiting for encoding to finish? In other word I want to process frames in my custom filter in parallel/queue to encoding process??? _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". In concept yes, but you may be better off improving the speed of the underlying filter itself. Part of the cost of encoding is beyond the encoder itself, you have to account for file-system overhead, disk I/O speed etc. Depending on your implementation, you may be running into issues with memory copies from system to GPU memory and back, which is quite expensive. try testing using a "hardware decoder--> your filter-->hardware encoder" chain to keep everything in GPU memory. Beyond that, standard GPU acceleration rules apply. Make sure your wave fronts/work groups are aligned, check for system utilization, use non-blocking/async calls when possible, etc. -Felix (FCLC) _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".