From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTP id 48791431A8 for ; Tue, 24 May 2022 14:23:55 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id E5D2C68B4EE; Tue, 24 May 2022 17:23:52 +0300 (EEST) Received: from NAM04-MW2-obe.outbound.protection.outlook.com (mail-mw2nam08olkn2050.outbound.protection.outlook.com [40.92.46.50]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 397C268B477 for ; Tue, 24 May 2022 17:23:47 +0300 (EEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=eGlYsyrnTKCZEF0jv6dm3J044vME95bIof4LkUTP+p7pteZkvvOMPVjt/XJh19OC6mk7/VTnKHzRB7q/QAqEv4XHqqcyFl+sflqv+zYXghOcLvRx5IoKFYRi+PIdg2mVPgKKn0MifFDp9zvBQzG68EY++0NUOB1+4qj8hqsMAiXEx9afxJTPCBY9kTr7K/bC7l67YaJ/y47h5Eg4IuuNWf4C7vKfxPpz4sJOEAh8ISZaiqVMKVxDRGPAnvPM4BTbveTYocKLQS/XX5EfQoobR2JUuWB0bq5ipdnyl/vYRoqklL+sVttQ0utTRXABvyiENXXNYPxBtZd1sZl5usybBw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=eYZYy9NBx0Y7dLTYSfy33KOwxTINmpNmXAvnxHFXGhg=; b=RHjgoWn54RCR21WQ6GTmhsOW74t+ARtlf0kJih0RWCprIQTFNimTDjBDEJl6055eg3EfTwpP9FY1rVyYc/bE+i2eBbodBZkGBgGQu5AaTZphDUGOlAfCwbkAS3B13iBFmQOP6Pm6UHM/avpgXlt3XwUo2dMdG7qJwX4mxEzZusEzXlE0gYkQUiZtlOcWZknp3eWAC6vj9E81IT3nCoofOvf/u8UQU0l7KIFqTf6df3Viig++vz0KTyYaotsiZeOVP3k0u7tY8Ci3GC4t65Ytb/LvlCY3A5HrkY6EimEYYxzZwFp/4kVVLTCk9TafWvTp85NjnzqJbommyP9SqyT4rg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=eYZYy9NBx0Y7dLTYSfy33KOwxTINmpNmXAvnxHFXGhg=; b=CrmssmAlADW9onMTi2VhJf6hdLmLwKPyNoY4sj/b0Tc5G4OcVpGUrS2W/Idc99x/yqFyQk2d5CQTaOb5wrfgdUNGrVymY5Fem+Q5X0RQLBvQPMOcd9KJKItGZn3fYCJU4aKcue20IVdd/VBDurCv0nOZN+tGrbiHj0zkXNWzy1+CCV9QG5JR9TbL0O5YcGOxb90rX40/Hu++qISlKbk+b+fhzEuWfY+xj7zqkwLqWn/Yf86qAtCNkPshXLeXCBcnpgebtSPP57cnsN3Zl2gAPnSkeDnUlWb/WedN2cNMRoiK2pPGA8TQYY/qul0+HmbBv4V592jV/sBuORJNAA7I8w== Received: from DM8P223MB0365.NAMP223.PROD.OUTLOOK.COM (2603:10b6:8:b::20) by CY5P223MB0515.NAMP223.PROD.OUTLOOK.COM (2603:10b6:930:25::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5273.23; Tue, 24 May 2022 14:23:43 +0000 Received: from DM8P223MB0365.NAMP223.PROD.OUTLOOK.COM ([fe80::c536:493f:7cda:53dc]) by DM8P223MB0365.NAMP223.PROD.OUTLOOK.COM ([fe80::c536:493f:7cda:53dc%3]) with mapi id 15.20.5273.023; Tue, 24 May 2022 14:23:43 +0000 From: Soft Works To: FFmpeg development discussions and patches Thread-Topic: [FFmpeg-devel] [PATCH 2/2] libavfi/dnn: add LibTorch as one of DNN backend Thread-Index: AQHYbomLzmIMQM3SmEm2rxIs+uAn3K0sOCoAgAHY1gCAAAEXsA== Date: Tue, 24 May 2022 14:23:43 +0000 Message-ID: References: <20220523092918.9548-1-ting.fu@intel.com> <20220523092918.9548-2-ting.fu@intel.com> <01371577-00b1-4b3f-b964-59e2359f2a69@www.fastmail.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-tmn: [fjZT512HQh+1TnKjG7aLgTgNdwjcWLn2] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 6d97775b-c1e5-492f-8235-08da3d9101d9 x-ms-traffictypediagnostic: CY5P223MB0515:EE_ x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: RCUsl7jpEg2ZsYCjyoLW1/pimaAzcNThfOM0hdwjOLnglcvyRJL2c/u1VzzG8UqS0ecxR+houdspvB5DnPqNqpPAxPqEcXrLwIL/5fhWGn14meludOIhwHKa8C39dWqH1rQA6etB0CudRxH9kNXWHP3kHfUSB0On5Hsaf7ggkNKkTPexvOIAY0yrXrWg9OBMgf77FK2ylhn2re0n0Qr/ywXKb6puzT67tVXcIo3+lN/rO5mD+r+msUK3ru0joxAVsxsysf5cD3ahdDxOb5TovRpoFkaSTPLFl5Xd2NgNmv1DGQ2TivF5fhMnqpP0bHBS3xMHz+6wK5bwu9IcUrlJDOYb0xsnyqTnOdwM/OHcbqiIWPcb7D7prn+TDk7CE20flK2YXG//Ds1X17hQHuk+kJuoExIDLRt+81McG/5J+Ls5wt3AVXgaXCadi5DmljaEs7aJYKhJCOzQtSd/VDSYOf3NAtjatRbKqc9yeMUb8aIVVRtQWBmT4rzZstLiFYbB2hHUDsSmijW8gTlXeEq7yJsuETXQ9djBNwQixc3s7WG40S1EnOdAeXmGSnzWeiE1Le68VDnzFf7EismLUptuJg== x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?utf-8?B?Y05PZHAxOE15UDlaMXk0TmlKNExGNEIyRnJtRlRYeU5ma0syZHp5ZDh4M0hi?= =?utf-8?B?SHpBeGVYR016TWNjN0xSSG40WlVxNlVDcXhOVW5kbXg4cC91T0xXWWdxRHpP?= =?utf-8?B?VzNuc0dETEZjbGtralBLNHFVMzNuVDN3UW1OVXJZTWsyZEhNU21iTmV0UTl4?= =?utf-8?B?aUZWREM1NUc4cDRua3BDTDhRNUxvMHpZd28reC9tbWFFODZmQzRiWFlzakRw?= =?utf-8?B?RUFUQXkvaW1QaERGWHVwYlBUUnpVR2hEbUhnOWZJcGtnSG1ySklxWWR2VVRD?= =?utf-8?B?YXdBVGM5SkpSN2xieVRQdmRNQktLaTlWR1E2TFp5U29LeW1Uak9TVnoyaFo4?= =?utf-8?B?akJKVS9ZRkpoKzB4cXRBTHNvRU9YUlF6T3UxRkFId0JhZWo5SkwvcFhCK3h0?= =?utf-8?B?TlVOZGRTajRUNGFUUnlGUFVINkJYODUyR0tMdGZrQXNhQUtyUXZManptYllu?= =?utf-8?B?VkwrWUg1OE50NUhWY2wvdmtUL3NqdnU5NHdZZjZzQjJybG53RklMRXZ4UVhH?= =?utf-8?B?ZlM0V1JldU43S0t2RmN2ZjlJcTdoNlUwR0o4TTNsbndaZ05YbzlIWXJvV3Y0?= =?utf-8?B?Sjc3UzhnS0l4RHk1V2RJeEdzYjM0Skl3Z3NUY093b2x0eVkyczdPR25LSldG?= =?utf-8?B?aTlnVS9wSWYxTVdNVWJ4ekdtRldLdmEvdzZGaDNDRVh3bWhvOTJzZ3h2ME0w?= =?utf-8?B?WWw5ME54YSt1TjZRcEh2VGVrSzBiN2J5N2xoUmtCcDhTMGpEcTVlbWRSTXRB?= =?utf-8?B?UE5MZjhTS2lWZGEvK0l1ZHlKQ3k1TjJ4Qm9BTjN4UE9rL3Y3MDcrL1czODQr?= =?utf-8?B?TzYxbUVYRm5ySmV1REZlY3phYlZSVWUzR3RGOEwxdjZyVmxZbzNIMzlHclBN?= =?utf-8?B?TGpoMnVTUVAvUVJDWW9pYmVsWFRScjBrTTg5Y3hMTThLdHdFdk04ZU5UNzJC?= =?utf-8?B?eDFLVll6MWxoR2JlWVhjWnBpRmp2SldPd3N4TFpqSUtBaDhoZXRMRFpFaFl5?= =?utf-8?B?VEpKQjExMEc0Z0cvVGhnQ2tQVm9OcGdBbGw2UDJNcE03UWorTTh1bXpqa1M4?= =?utf-8?B?WTgyZDJ4Sm5XSXJRc3B6bVI0WkJndTVpZC8zNm12azczNk5ia1d6SDMxOXFj?= =?utf-8?B?Ym45SkJPZEtFZjdBQzh0eGdDUk1uZTRSelg0a1FVMkNqU2J5cEE5WlMzcGpH?= =?utf-8?B?RkJRb29pb21qRGJES1pOMlI5MnFRUDlDSXNRa0hsVnlFbVVSa2tIWFJyT011?= =?utf-8?B?cU42S0lHTll3RHF1eEE4cGVZRm96b2dzV2hiM3l6dUFoY3lQcjJpekIwY3Jl?= =?utf-8?B?UUc2QWZ3MytTeDMyNWRYaEYyUUJGOFM0TjFJenFNN3FwOWNDZjc2TWRHSFJr?= =?utf-8?B?VXk0UlpBcitHMGZLdTJwQTZrOEQ4S1I1MCtYTHZFRXZ1TEtvNHVZaWp5OVkv?= =?utf-8?B?TDJTMEZmb1pLSys2M3BEVElnL1lLWmpRSDlUZGlqR0pFN3ViOG1JSUZhMTM1?= =?utf-8?B?dUlTNFRVWG8wd0tPTkFXRW9DMXdvcUw4eTYxQ3BNSlRWdlR1UlNmdjNOa3Zn?= =?utf-8?B?Qzg3S3R3cW4zRGhUcVFHWFF3NGYwS2V1RWI3UlUzWVlIUnczZE1jMERIYlRU?= =?utf-8?B?TUdYUGR5cHJEQmZva3pPWWdFbGdvKzZLQWlVOVdwZGRpKzY1eEFtTUpkblR1?= =?utf-8?B?RUZHN25ZZG0xQXRiNVQvQjY3TUZueThVK2NpSGVleFBURDZTREVCU24vQWFx?= =?utf-8?B?RlBvVmVhRGtFSW15WXBHT1R2c3ZUMzNIdHJLTHNSV3c3VHNMKzVkbHFLbzlE?= =?utf-8?B?emlhZlc1THZoSVBDQmlsOExFNDRvdHRWR0FoL0puOEU0YjVvTFlpdythRXYw?= =?utf-8?B?NlRrYzhrR0N3eUdBc3IvVDdNM2VqVkRraXdybDRGaXNjQVBUb2k2d0hpQXV0?= =?utf-8?Q?pCq7zBvv5Is=3D?= MIME-Version: 1.0 X-OriginatorOrg: sct-15-20-4755-11-msonline-outlook-1ff67.templateTenant X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DM8P223MB0365.NAMP223.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: 6d97775b-c1e5-492f-8235-08da3d9101d9 X-MS-Exchange-CrossTenant-originalarrivaltime: 24 May 2022 14:23:43.6461 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY5P223MB0515 Subject: Re: [FFmpeg-devel] [PATCH 2/2] libavfi/dnn: add LibTorch as one of DNN backend X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: > -----Original Message----- > From: ffmpeg-devel On Behalf Of Fu, Ting > Sent: Tuesday, May 24, 2022 4:03 PM > To: FFmpeg development discussions and patches > Subject: Re: [FFmpeg-devel] [PATCH 2/2] libavfi/dnn: add LibTorch as one > of DNN backend > > Hi Jean-Baptiste, > > I am trying to add this backend since we got some users who have interest > in doing PyTorch model(BasicVSR model) inference with FFmpeg. > And as we all know, the PyTorch is one of the most popular AI inference > engines and it has large number of models. So, I think if LibTorch is one > of FFmpeg DNN backend, would help the PyTorch users a lot. > > PS, ONNX is not in my plan. I am going to improve the LibTorch backend > performance and make it compatible with more models in next steps. > > Thank you. > Ting FU Hi Ting, I've never looked at the DNN part in ffmpeg, so just out of curiosity: Is this working 1-way or 2-way? What I mean is whether this is just about feeding images to the AI engines or does the ffmpeg filter get some data in return for each frame that is processed? So for example, in case of object identification/tracking, is it possible to get identified rectangles back from the inference result, attach it to an AVFrame so that a downstream filter could paint those rectangles on each video frame? Thanks, softworkz _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".