From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTP id ACBB64983C for ; Tue, 20 Feb 2024 04:16:52 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 5C0DD68D43F; Tue, 20 Feb 2024 06:16:49 +0200 (EET) Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.21]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id CF72A68D3D6 for ; Tue, 20 Feb 2024 06:16:41 +0200 (EET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1708402607; x=1739938607; h=from:to:subject:date:message-id:references:in-reply-to: content-transfer-encoding:mime-version; bh=ZrZOeuTjuXweh63Lk6DGtuSmIiivc/5r/PDKWP7zwt8=; b=loVNCbhsMQxRR+h6WzFgL0HHnNI1EOXNRK5A/Xf5q0Xv8l4GenGN1JaE UIQbPOV3vY055GCJaEnS45oamKjRGVoMgQ/6DzNrykk6pNF+I5A6U3swv W+qBkk3Wr3D/LMdbFACG4H4Tnc2ZCwFMaaSe7Y6IrP747eE4VXH3jM7Mu 2q5TS7dik5K8y1a4aXX7zrOvPQyvrX+rFx7C1CL/jQ7s0CEVRQf02Ov1v L0GdlFQelaw1kNq/siVpurfzzsAt0t8p66qJs9r6Sf0lNxVCFKSXM4pKf HXQazqVuzU/SX9/Q79YuK3eDxXUMqaQN/NnHyZV44CvN/vo8m/49fEYe7 w==; X-IronPort-AV: E=McAfee;i="6600,9927,10989"; a="2393097" X-IronPort-AV: E=Sophos;i="6.06,171,1705392000"; d="scan'208";a="2393097" Received: from fmviesa002.fm.intel.com ([10.60.135.142]) by orvoesa113.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 19 Feb 2024 20:16:39 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.06,171,1705392000"; d="scan'208";a="27812467" Received: from orsmsx601.amr.corp.intel.com ([10.22.229.14]) by fmviesa002.fm.intel.com with ESMTP/TLS/AES256-GCM-SHA384; 19 Feb 2024 20:16:38 -0800 Received: from orsmsx611.amr.corp.intel.com (10.22.229.24) by ORSMSX601.amr.corp.intel.com (10.22.229.14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Mon, 19 Feb 2024 20:16:38 -0800 Received: from orsmsx611.amr.corp.intel.com (10.22.229.24) by ORSMSX611.amr.corp.intel.com (10.22.229.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Mon, 19 Feb 2024 20:16:37 -0800 Received: from ORSEDG601.ED.cps.intel.com (10.7.248.6) by orsmsx611.amr.corp.intel.com (10.22.229.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35 via Frontend Transport; Mon, 19 Feb 2024 20:16:37 -0800 Received: from NAM11-CO1-obe.outbound.protection.outlook.com (104.47.56.168) by edgegateway.intel.com (134.134.137.102) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.35; Mon, 19 Feb 2024 20:16:37 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=KLw5C9FQnVvzaLms6kpkcm2kLYaIY5c+LlWHhGsUHX5QDlHiWoHtw2Bj9ja+LtwbZ+75DtajDkIndsUJYSqceF/o8keo/RlxeUUSUhMvt9JttELYrhNsvbyI41W9HiD768GdSEVSHhe4UHgsfqb+E0ynIx0yHNip1cZqz95SRETBRuhgNZtkM94VVPUURHn1DGWO2vWfbW2PaAa5LKflQpUYTTRL00/a4GFn38ic1hPEfiM6CIxZHiusLOoebNX2DI5XAPDBTQFXAd67nE5H8+Uw7ekOvref1JQOaOLtTrvdGxfCo8yyECnhPVb9zSfKNiCvyj/q75N+ifoDVQ9GfA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=OXTus1FwwCQUqDapv5/XmDRI/Rf5Uar+6zkQ9z0TK/s=; b=cqHHVEu49xL3etG1LX+qKqk7MqU7ECFrUJoKfQ03WMPy0NvBTk8+IaPOMz22QvX216/J/YEgg1Qgg6v9HKS+1zHLT2P6Qx+f49Cai6JNAf5M5uXYbFYDHVSfPerSQYNI4lxoS6s19LtnTHc7S3uEVN1+IeZFhak8FdJ8h3Wlv+zjXS/bVBU/lo6ktRQC6INrd0lzJHZrcbZObpE1zKOx0GUfQxm//MH7SoCd7qsgJy8ZRrnPRAdV88wUAoRwkselJFbs1yIWl1qUeGDOa8D6dcniQfMuM3X7qq3rcUILajNru+6x0MDdK5m8r44CKLA9W3pxX9qdRnN1A0mj79orfg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from IA1PR11MB6396.namprd11.prod.outlook.com (2603:10b6:208:3ab::10) by SA3PR11MB7611.namprd11.prod.outlook.com (2603:10b6:806:304::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7292.26; Tue, 20 Feb 2024 04:16:36 +0000 Received: from IA1PR11MB6396.namprd11.prod.outlook.com ([fe80::204e:5433:6d25:bde0]) by IA1PR11MB6396.namprd11.prod.outlook.com ([fe80::204e:5433:6d25:bde0%6]) with mapi id 15.20.7292.036; Tue, 20 Feb 2024 04:16:36 +0000 From: "Chen, Wenbin" To: FFmpeg development discussions and patches Thread-Topic: [FFmpeg-devel] [PATCH v2] libavfi/dnn: add LibTorch as one of DNN backend Thread-Index: AQHaVak5eneTUGTDGkKt2F8vPj0ybLEI8j4AgAnET0A= Date: Tue, 20 Feb 2024 04:16:36 +0000 Message-ID: References: <20240202072629.1259512-1-wenbin.chen@intel.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: IA1PR11MB6396:EE_|SA3PR11MB7611:EE_ x-ms-office365-filtering-correlation-id: f2345a29-ebad-49a4-cc51-08dc31caba69 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: NXciFmATcXW4UgO3rFcj2yTz0yu+5co9akSW9TRGACpatLfHslOMBYrecAxhCijkwoXnY7gy5ELMx5+VwZDtnEiLy4VnvFdTLMBk9hLFfgUIODKUVbsjZVQTzQ9+83xyM/dHTJmpEbasaNEdL9cESx7OAIV72OgeoFsvUWH5ufGXMepYdtPyEISNuLRQ8AXs8rLnnez1KQuCTtow+pSX7MlekqxPF5UtrTljYnyFRFRQK4r6TMToyM+BxPaRw7kdaDh63MeqWv65d534xSP6mZopbvfBHp7iTGsOsWFTTNRP4x9FrQSsTzXT72B65mrlz0qGqAZVQxt0A3i231TFGxs4TCA/LqgdWJc0VQzvklwFd1oadjFo9mBp7b9x9B605iDcUV5XWZ4IxR29m2MgQh15Mmdz8ue5p/YcrjOofZkb5M/WKA/IINtXIILriGpoXgk0F+pdo6v05WRvZP9OSUlIO4jjxh43Bk9JEruRAU1Nd316BSDHXAv5RxeJOSxQ+LN3UOQO6w9YoDbk6+95Ch8u4qqAQokaowfEpj01iuzsEc7T2lfVaYjBdVK6DFONFn3fKmja4HKojCm05I0kLvEWuJOtMMN4QT8tR9RB0lI= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:IA1PR11MB6396.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(38070700009); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?LusJKeXtGgjYChWDKROEyJpw8vQIH1isQXrc3sYFB9kXR+bPGeeQFnbnA4VF?= =?us-ascii?Q?9zePyC9KKs5NyTF/4AVlZ/6hPE59n8BdG/JnJJlZsRD7ChT8TSarDDNrt68c?= =?us-ascii?Q?oxNbQyvSypJ8Uh5yWyjjZQ+emFcmrmJdm00806gSQ9s8d90qGVCCjf+YsM8V?= =?us-ascii?Q?+2EcR3jxj5GD8F9UW/qmOsQS84fRrxoSvInrexo2ZN4RSRsU5zYPHey3i/nR?= =?us-ascii?Q?p8I6KK4EVyj1f7x9J0v6h2GmGuhD7RYhTOmG19SC6c67iDxxZ9doyXS734X7?= =?us-ascii?Q?dIkCy7G+EYS6155uPwTEDp8ufKI2zrDZwK1/HZJprUo+oDzWtYjiJz15lmum?= =?us-ascii?Q?SrjGqzaB/+/wK/9JbzoHYkJWeQmouflRNvnfQgfz9VXuusC+t3MigVNdoF01?= =?us-ascii?Q?JThruEq9B6Bc9HlmFXaerbxhOx+ze35QX8IRVp2mosL/cPQ38JnAH+1M8GVa?= =?us-ascii?Q?Dlw8L28VAzT7E+hE0Dofbd7Ie1GLuxsPgFIoOtW+gmPs6/CP+kTa6xoYt5HZ?= =?us-ascii?Q?IeJlYEmtAoWWCEKSNRQ6BnC6lrMMp0dy2y6TBVfC09yRiL1esTJPDKxz8WdC?= =?us-ascii?Q?lckXPXgxSyJoaRoAvcxNjcI1OP6eZSxbphnaJlXNahRzKx/owaK+ERay/Qqx?= =?us-ascii?Q?rnSyic9ZaB2JKhByykjkld91zHfs1lYN1UNRWQ8QyDqo/TJSvdvmv2ikDKx7?= =?us-ascii?Q?qRxpKSejU96BA4x6RuXLd6BQhPW+adY513c82A292HTT2zWMDA/5VDic/p36?= =?us-ascii?Q?KfgIBKRMcccaG/jPiFmyecw4Thfbj2Q6cB5VqpkpYltJa/4COYgpBKeijSFg?= =?us-ascii?Q?y/Y4QdZHwXpr9gbPyddk/19UTeO5mHu/PjYgDA8m2oZlrzbBni8UKgan3BYG?= =?us-ascii?Q?zaqxPat9C5wHzg+CJVgvB8oy2DjTvRvaj9OPuOF+XVjhOz9MVtMOvUbgDeC7?= =?us-ascii?Q?mdbF9vA5H7fgJ/Y5S6v3d90BmBdVRfSMGDuftwvwab8kTBGXV/ZrDiAS7Z5A?= =?us-ascii?Q?XWOVueVOB9B9tJWK6Oh4a9bvraatIcDFCj5dwR/OA/a1vSBUMwL0uYWGrC0A?= =?us-ascii?Q?SvlM5KbIo3wRcBQTIYTHhUlKcLKNy3j990XSLMkjNDOwxezlkgIgyTRltgtm?= =?us-ascii?Q?ZwPSpJrHDU4V0iCg2hwwsFvi9yQJqy5NnRPXqseivVOFwKCGDGwZoiDOdLH+?= =?us-ascii?Q?RkmTIvoNOlQhRWr4FIua8v/EBvkGL2BGbzj8F1xD0pWyiBRhtQUlnqFfWglo?= =?us-ascii?Q?pekyw5OuyFZ59SotEWQ/Wdf+XHyxKzxqAGL37M7LUcOUKmhTMP5YqDxvh8uJ?= =?us-ascii?Q?oVk7+aTZY6XY6g+EpiD7WcY9FIE20y3FrvysvsiVGVZbPxb9AmBLicPFlCs8?= =?us-ascii?Q?noBuzLueygK8uTSkOP+KC9NaXh11qMdvOGz2BK9qg+zQ2dLljbsrPPV85tlu?= =?us-ascii?Q?jQbtjttHQcwfV32EmC1uKUJC6UVBYrO9z4cwyx/DHaMGnO3+pkRLFlfWhChi?= =?us-ascii?Q?7e0GCtQgEGeLO+INMFir1wPHgWmg+5fDIF0l7cO+WVEQr30vbeHJNLQrmNT2?= =?us-ascii?Q?jWYzvc6qu69jFSlJbaqOySISkI/7+tFqajUsR+Vt?= MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: IA1PR11MB6396.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: f2345a29-ebad-49a4-cc51-08dc31caba69 X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Feb 2024 04:16:36.0194 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: hCwzkGPeIp5kRXnh+NteGJM47rxBc9XICe0yEJu70R6ZfcP0c9MCDGmm2IRPatqR1Val3xfo8w1/zWjkDc85fg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA3PR11MB7611 X-OriginatorOrg: intel.com Subject: Re: [FFmpeg-devel] [PATCH v2] libavfi/dnn: add LibTorch as one of DNN backend X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: > Hello, > > On Fri, 2 Feb 2024, at 08:26, wenbin.chen-at-intel.com@ffmpeg.org wrote: > > +static void infer_completion_callback(void *args) { > > + THRequestItem *request = (THRequestItem*)args; > > + LastLevelTaskItem *lltask = request->lltask; > > + TaskItem *task = lltask->task; > > + DNNData outputs = { 0 }; > > + THInferRequest *infer_request = request->infer_request; > > + THModel *th_model = (THModel *)task->model; > > + torch::Tensor *output = infer_request->output; > > + > > + c10::IntArrayRef sizes = output->sizes(); > > + assert(sizes.size == 5); > > Why 5? 5 means 5 channels: [batch_size, frame_number, channel, height, width] I only add video SR support, so it only support this type of data for now. I will change the code to be more easy to read. > > > + outputs.order = DCO_RGB; > > + outputs.layout = DL_NCHW; > > + outputs.dims[2] = sizes.at(3); > > + outputs.dims[3] = sizes.at(4); > > + outputs.dt = DNN_FLOAT; > > + outputs.dims[1] = 3; > > Why 3? It is RGB so the channel is 3, but I should use sizes.at(2) instead of a magic number. Thanks for pointing it out. I will update it in patch v3. > > > -- > Jean-Baptiste Kempf - President > +33 672 704 734 > _______________________________________________ > ffmpeg-devel mailing list > ffmpeg-devel@ffmpeg.org > https://ffmpeg.org/mailman/listinfo/ffmpeg-devel > > To unsubscribe, visit link above, or email > ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".