From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTP id DCF18448D1 for ; Tue, 3 Jan 2023 09:10:47 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 3662268B59C; Tue, 3 Jan 2023 11:10:44 +0200 (EET) Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 1291568BBD2 for ; Tue, 3 Jan 2023 11:10:35 +0200 (EET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1672737041; x=1704273041; h=from:to:subject:date:message-id:references:in-reply-to: content-transfer-encoding:mime-version; bh=L92nVdzjwa/Uv/xVbEHc8uI0W72l1YV8k8JuI7ikAPI=; b=jq1Ucs39xcQKFYLRW2cyDVmMvbRkkpcKSPyX+OXEibPeASAX39mUly9l fTXcIoWfFfdHzq//09iMELLSb2XBMLInFjuXGJLjONNY0ojtjhqWoJXge kz14Q1DJQiILhkH85tS1NA76pI2CZqrmvo8Onxp9u/IFbqqSbCZFuu4uF 1rgKrczfw85XaOaCfAOJwRGJmX/krNyyQOlJlJg+wyL7Qjvob7JwuwIo5 6ZKt1l48UNOIJZ88k821y91KiB/08xipKdRtcxMRkR1smJbUrJCPmV2Yo mEK3xY3qKFLp2OulHKObapSM9OYUY5SkAAtChjv7dF8eg9cHaV20BYZcH Q==; X-IronPort-AV: E=McAfee;i="6500,9779,10578"; a="386055376" X-IronPort-AV: E=Sophos;i="5.96,296,1665471600"; d="scan'208";a="386055376" Received: from fmsmga005.fm.intel.com ([10.253.24.32]) by orsmga105.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 03 Jan 2023 01:10:32 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6500,9779,10578"; a="983511211" X-IronPort-AV: E=Sophos;i="5.96,296,1665471600"; d="scan'208";a="983511211" Received: from orsmsx603.amr.corp.intel.com ([10.22.229.16]) by fmsmga005.fm.intel.com with ESMTP; 03 Jan 2023 01:10:29 -0800 Received: from orsmsx610.amr.corp.intel.com (10.22.229.23) by ORSMSX603.amr.corp.intel.com (10.22.229.16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16; Tue, 3 Jan 2023 01:10:26 -0800 Received: from orsedg603.ED.cps.intel.com (10.7.248.4) by orsmsx610.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16 via Frontend Transport; Tue, 3 Jan 2023 01:10:26 -0800 Received: from NAM10-DM6-obe.outbound.protection.outlook.com (104.47.58.106) by edgegateway.intel.com (134.134.137.100) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.16; Tue, 3 Jan 2023 01:10:26 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=l7HT9QWzsYK12Ikj46T8sx6GR62pxGOE6HF/FV/yBUqSJhhaNtTi8hy5ASIzrLAeUFToF6fPheqZz1eu/S6eeuFjAKAYOg1HtBBxX+3jAJWa0gbxqXf4EHt4CGiA0cdkUOpZEH709KYDjJTRwwnkdKbg3PzOviZ1jvM4FEPlq7xoM7gsLH9eY7X7P9xKgiEF0guXz4hnsgm6D4AJrYjf/e0SlMl31bJ2dIVyuHBgaJnEPYAaR5YehioVsr9l6EU88Gp5bQxWzYel8ZgdmyKYCsznZ3p46EOveXrnL4nGnBmUqaVwxw9qLZPQoZkjIKySkq4YkSbMx0ysxRNepT017A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=adyAau24rV6rYicK2+31YGZVNt6qsjmRTzX3RRYK0pY=; b=KebLBIkgynzZ3IJg7uzoBfPM5o6GYgQGPxR9+YACZWDwz8jQ8suZjNEjzjduOYxicl/dqGMQNWMf7XZT5N+jddNM2TMwuoDgOXO9cNCbP/36HHtw4OWfuyAyZQCk9R356Mnllk1UXQdeIG12twlA+zAvQf+jyQe/HHowuCmIqnCXjVYV470ozNuCt7JK+196lj+PJkaC0hT7apGMaQX16D2h7dPyzPZAgJ04EZgFIQ4LEwSl7blvGUA/1YWeqCSn6acNwYKsZj8UkH/366YFSGBSJsF5aQ+O3hoRw39W6M+Ca4Wi/15P//+mnKWdpRHJ3onLqsrmsgluTgwr7cpvkQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from SN6PR11MB3117.namprd11.prod.outlook.com (2603:10b6:805:d7::32) by CO1PR11MB4818.namprd11.prod.outlook.com (2603:10b6:303:93::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5944.19; Tue, 3 Jan 2023 09:10:25 +0000 Received: from SN6PR11MB3117.namprd11.prod.outlook.com ([fe80::c110:2a9c:ca6c:5f16]) by SN6PR11MB3117.namprd11.prod.outlook.com ([fe80::c110:2a9c:ca6c:5f16%4]) with mapi id 15.20.5944.016; Tue, 3 Jan 2023 09:10:24 +0000 From: "Fu, Ting" To: FFmpeg development discussions and patches Thread-Topic: [FFmpeg-devel] [PATCH 2/2] lavfi/dnn: Remove DNN native backend Thread-Index: AQHZHC1H1On4NERQ6UyeFwPDpubLM66JXNyAgAMJ9PA= Date: Tue, 3 Jan 2023 09:10:24 +0000 Message-ID: References: <20221230084256.23865-1-ting.fu@intel.com> <20221230084256.23865-2-ting.fu@intel.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: SN6PR11MB3117:EE_|CO1PR11MB4818:EE_ x-ms-office365-filtering-correlation-id: e8c78dec-6c0b-4661-b707-08daed6a595e x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: V/tc8BI+8eoh67Yz+VaBQiyF5jgZ4viBBZOsqAb9ck9ToxfgvHg7gZjJID0Gt9FdipNa9rSYNJH1QR03SpFi/21gHVPpCS9lG8C2xF6H4vItca8ZC5TPM3D0t9GiyQYmvMLz4lhP0aee0/WvBeB7cgb1NAdfhAjGfLqJOEQqHDyW+xFWfPE1TTRZjyrWKCW8EJz1kdfONgW6Z6iTiX8YvgAz075QqXLbfwE6DqxZrrnb47IeevlNvY1zShy8A0MAoyFL0l5OYWGUu4phe56tIQBAtPhUeFIZcv4KIdO5ghYwNpwRxEI9KzpmRy2jCORckl7iAt8XvjRvMW6NNZ4O/E+dbJcqh188F1HizYHwqvGsCUkjoG01LyvfgZrmHcmPgmw0SdrQzE3aEV83yAV0tLWSfd257LS0bFEyVKXh9UtIwe8qzFtursziXplGCxRzCpUpSI3kWCsgIkMX1c+MZbg1DdWyzOInq9y430GgM3KjR57IUkouNyLTGSC6rhoq2TtU2OkcWLhXiMFeh2qJq+xl9Ng4viWruSsWKsxN8ctaM5GyTEjfL2uJ/JodwHBLJFUgfM1VDgb0ftZ4HVx1VoTe2iLQjTh7w2So5L/hpbK8Yb/m9AGlt97L8Fkzc8DP0n3+CfYg2l6WJEpmETtuExdIHOme+509xhTF9z+pmLWmbZ8krnI6GZb7l2lejIyIG/jKLWUIR36D5TVsJRr2T1M4dqpRrBaYTUAT3dPzTAGBGGe0Zllels+wNdgJQXpy x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN6PR11MB3117.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230022)(136003)(376002)(396003)(346002)(39860400002)(366004)(451199015)(66899015)(9686003)(26005)(186003)(8936002)(55016003)(83380400001)(33656002)(71200400001)(53546011)(478600001)(7696005)(52536014)(6506007)(966005)(6916009)(316002)(66476007)(8676002)(76116006)(66946007)(66556008)(66446008)(64756008)(41300700001)(38070700005)(38100700002)(122000001)(5660300002)(86362001)(2906002)(82960400001)(22166006); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?8oauXHh7vLKqUsPikBFxs61aHtl4OZMgybdIw1cCEGzbnlNpztBXH87OUSja?= =?us-ascii?Q?Yn+95Tuvi1Irt3uOGg/9wWjD/GpbeI6myU34GPiKkjCLY7r3psley6/Xb4Fr?= =?us-ascii?Q?5685rO3TUe3iCKtWqSUecAW3ozHQ05/R47pBCNNciQ2QVaUhXeoaPi7A8mjG?= =?us-ascii?Q?NKpBHIDcd7mf2fIz4n1kvVJIGB1KQFgJWbcHEDcHWnWCYZ5/WQCySpe0hbv0?= =?us-ascii?Q?jNhLPhxxe34CxzCJBreAXk+n+u7HgEqOM/vWvTIia4kSsOGgSzqhXBBKy4xe?= =?us-ascii?Q?gvOv+Ya7tOeww3iDNcVWLO9BHQZCHOaKS0mOi1dPzu32m02Q7jWDfhArU/0P?= =?us-ascii?Q?bXC6bWoKIMWLUF6BjQdeJXIbFyM/wpeUI8a06AVenAo80ehp7tfDwMLbxSWZ?= =?us-ascii?Q?tVse/33TaYBgquCcqs+oSIFALek7hnaE2q8w7nj8kM6dd6bu3bAJIpMDtzIq?= =?us-ascii?Q?EMcxPsiqaAvog+WawMosau36eWPAybtc2ZzcJzZIdkFckzCJI/GtbqQ729c7?= =?us-ascii?Q?7vkCkJRVGiRBFM9E7XKEgMyu73UK/FeW3/ot89JkYsyXFMn33c/9P1g4y5Yb?= =?us-ascii?Q?ORhNgL8+raQXD02dt1H3I9ckEz1YiUZbVFmFOpg3lzEapM0lTjvYLHCnXrGS?= =?us-ascii?Q?GpY2nQI9ylMG5ASbVb/aaK9ZOetTd+6pyTVNvGE7n8FIoIXolnN66lQnjT17?= =?us-ascii?Q?XhnxMVwqzAh5HXbDHfs9CgAE6dJvcQlhB7khDrvxl+XZpznjLj+2ws8l4mYj?= =?us-ascii?Q?Z2ucp5nMxGPs+63I7YDuoPq+gV/4m2GxmTWIXbUOYMZb5m/K7reWU4+DoiQD?= =?us-ascii?Q?bkFIhzJn5WHNphWsGIC0qtEvvRZdZD2epRRJSmOKF2HiG7koSy5tWp8cdHtc?= =?us-ascii?Q?KmFBV/zWytrOr/ZpTJxVWqIghuCar2H0Ab6ERTRb/FYa1o52I1aZpC5fvXu0?= =?us-ascii?Q?VlSOSgPgYC6fIU2VBsFn/+hNwt0U5uMXnqiHPxroZwDCIDjr/mJU2+pA2k70?= =?us-ascii?Q?ynsFtmotCf4388diD1IbDypc37+lZcPTBE06QLjlpxwuKzwXMDlMA1muBDBi?= =?us-ascii?Q?GLUva2EYcH4Rrkzuh1Q2o0eJrfUNaxonHLNbRKGeGCV51yLfFTVhQuLO/e/I?= =?us-ascii?Q?boD+joVz1SKiYJOGM9z4yW8Y78UNqrDmQp7KCd7cglJKIT43Ersja59Z882Z?= =?us-ascii?Q?3L56wqxpdr3OV+1FR62O07gzobblMqrS4JfoEyyPwK+OrjcgXtjZXJ9IPHoL?= =?us-ascii?Q?QSlmae2HUKa75CmrKucTWQMKzknQbmXWARfPaPAp6/u9DASKNjRSTQuaNuZp?= =?us-ascii?Q?ulfxnjY68eufAPfVpShYJYyjQyRj/qzDQUfnBge30zlBWutl2b3TnyAhLBOC?= =?us-ascii?Q?4lcRGim0MywV+YQ2xHi2Uyzqw4ZsM3O+PDc++X/fWdVUyWP8ghFyPm5IM89D?= =?us-ascii?Q?Ul29Ol/0/qrkO9/vpnHcxTO+z9mng9pS74PsSQPU833TTlFw6GCO3E8d1bGM?= =?us-ascii?Q?PDNvJg4JoqPqe7RjLrAvncBd281HftDDh8MPnn72QazldjDorIR8ifNXQ+ia?= =?us-ascii?Q?Vls1RyKLa8LbyFBaNkQ=3D?= MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN6PR11MB3117.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: e8c78dec-6c0b-4661-b707-08daed6a595e X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Jan 2023 09:10:24.7886 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: o9W0VqfUw7E893kPvoc16lYRq2s9tpjCUo/Tp0/oo6GYWjkiC/MWPPtCukoiMxNz80PcRYYMfo8dAU+2+24sSw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO1PR11MB4818 X-OriginatorOrg: intel.com Subject: Re: [FFmpeg-devel] [PATCH 2/2] lavfi/dnn: Remove DNN native backend X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: > -----Original Message----- > From: ffmpeg-devel On Behalf Of > Marton Balint > Sent: Sunday, January 1, 2023 06:20 PM > To: FFmpeg development discussions and patches devel@ffmpeg.org> > Subject: Re: [FFmpeg-devel] [PATCH 2/2] lavfi/dnn: Remove DNN native > backend > > > > On Fri, 30 Dec 2022, Ting Fu wrote: > > > According to discussion in > > https://etherpad.mit.edu/p/FF_dev_meeting_20221202. > > The DNN native backend should be removed at first step. > > All the DNN native backend related code is deleted. > > You should explain why it is being removed. The cited URL is not giving > any explanations. > > Thanks, > Marton > Hi Marton, Hope the email here can explain: http://ffmpeg.org/pipermail/ffmpeg-devel/2022-December/304534.html As I noticed, the native backend only supports a few models, which was an outcome after many layers' implementation in FFmpeg DNN module. Naturally, it would take many other works to support other models. What's more, due to its' ordinary, unsatisfied performance, almost users choose other well-developed DNN framework for inference. I believe that's the main reason to remove native from DNN module. Thank you Ting Fu > > > > > Signed-off-by: Ting Fu > > --- > > libavfilter/dnn/Makefile | 10 - > > libavfilter/dnn/dnn_backend_native.c | 561 ------------------ > > libavfilter/dnn/dnn_backend_native.h | 149 ----- > > .../dnn/dnn_backend_native_layer_avgpool.c | 147 ----- > > .../dnn/dnn_backend_native_layer_avgpool.h | 69 --- > > .../dnn/dnn_backend_native_layer_conv2d.c | 265 --------- > > .../dnn/dnn_backend_native_layer_conv2d.h | 68 --- > > .../dnn/dnn_backend_native_layer_dense.c | 151 ----- > > .../dnn/dnn_backend_native_layer_dense.h | 65 -- > > .../dnn_backend_native_layer_depth2space.c | 102 ---- > > .../dnn_backend_native_layer_depth2space.h | 72 --- > > .../dnn/dnn_backend_native_layer_mathbinary.c | 193 ------ > > .../dnn/dnn_backend_native_layer_mathbinary.h | 54 -- > > .../dnn/dnn_backend_native_layer_mathunary.c | 156 ----- > > .../dnn/dnn_backend_native_layer_mathunary.h | 92 --- > > .../dnn/dnn_backend_native_layer_maximum.c | 83 --- > > .../dnn/dnn_backend_native_layer_maximum.h | 44 -- > > .../dnn/dnn_backend_native_layer_pad.c | 268 --------- > > .../dnn/dnn_backend_native_layer_pad.h | 43 -- > > libavfilter/dnn/dnn_backend_native_layers.c | 42 -- > > libavfilter/dnn/dnn_backend_native_layers.h | 38 -- > > libavfilter/dnn/dnn_backend_tf.c | 368 +----------- > > libavfilter/dnn/dnn_interface.c | 10 +- > > libavfilter/tests/dnn-layer-avgpool.c | 197 ------ > > libavfilter/tests/dnn-layer-conv2d.c | 248 -------- > > libavfilter/tests/dnn-layer-dense.c | 131 ---- > > libavfilter/tests/dnn-layer-depth2space.c | 102 ---- > > libavfilter/tests/dnn-layer-mathbinary.c | 214 ------- > > libavfilter/tests/dnn-layer-mathunary.c | 148 ----- > > libavfilter/tests/dnn-layer-maximum.c | 71 --- > > libavfilter/tests/dnn-layer-pad.c | 239 -------- > > tests/Makefile | 1 - > > tests/fate/dnn.mak | 45 -- > > 33 files changed, 6 insertions(+), 4440 deletions(-) > > delete mode 100644 libavfilter/dnn/dnn_backend_native.c > > delete mode 100644 libavfilter/dnn/dnn_backend_native.h > > delete mode 100644 libavfilter/dnn/dnn_backend_native_layer_avgpool.c > > delete mode 100644 libavfilter/dnn/dnn_backend_native_layer_avgpool.h > > delete mode 100644 libavfilter/dnn/dnn_backend_native_layer_conv2d.c > > delete mode 100644 libavfilter/dnn/dnn_backend_native_layer_conv2d.h > > delete mode 100644 libavfilter/dnn/dnn_backend_native_layer_dense.c > > delete mode 100644 libavfilter/dnn/dnn_backend_native_layer_dense.h > > delete mode 100644 > libavfilter/dnn/dnn_backend_native_layer_depth2space.c > > delete mode 100644 > libavfilter/dnn/dnn_backend_native_layer_depth2space.h > > delete mode 100644 > libavfilter/dnn/dnn_backend_native_layer_mathbinary.c > > delete mode 100644 > libavfilter/dnn/dnn_backend_native_layer_mathbinary.h > > delete mode 100644 > libavfilter/dnn/dnn_backend_native_layer_mathunary.c > > delete mode 100644 > libavfilter/dnn/dnn_backend_native_layer_mathunary.h > > delete mode 100644 > libavfilter/dnn/dnn_backend_native_layer_maximum.c > > delete mode 100644 > libavfilter/dnn/dnn_backend_native_layer_maximum.h > > delete mode 100644 libavfilter/dnn/dnn_backend_native_layer_pad.c > > delete mode 100644 libavfilter/dnn/dnn_backend_native_layer_pad.h > > delete mode 100644 libavfilter/dnn/dnn_backend_native_layers.c > > delete mode 100644 libavfilter/dnn/dnn_backend_native_layers.h > > delete mode 100644 libavfilter/tests/dnn-layer-avgpool.c > > delete mode 100644 libavfilter/tests/dnn-layer-conv2d.c > > delete mode 100644 libavfilter/tests/dnn-layer-dense.c > > delete mode 100644 libavfilter/tests/dnn-layer-depth2space.c > > delete mode 100644 libavfilter/tests/dnn-layer-mathbinary.c > > delete mode 100644 libavfilter/tests/dnn-layer-mathunary.c > > delete mode 100644 libavfilter/tests/dnn-layer-maximum.c > > delete mode 100644 libavfilter/tests/dnn-layer-pad.c > > delete mode 100644 tests/fate/dnn.mak > > [...] > > > > _______________________________________________ > > ffmpeg-devel mailing list > > ffmpeg-devel@ffmpeg.org > > https://ffmpeg.org/mailman/listinfo/ffmpeg-devel > > > > To unsubscribe, visit link above, or email > > ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". > > > > _______________________________________________ > ffmpeg-devel mailing list > ffmpeg-devel@ffmpeg.org > https://ffmpeg.org/mailman/listinfo/ffmpeg-devel > > To unsubscribe, visit link above, or email > ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".