From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTPS id 794694EA7C for ; Mon, 12 May 2025 10:11:54 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id C0C4D68C4B1; Mon, 12 May 2025 13:11:49 +0300 (EEST) Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.17]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 3853F68A76F for ; Mon, 12 May 2025 13:11:42 +0300 (EEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1747044707; x=1778580707; h=from:to:subject:date:message-id:references:in-reply-to: content-transfer-encoding:mime-version; bh=N51NvSJz05g6XwHrqNThRBd/PW4+OwRtOV4dyV6YYuA=; b=ORHrMQVgHqAcQFWR5HupEFNc3PdfefFdBNzQMJc8+i/mcyMtQ6u5QLrS lFOyoaTP61wGDyPL+BotjAALE+5fpE4PlIbfAEIZEtAm9tw0M8HHBNA3X 9mP7EFC0dTwIAXGCXU4aH8SGGgHnujMLMLQSj7FAjvua/vmrrbW8AEjKT 7V3WdaxOlLbEXuTBI1lUBYs8rxzx3I+vGg2gMq94Hn+4fGxaS2j1M0/dO wSfwWk5u7L5OTZj501ikT2D7LUwExdEgFJn52omkmbDrZ34AVrG4qAaw1 RH83xoKKxuquc6hsd9WzPrUUSW8ANsUMZg7GxMXRzlRgOZi+G8cja7yWG Q==; X-CSE-ConnectionGUID: ZqHHsGd7R3OOW3jbL7PZKQ== X-CSE-MsgGUID: qvKbDY+0STSIuBBXaZUcOQ== X-IronPort-AV: E=McAfee;i="6700,10204,11430"; a="48829898" X-IronPort-AV: E=Sophos;i="6.15,282,1739865600"; d="scan'208";a="48829898" Received: from fmviesa010.fm.intel.com ([10.60.135.150]) by orvoesa109.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 May 2025 03:11:40 -0700 X-CSE-ConnectionGUID: srm5XJKxRqS2nWJWR14+FA== X-CSE-MsgGUID: ENGub8hJTLmPThjJWGTE4g== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.15,282,1739865600"; d="scan'208";a="137791510" Received: from orsmsx903.amr.corp.intel.com ([10.22.229.25]) by fmviesa010.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 May 2025 03:11:40 -0700 Received: from ORSMSX901.amr.corp.intel.com (10.22.229.23) by ORSMSX903.amr.corp.intel.com (10.22.229.25) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.14; Mon, 12 May 2025 03:11:39 -0700 Received: from orsedg603.ED.cps.intel.com (10.7.248.4) by ORSMSX901.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.14 via Frontend Transport; Mon, 12 May 2025 03:11:39 -0700 Received: from NAM11-BN8-obe.outbound.protection.outlook.com (104.47.58.172) by edgegateway.intel.com (134.134.137.100) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.44; Mon, 12 May 2025 03:11:39 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=Vv1uHErh6tNTwKF0ykCM8s9X/c/DsdjsXfUVON584bNtl5gGmmFQxBVBK9AwjT90uoN2bY2SEhuf3hgx6lcdC48F2otrhc0MZ/CBKekbJZGb8db+0tbl8xJt5vQY+1kePvjbj5nMrKzLLYkoPwoJxC0yNI6d7a0aoTLEi6TOr3MrUr2G9X0xc7nx83PHVRF25ceax82fiJGCmsH+EoWbNYoukl7fQI2AoURtzZUoU46K+WUrPZClzR1wZYsR6e05fQW9ajIWIMuIy25rM3vYTg0+XbHnGpmR1RTtzabP0q+3iVgi/vbXTnvw9CEW9PVI/MBdZbHADewCC800yyNBeg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=N51NvSJz05g6XwHrqNThRBd/PW4+OwRtOV4dyV6YYuA=; b=W/cNDYWXU4ylE4F5BltTBt71UiBrYyHutct05z4Mwoh3AA9Pmaexkq49cvVI+XHpnigXBf/2X5bAQVBKpbM7KnXHIt8t1Bh4T2uI6wLAm/uifpBz3Z1ETgrvjtcVSGgg/BtWsUDLOo1DwHc9mPsh4bxE99lrX7i38oBItiNMJBKbLbrHSMY1wPD9+ddN/l050oXGiiKhM0AIjqW+qRjbIRke1ZQu+p2Y0OrQTaJfHCTttLnKJywB3P/wN21nQB8uBSw1sq81BL2o9179qITE4fIDc8XZzHmSaN74863OEZRVjKna+F6O+Rae5ZBRW/f0PxMS7b9HKK3e71FxVggDfQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from PH7PR11MB5957.namprd11.prod.outlook.com (2603:10b6:510:1e0::14) by IA4PR11MB9035.namprd11.prod.outlook.com (2603:10b6:208:55e::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8722.29; Mon, 12 May 2025 10:11:37 +0000 Received: from PH7PR11MB5957.namprd11.prod.outlook.com ([fe80::9ca7:5dd5:8a5c:d73e]) by PH7PR11MB5957.namprd11.prod.outlook.com ([fe80::9ca7:5dd5:8a5c:d73e%7]) with mapi id 15.20.8722.020; Mon, 12 May 2025 10:11:37 +0000 From: "Guo, Yejun" To: FFmpeg development discussions and patches Thread-Topic: [FFmpeg-devel] [PATCH v2 FFmpeg 11/20] libavfilter/dnn_filter_common: dnn execute functions for CLIP and CLAP Thread-Index: AduR9jPuviQ39k2UQB6qdzuC/X92mwxL89Sg Date: Mon, 12 May 2025 10:11:37 +0000 Message-ID: References: <003f01db91f6$36603a60$a320af20$@gmail.com> In-Reply-To: <003f01db91f6$36603a60$a320af20$@gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PH7PR11MB5957:EE_|IA4PR11MB9035:EE_ x-ms-office365-filtering-correlation-id: 7575f502-f34b-49fb-d25e-08dd913d6192 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; ARA:13230040|366016|10070799003|1800799024|376014|7053199007|38070700018; x-microsoft-antispam-message-info: =?utf-8?B?eGptV2R0RFB6VFhWTVhJTmd3RDlNcU1jL0lQVXBKd2VaZXZEL0REKzkrQVFK?= =?utf-8?B?RnhiODd4RGZnbHNpWGlmT3hRYTJLQnNnOHJGQTcyOXQwSzlkOEVvT013R2tJ?= =?utf-8?B?UHMyWTFjVmJlUDVRQWNnRXhEV2hDWk05VEU2bFJCa1E5MVdCeTZlRXlaMkRl?= =?utf-8?B?alpmejFHMTVMaEZJaG1qNk9YeUhTdlFpeit5Ly9STTJJVFVGZlBuM1lDZmU4?= =?utf-8?B?VCsvZUd2elFuYjRmNkY3TUxrS051YlJXUkYxczZXcEorUXNXRGJhSDN2VTRF?= =?utf-8?B?cUwxL0hpcGd4SEJPR05pVVlkM3Y2ZGhqby9UNGloOVVGSjRzak5NaEpoL1N1?= =?utf-8?B?aWxZcWIveGxLUVJsb25BcThKQXo4VHo4NWJwQ2haM0Z6dmhlV0dwcUpqSjhJ?= =?utf-8?B?K0hmcGt3aHhxTG9WcVhWZElJd0pYREwxRmFKYWJEZW1FMHNEb0N2NG52R09p?= =?utf-8?B?UmRNMHBYdmtDcllkeERlNjl0SVVuTktWNDlNaHhsdG5xWmEwMGdlRnpiTlBy?= =?utf-8?B?M1dPUDJjM3NsMkxZRnZqYkIyekhUZ0t0dXlaOHF4eW9scWFyU0tiajBwcUI3?= =?utf-8?B?M2NGQWN0UjBzU2tpRW5HQTUreWpjblVkRTJNbFJnWEJUUDVWRHRzUUtYQzA0?= =?utf-8?B?MnNwV2lINjlaVFoxcXNWdXVkbUt2V3IyZUNTVEtKbzJFRTBOS3BKV1R0bW85?= =?utf-8?B?OWtyZmtzdXFZbjdiN2szK05HK2tDTlV6YWg0NFR4Vm50U0JuUUlMc1VQSG9X?= =?utf-8?B?U2xlVjV4YzgyQnA3VUI2YVVsTlh6Y1hpVEFkODdlcWpmcG8zVkNDRnBMUklp?= =?utf-8?B?Q2Y0OFdWT3lwRGpVZU4wZW94OTJqUTBMVFlMOXN3SmUrZEpJbG5VYk01OHpK?= =?utf-8?B?TVVGR1NhTXhpZ0ZXaHhRZ3VlTllPUUhOSVZDZVhrYUlWNzZtb2Q3MHFCU2NF?= =?utf-8?B?c3lSRyswNjcxNE9SVlQwTjFqT0FQWHY3NkQwbERRU2tJSWlqcG1rM2poU3Bp?= =?utf-8?B?ZkR2eUdiVHIyVmNTR0N5aG9YZUlkTU5mK2NkYTk3QzQyOTlwcDQ0TUNyVnJX?= =?utf-8?B?YXhaU21BaU5CbW8vTktHQ09LeGJnYTNCMjRoby8rS2RTRFRSSVhvUWN4L1ZS?= =?utf-8?B?VWhwL29WV2ZxMWN0WmQ0dkpFRHg4ZHd2M09Kd2luMGR6NUdWL0pFWlI4bjd2?= =?utf-8?B?enZyRnlXTVVSREp6UUFIWXowSGovTklRVFZNa1lhRDVtc1R2TlFoY2p4ZEIv?= =?utf-8?B?Snc5Nkt0RHE5eXdTdmVDSkIvdXdOdCtMS091NmtGRUlrYTEwQTRMWVJwc0JJ?= =?utf-8?B?bjJGaGVISm5sNEpac3lTV2NJL2NjclZQTThpSWVqV084SzlySnNTdHZ0dVM3?= =?utf-8?B?MUVheVM4eWYzc1FZQWIxc3plQzlwR0d5ZkVwdFg0WFprb3FvNWlJd2ltTkhI?= =?utf-8?B?OUpITkJyMldXTEViWG5TTnFKMmNkaEJRVHJxLzBkdWFxZ0t0V1lMRlJRYjRR?= =?utf-8?B?YWFxZVM1eDVSaGpMNlo0U2l0VThvUlJCVUJHanBQc25WUmM5aFV6bEtpK0Y3?= =?utf-8?B?QW52bVJiazNBQXl2cjF3aVk3RnQyMCtHOHg5b2taUmphMWtWY1lNK25EMmxr?= =?utf-8?B?Nk5oU1BJSUtQaG9ubU1yYWwwbGxQSnBnUUY0Y2llemJhRFdvdUpFREh2V2dB?= =?utf-8?B?U0VxZWY1TmQ1cEhMM2NUTFh1UXY1dUd6UFVVZ0lCSWcvMzZPVWVvNGt2Zy9B?= =?utf-8?B?L0JERTFvMExmbHZkVU1UQzlqUzRyemlvZmFyTUZ0SzVBdUNrdnFUZms0TUIw?= =?utf-8?B?VjhYOXBWaTZ2aElaWXM4Ujl3RW5hUHpBeUF4QzM3L3FSOU43VFdTTWN6bzJH?= =?utf-8?B?cVJBQStCTWwyWVFhTldON1dOZTBmOGxMbFV2cGxkVVdiNk1nazRSTjJHQ2Fl?= =?utf-8?B?WktXUXdBQkw0Zmt1MmM4cTdnM0JudWp1bzdlUU8wbnUyN2cwS1dPZG4rQWY5?= =?utf-8?B?KzBvcmRhQWl3PT0=?= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PH7PR11MB5957.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230040)(366016)(10070799003)(1800799024)(376014)(7053199007)(38070700018); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?utf-8?B?bW1LTmpKcFhqRER2TzBDQ3BpcTF0N2RPV3Q2NTdlem1NZDBoU3RWaFN3dmVE?= =?utf-8?B?T2dwYmh1YmczM1ZtTC9pUkY5T1F4ZGRsQllEaUs4R0FESm1rcVQ2bkZpaXFo?= =?utf-8?B?SlIwblVManVHMlpZdEhCMHRyVE14ZDhRdGc0UUdaN1MxUE1GQTU2WWlLamVP?= =?utf-8?B?bloxanFXNmkwV05qYXl5RTIrZmh0akQ1WGZYbWwzMHpNMkl1UHBjK1hDRGZ0?= =?utf-8?B?eHpMY2t5Y1JGcFRwOTE0amRoN3J2L2FGZGUxSG04YTNSUzdJeXRVY2dHY1hs?= =?utf-8?B?YmxSMUp0bGhubyszdm9FbUErcVRIZ3gvZERIR25JZndQdEVQd242dFFMZ1Er?= =?utf-8?B?aWx4T01NRENWSVhMQzk2WUdpanhCSVRmUVBpVm9qdTZmNnA3WkhZTjhFdFZM?= =?utf-8?B?ZS9ROENscXlHazVBOFgzdStzcWtTZmNUa3YxY0tncWh5ZTdCRlJoSFpYOEFD?= =?utf-8?B?NHA3RGh4cEwvS2c3bnl1ZWdFbGJUaXJNMit4cThQc0RoSUwwbWZjc05WYVV4?= =?utf-8?B?MVd3VnlCaDR1dFozbmZQMHZBbzlvQktSckt4Ly8yaGZ3NWRTWE9Yby9PWG5F?= =?utf-8?B?N2l1WnJLTzFpL2ZLODQ1Z0d3RDVlTzRtWk5hREVtSzM0amlwQnNYVnh4VzNW?= =?utf-8?B?dzU5ZlRmd3dkdXR3c0xKYW1QZk9jM3V1SHBydXBIY2YzRHF2RWhKdE93NTFs?= =?utf-8?B?TDBwYjE3dHJaOGJXY3hWeWxTd0Q2VlBBNlhMWjBFQzRSQjcvQUxZNFJKcmZl?= =?utf-8?B?bnMrbFF3SjR4ai9JNlc3YnN4eFZDeCtqc3JkdkVkczZlTGF5ZXdNTS8zQklv?= =?utf-8?B?M29tczJYZ0Q3UExFRDhpZ0d0RmxYd0NIL3JjQm4vdkRZMzlNRCs5V2xDV01o?= =?utf-8?B?ZTRyaGpIUWs1NEJsbm5wcWhYaHgydjRMd2JZYXMyMU1ZckNUcFhSbmpqc1VU?= =?utf-8?B?STdqZ3ZjNTZJSW0zWENjVG8zS1l1M1hGa21vVUJtTDhuUDBWMUhPTkVEWXBK?= =?utf-8?B?WFJKaWFYOWNhKzMralNpRnRpdUUyZ0puYXBPZ2grYVhGY1BQSHNYb0VBWlcx?= =?utf-8?B?K3VFeEhZbVVXdHM2ODM2ODc4UjNpRTltTFlSamhKOEpVVnJsaVF1N2VBOGFU?= =?utf-8?B?eEJoUThSSXNvdmlNd2lhNi9BK0dvYXFaOUlSNG9JdGNzNmVOZlI0THMzbWdw?= =?utf-8?B?eDJLZlNrSDdkMGlpZnlDdGZwcW1xOFFIcmF5NmJOZE53NVl5MUUzQjQvTk02?= =?utf-8?B?RWxEeEZLYUlGZUFGSEZXWGQxbjZWaW0xWEErVUpOUGtyN2ZpSEhrNTZYeVFF?= =?utf-8?B?Q0E4bVY2ZytGL2t4dXhuU212V2hxZkk0VkRZSzhLd1EwTVpFSHcrdzRIWWYx?= =?utf-8?B?Z0tHWHF6QXE0ZyswWUlDY05tVkpjSGVIelNvWlVkWjh0aGVzeXpjeVh4clIz?= =?utf-8?B?M0pCVHFNOUxYREtxZmJwTTl0eENCSEtmbGZhLzk3dVFvUndQMXhlZUFZNWpu?= =?utf-8?B?Q29HZnpxTVpRNHRGSEpTek4rak05bWY5cGQvdzRycUNZR0dZWUlvbkZrLzEw?= =?utf-8?B?TkYvMHBqbTFVa0lCRG9ONWthU1JCWWRiakhxTk12ZlRZcG5KYWs3bDFsdERp?= =?utf-8?B?MTA3T3l1bktGRjZFQUlmTmd5Mk5XaGlKclI3aUhRbnQ1SmJVcVRxVTM5Ry9T?= =?utf-8?B?U1NSdElrcDJ6cXQ5QlVzSWpSRVN6Q1MrNGF2T3FtSTI5Q1B1NTRXdTlCTXpl?= =?utf-8?B?MEp2Z3ZNVGRabEhMNkZCTjl3clBBTzhHMC8yMW1EVGJKRUJBWGV0U0tXNi9P?= =?utf-8?B?eHI4Zmw5ZENyL3RObmgvQUJoZXRvQkNqWVVidVoyTlE3eFF0YXBzNzRNZ29J?= =?utf-8?B?UWEveVhVaHRBb2dLaHhhOG14amt1Tk93dkN2aWF2UEpRL0M4d2dFejZBajgr?= =?utf-8?B?VGNKd044UWcxQ2JPVTJFeC9qV05zdjAvRHlUQTBnU2taeEJIRllIbk90VXFW?= =?utf-8?B?SGNBaXY5VEN5bUpyQkQ3b2ErYzBVS0FIR3NLLy9EdWs5dWJwalVCaXowS1ZE?= =?utf-8?B?SFN5NDdUb1hyenV0Q0lobFRmZGNCRGl6Nmc4QWJza3czRTZ5ZFJoS0t2SXEx?= =?utf-8?B?aFN0MHFjbTh5ZEx1cS9mYjFEb0JWS1Z4TTNPMFlrOUtpQ2QrWk1ZZERWK244?= =?utf-8?Q?xsBiEvYxJ4rTU1ibxEzzReeeBWV8AS4tJlNESzeAIxPM?= MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PH7PR11MB5957.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 7575f502-f34b-49fb-d25e-08dd913d6192 X-MS-Exchange-CrossTenant-originalarrivaltime: 12 May 2025 10:11:37.2350 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: j6yNAgwnxMXqLgLpo7vp7UMb7gGVfVhzgas/bGFdarsxnLu7b3mY5MiFqxwp9qFuG/EriwYuR/t2JURv4mnpQA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA4PR11MB9035 X-OriginatorOrg: intel.com Subject: Re: [FFmpeg-devel] [PATCH v2 FFmpeg 11/20] libavfilter/dnn_filter_common: dnn execute functions for CLIP and CLAP X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: > -----Original Message----- > From: ffmpeg-devel On Behalf Of > m.kaindl0208@gmail.com > Sent: Tuesday, March 11, 2025 3:54 AM > To: ffmpeg-devel@ffmpeg.org > Subject: [FFmpeg-devel] [PATCH v2 FFmpeg 11/20] > libavfilter/dnn_filter_common: dnn execute functions for CLIP and CLAP > > Signed-off-by: MaximilianKaindl > --- > libavfilter/dnn_filter_common.c | 81 +++++++++++++++++++++++---------- > libavfilter/dnn_filter_common.h | 34 +++++++------- > 2 files changed, 76 insertions(+), 39 deletions(-) > > diff --git a/libavfilter/dnn_filter_common.c b/libavfilter/dnn_filter_common.c > index 899e869cca..f3117748ae 100644 > --- a/libavfilter/dnn_filter_common.c > +++ b/libavfilter/dnn_filter_common.c > +int ff_dnn_execute_model_clip(DnnContext *ctx, AVFrame *in_frame, > AVFrame *out_frame, const char **labels, int label_count, const char* > tokenizer_path, char *target) > +{ > + DNNExecZeroShotClassificationParams class_params = { > + { > + .input_name = ctx->model_inputname, > + .output_names = (const char **)ctx->model_outputnames, > + .nb_output = ctx->nb_outputs, > + .in_frame = in_frame, > + .out_frame = out_frame, > + }, > + .labels = labels, > + .label_count = label_count, > + .tokenizer_path = tokenizer_path, Why we need tokenizer_path to execute model since it is already initialized in load_model_with_tokenizer from patch 10. > + .target = target, > + }; > + return (ctx->dnn_module->execute_model)(ctx->model, > &class_params.base); > +} > + _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".