From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTPS id D21B54D086 for ; Sun, 16 Feb 2025 06:09:12 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 5E38F68B206; Sun, 16 Feb 2025 08:09:08 +0200 (EET) Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.9]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 44AC368AFFF for ; Sun, 16 Feb 2025 08:09:01 +0200 (EET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1739686147; x=1771222147; h=from:to:subject:date:message-id:references:in-reply-to: content-transfer-encoding:mime-version; bh=eVTn98X1mDfRH+TpDIpd+KDJoeU4sl/gqyaUZbNL9tU=; b=Z6TZsBTJkUilogBONxiUbp3UxEuy9N1z5/GCd5ufhvWeZm2MnZMlV9Nn 3DeJ/DsV+tCBn8X98RJlUXZub+p98VMJIQofANdlp2vmWs/V00entPVvA nESzrpc01//Dz8jEQ81UHcCogZI+GCztJM0qF9xytozz+d1ACy5laz0/f nOl7z4O80YgFZ9KRqor6lJjdKdeL8tUoH3FPcG3RqsPJLN+mjMezXr0pH mbapbFPNHKGzkjO18PvUu093HkX5ucDaInOIJtGHFL6oLsySlnxgwicMd 69cEoRZml6mObplafphUPZbHaARhYfruiABfjGI7k15+8r61mVL52epyL Q==; X-CSE-ConnectionGUID: DGZkomd0Sx+ashej61U7lQ== X-CSE-MsgGUID: jpLHdQq7SEKp4p5e4QRgrQ== X-IronPort-AV: E=McAfee;i="6700,10204,11346"; a="62863634" X-IronPort-AV: E=Sophos;i="6.13,290,1732608000"; d="scan'208";a="62863634" Received: from fmviesa005.fm.intel.com ([10.60.135.145]) by orvoesa101.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 15 Feb 2025 22:08:59 -0800 X-CSE-ConnectionGUID: 6GssOFVPRCO6rkTg67LQOw== X-CSE-MsgGUID: GwRv7/I2Q4aIs5kZYmdxrg== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.12,224,1728975600"; d="scan'208";a="118459684" Received: from orsmsx901.amr.corp.intel.com ([10.22.229.23]) by fmviesa005.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 15 Feb 2025 22:08:58 -0800 Received: from orsmsx601.amr.corp.intel.com (10.22.229.14) by ORSMSX901.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.2.1544.14; Sat, 15 Feb 2025 22:08:57 -0800 Received: from orsedg603.ED.cps.intel.com (10.7.248.4) by orsmsx601.amr.corp.intel.com (10.22.229.14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.44 via Frontend Transport; Sat, 15 Feb 2025 22:08:57 -0800 Received: from NAM04-DM6-obe.outbound.protection.outlook.com (104.47.73.44) by edgegateway.intel.com (134.134.137.100) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.44; Sat, 15 Feb 2025 22:08:57 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=I+qk6JFZl6XvQgD45RQTQ3wSWip8w5E6sFIBgkNHcm/tUlM5fJbeqS6s727iS4VmFoJLB30n2/0b4Kpwiv7dk2H7gJJQfEebugkrv2LEidjCndyt8q+/iZbLQ1bq3iaBNzevwFSW6J31g8usDH98x7Ha/oAf7YTOKoqLkUmpg/v24/wRJichbPtK7CLtseQtcUkAe2FxgMrD8cJxLJ3HcHiVxWaXu9XHVVgjROWrlXOIst+loQ387hREd8yoJOoRNZDyRa3N4a2zxY/nn+s93H6v3izL98/0Z+3VKT/JDb91Bcc2j9S7UbBA4GrUvSz/oVjesFUcrJIl+hfqGK1kyA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=eVTn98X1mDfRH+TpDIpd+KDJoeU4sl/gqyaUZbNL9tU=; b=okAxp8AEOHf/e/wLiqiiA2bAMwI98Eg6Wa3KArLKS0srTl4CtBilqK0pTJUxftOmaPvzYF1NeV6VpmHpUTEDAqkDdSd+mEHd2+zkBk38xUjl1a1qHW50vtc6k1aDmOGhSZ1Gi8sVmiO38q8zrMU8zmelxPIvQ0bIw66qidMLcifHR3ZRQFlFG9aTbNYI6mXzNX0TvZnLLI2oT0uDvp2cGgCVsynzBPISIMXvxM3v5ZT2qo3luIqhNADKBttch2mmJFKorxzxXchF9SNGI3WhDv92ZlPL3r990JQh2byWEiby/dO8FCJwFZs9uAzf3UZolRT/mbPyjCjw42+maxUpdQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from PH7PR11MB5957.namprd11.prod.outlook.com (2603:10b6:510:1e0::14) by IA1PR11MB7943.namprd11.prod.outlook.com (2603:10b6:208:3fc::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8445.19; Sun, 16 Feb 2025 06:08:28 +0000 Received: from PH7PR11MB5957.namprd11.prod.outlook.com ([fe80::9ca7:5dd5:8a5c:d73e]) by PH7PR11MB5957.namprd11.prod.outlook.com ([fe80::9ca7:5dd5:8a5c:d73e%4]) with mapi id 15.20.8445.015; Sun, 16 Feb 2025 06:08:28 +0000 From: "Guo, Yejun" To: FFmpeg development discussions and patches Thread-Topic: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image classification using CLIP models Thread-Index: AdtyhuRcwdeGikTTTrap4GomiMz7rQABg6HQA2r0iPA= Date: Sun, 16 Feb 2025 06:08:28 +0000 Message-ID: References: <001701db728d$09fa37b0$1deea710$@gmail.com> In-Reply-To: <001701db728d$09fa37b0$1deea710$@gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PH7PR11MB5957:EE_|IA1PR11MB7943:EE_ x-ms-office365-filtering-correlation-id: 07a830af-c823-46c7-f0af-08dd4e5054a9 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; ARA:13230040|376014|366016|1800799024|7053199007|38070700018; x-microsoft-antispam-message-info: =?utf-8?B?UlExUFJsemc2RmdWVVZxcTVuZnRBVjJOLy9PdzEzRytwR1VFb2Y3YmQ3SFla?= =?utf-8?B?RXFyeHZKY1Z4ZFBIWnN6S2Roc2cwN0VDRFBXaGRpVno1Vmhrd0d3bjNXMFcr?= =?utf-8?B?VUdUeUVPdm1PNWRRNVJXMThoUUhBVElxWHlUTDg3eHBNRFViclNVa2t4bHZM?= =?utf-8?B?QXpibS9WWU5yRU5pOVBrOHBCa3J4SlpPdm5hd0JQR1ZwTDJvcDFyaWhraThK?= =?utf-8?B?ZGxrQUlUUk1JNnRJLzBRZURMTEpDNko2U29yM3ZWYm14QU5KZ1pJMytXSTNO?= =?utf-8?B?cTBIZ3loUEhlNmwxWE9DQkxKMTJmSVlzT2kxRHhEZ1JYSE9KNjJraTNzYUZs?= =?utf-8?B?QUEwTVh1Ym1iSVBGcVBBRDBwejFJc3IwMkNKcURZK0hNVi9iZzZtNzFqT3hx?= =?utf-8?B?UEd2cnZheUlGNS9SYXRLNDhmTk1nbU5lYUdzdTBBdUdlZnVYZzJVWkJ5cGVW?= =?utf-8?B?bGRkeStTSjZCU2JOS3l4c3ovZkNvTlRSK3lrZDFua2hLVnk2MDZjWGlKWmVl?= =?utf-8?B?WHJzc05BS0dSSkhTdFJFZ0RhWDh6a1VaV0pXdFFpblA0OUhaRnpYRWZTVkVr?= =?utf-8?B?MXlnVzdaVUVHbnRTVDVDRlVuOWQxbEVmOXgwZUpQaWRGaU1tQ3cvak9CT1lm?= =?utf-8?B?NzB0SzdiTGxQMGlZbFdsUXd4MUJVSnhFWkdJS3NiVE1pSi9lOVJFeFN4amhz?= =?utf-8?B?T0JpQjhTVElJVXZhNHVaS2xFNWJSclp6aVpMa0NSWHZUUGFpbUUyK2VvSjNZ?= =?utf-8?B?cG96Q0ROaGhMSGY4Vk5YY1dxWC9hajV4a05GZElkcmZIaCtMbnVhdUpKcG9O?= =?utf-8?B?eXQyL0gvZmdSVmhyMEJYazREVkZ6V2tIWEpkcmJ3Z0RUelRXRTVkaTZLZEVH?= =?utf-8?B?MkNVT0l2MjVLazUrbXpTNjVyZm9OS0lsMHVhZHhTTkFDMjhtSzRJV2RTR0tl?= =?utf-8?B?SE9pSm10RDFvb0JSN0pyVEJxVGpQQnhneXN2RiszOXc0d3gwc3orbktYbVZT?= =?utf-8?B?dC9IaTFnZTAwZFh3NGRrU2FoWVMzOWJ1SXkwc2h5Z05MZnRzZW40Rk5RSjBQ?= =?utf-8?B?amw1Y3VBM1RmK2VXUHNubkhlaDJOWHpkL3ByeWJocnNMQUlWVG1BWWszc29S?= =?utf-8?B?VUFvUHdFUGI5S0VGZ1E5Zi80QnJaYkc4VlR3Tm9mRmRmOW1McWhoUVp1K0o5?= =?utf-8?B?QkU3ME1Tb1QyNW9yaGVGWGZyaDlkRmEzU1ptbEowcWFXQmtFa3FmVmRweW93?= =?utf-8?B?SkhCdFgremFjM3hTc2RiTzRBNnhGbmxNS3QxWVJKc0dZWUNmZzQvTlRheHov?= =?utf-8?B?ZW03OEVoUjZYMkZNYzJzZDRBeFNCWnEwUWJnb0MvN2c5Q0dEY2lSd28wOCsr?= =?utf-8?B?S24rWVBrVUlteDlSZVV1S3NVQjdCd3lwazdVOUN4Zm5QM0UvU0V3ZjBYVDAv?= =?utf-8?B?NzBUaS9ZdXBXbG5NR1Z2SnJ1clpuYWR4Q2UyTUNsUXBZKzBibmsrSWw3MTVY?= =?utf-8?B?SEVBaVJWTUZHQXIzRU1TbDdUT1VkQ0xka0dYMlJMdHJpWFA0bUFWL3dMUjlz?= =?utf-8?B?TjlvQ1hURmN5ZEFGRWxMcFZYWmRHZ2Nkcy8vUDVDWG93V1FnMUNzb1JsdVpF?= =?utf-8?B?Qm9tOUhLbHR1ZGlxL2F5QzFyQkJoSVB0aGFubno2YlVjZFd6czF6dGRRZ2xW?= =?utf-8?B?Y3hJQkEwNWNkSFNaMFoxdFRFSnRmUm14NDIxQWtEWVRMMy9iTDl0d01LcHdN?= =?utf-8?B?WXd4SFV6Y0hKTzBWRE9IZUpPMlJUSWJLcHRwZDhDeFU2d0d6SlRtRlpZdm12?= =?utf-8?B?cnMySk5EVVZYY0U1QUZPVWVSRGFxRCt0RTRvZDgyOXVBS2RublpndGFaSVMy?= =?utf-8?B?dGVqSXhhVVg5dkJ0MjBuNHczK2dJN1h0VExHdUtYbWZSb2c9PQ==?= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PH7PR11MB5957.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230040)(376014)(366016)(1800799024)(7053199007)(38070700018); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?utf-8?B?QzE2NGpMSGRvK0lnU1FRL2FzOC9OZlZPWUdJdThwdmNYdWFGb2NqZC9DeG5k?= =?utf-8?B?S215RUd1Q3hldUUyYy9CUkk0MUordENra1ZDa3BoWTBiM0FrMy93SnZ0OXJX?= =?utf-8?B?a0F1dm5qbTBBNFRySm9jdHlGanpOZHF3S0g5ZnRNcWNaN2FxVExFdkJ1NEFJ?= =?utf-8?B?Rlg5aHBlTmdYUDQ1RUw2Qyt3UDZ3ZkxMZFY5MlJBbytibkNDVWtEWVJYNkpH?= =?utf-8?B?MjVoZnU3blpDTUt0UEJCSDlIOEh5ZUxNN1Z4d2VuWDUxc2NlOGJCT0x0RFdT?= =?utf-8?B?UVltZHluSEorOXQ1NS8vNGpWOFpqL2hKZkJhWWk3V1c2M1dZWlZGKzBZQVB2?= =?utf-8?B?Skt1TGxtSEF0THA3WTZoOFFVb2hIdHZQdHJYQzRqdHlQbFdSM2M4T1dsdWh2?= =?utf-8?B?bEpBVUhacmRwdkhxSDA1dm1IYnVyRlk4QVNqbXhVWlREL1RPcGpMYldwVDdm?= =?utf-8?B?dE93NXNabURKZFcwaVFZeUV2bmk5VDBtcTVtTGV6a3lnV2NDMml1WTdWQ1Vw?= =?utf-8?B?L3RHNTRzSm5RQ2dINUllSUxGbmpXY1hzTFM5Q3U4VDdBQVNvcmZkSVBSZGVw?= =?utf-8?B?WTc2VzJkN2hwanZOcStlcTJIRDFQNmNjdm5Fd2dDT3d0LzJnS05ZY2R0VjNi?= =?utf-8?B?RG9ZdFZNZkd0VEp4ZnBhQ0FkRndhUDB4ZnF2dkdoTzNDblFnUU04RFBCelBv?= =?utf-8?B?YnM0RUZqaHNmL3dOQitreWZOM1pBbXlQdDFnVW53K3o1cXBQeW5OYzczT1VJ?= =?utf-8?B?U3FsbXEzcXBOTU9uWmtZcXN6a0s0enlzK0RDcnI0QVRCRUJlcFpad3BhRXhI?= =?utf-8?B?ZlhLWmxVeSswcDYzTnNwblhCZHFJZEEvU3VhV1lqV0VBdXU5UHI1TC9ZRktE?= =?utf-8?B?VHgrU09TQ0NJV1RUVGM2eDhZMm14S3FQcWtZYWFzc2Mxek1tMzRSQ0NwYStE?= =?utf-8?B?V1F6a2pFMmJOenlYOXRja2VTRSsyaEF1bUJsZlk5SGlhYTdtVW5CeFJST0Vh?= =?utf-8?B?dGJVUk9PNW1XVForNzBEdG9nQXVaRWtiVXYrb3JWdkI4OVdZR1RkV2I5SEdW?= =?utf-8?B?cDExSmN1ZUxDQTdENE8yNjhUWVZ4Q3JIWFp1amVvQXFwWGlhWDJHT3I3VnRq?= =?utf-8?B?azBnR2FtV1R2UGk1S0djQzR0ZFJyS1FwUXl2MmltUHltelZtcERWQjFHQll6?= =?utf-8?B?VEh5QTBQOUMyYXV4M3Q3Wi92RHJDY0xSTmhJRlMrbmtkRzhxUnRFcERDemdP?= =?utf-8?B?UVpwcDBESER4aHR0d3E2K25rSzFTL0p6QkFGM0VhRFlmZitHU3R5VVhoVm9w?= =?utf-8?B?OFd2YXBlMHNNMFJDYnFtKzNsOWVMVXdzWlQrVHN2SWpQd1UzMlFKbngxaVox?= =?utf-8?B?YWMxSnJqZ2VTdFhqeEJNNEJGQnpGM3FVUlRtaFpGbnZCdXliTnRHa1duQzlV?= =?utf-8?B?MldzM2t4U3YxL1YvdHdtUXdla05ENUhjNnEwWHRpWTZvdzdCQys4M1VlRzFF?= =?utf-8?B?bGhaSnY2NUtRcTBhQk9POGNrR053b3cwbFFCNXlteG9ZRmJ0QzZLK2R3dGt1?= =?utf-8?B?M3cxTW9oejBRTzdGZ3NPMStRZGliQnBqbXNpelVDdkdETUhDc3N6YXRQTnRi?= =?utf-8?B?V0NpOTV1SUdKU0M5ZVRHQjhMa3QzYUhaRnE0WWtWYVEzZFR1dmJjMVpSdERu?= =?utf-8?B?T3NKWWkwNlY2dC9JN216cmJxenV4bmR3S2JZUHNRaXR6cCtsb08yajloSllY?= =?utf-8?B?b0ZFR0dMNXAwckFXMGI5TGpsVDEwempRS0tyMDR3TUdvY2VRaHc1ZGcwcVA1?= =?utf-8?B?eFpSRjFmdFhBQzRnT1VmRWQyb1AyU0k0dkR1STFWQWM3UGtQcjNtc245cks4?= =?utf-8?B?NDFrbkZrK0FQWWowUDJ3OWdTR0pjMVNkTU1ZcGZML2s2em9aYlB6NUZwdXhi?= =?utf-8?B?WXB3YkI0Nmxxb1pkeDMvSTVEbnBjNEtHYXZSM09XakZrdWJLcCtUdU9RYks3?= =?utf-8?B?VlhPVTFHRlNTOXZ3Mmw4aVBSMTQ3S3hLN21xMFhxZWx6S3JtN3FORkhTcjcz?= =?utf-8?B?ZWwwMmIyK0Nkb1hBODdWUy9yenlCYjg1RmI5Njg1L0ZOTEZzVE9Sa3JPK1Nj?= =?utf-8?Q?NbE/BwTAzU0ckmEZxOPcuUZlD?= MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PH7PR11MB5957.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 07a830af-c823-46c7-f0af-08dd4e5054a9 X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Feb 2025 06:08:28.0981 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: Xg6h1ZA1p5K02iTGWG2wcD3Dpu7EQc3fmTEf625/dSgemvHMmS/bUyNrb7+cPsX0K8RKNauCyJuSTiX/X1Zjyw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA1PR11MB7943 X-OriginatorOrg: intel.com Subject: Re: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image classification using CLIP models X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: > -----Original Message----- > From: ffmpeg-devel On Behalf Of > m.kaindl0208@gmail.com > Sent: Thursday, January 30, 2025 4:33 AM > To: ffmpeg-devel@ffmpeg.org > Subject: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image > classification using CLIP models > > Add a new filter 'dnn_clip' that performs zero-shot image classification using > CLIP (Contrastive Language-Image Pre-Training) models. The filter supports: For image classification with new dnn models, we'd better add the new model support with dnn_classify at https://ffmpeg.org/ffmpeg-filters.html#dnn_005fclassify _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".