From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTPS id 9966E4D14E for ; Mon, 17 Feb 2025 16:28:48 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 843BD68BDF4; Mon, 17 Feb 2025 18:28:45 +0200 (EET) Received: from mail-ej1-f51.google.com (mail-ej1-f51.google.com [209.85.218.51]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id D538C68B3FA for ; Mon, 17 Feb 2025 18:28:38 +0200 (EET) Received: by mail-ej1-f51.google.com with SMTP id a640c23a62f3a-abb75200275so301392366b.3 for ; Mon, 17 Feb 2025 08:28:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1739809718; x=1740414518; darn=ffmpeg.org; h=mime-version:content-language:accept-language:in-reply-to :references:message-id:date:thread-index:thread-topic:subject:to :from:from:to:cc:subject:date:message-id:reply-to; bh=7NOLxmm2QhxGHdFSDjc7NjjsFUDK6Vv7UaWzxwWpkB0=; b=Ehu5O5d0bENxAQdGauBQbcbrCixoEvrUx3Risb+xM3e1MrnCo4P//7r7yh/nFyXHB+ hc8xAj0yP3HPBxtL/GYZfbfvmNkjEnSWWe8I3tr5mFtowuxryEvue7iJwtRZeGUHr7dk rn+mCWymREarQxroMlu6FIciN3k9BZxu6vDRE9GOaKjcTTbG+xYfCzTMIg8Vl6kxZarh GMYyq7WgchUdMGcwW5fEkbVfOY3diz9keIajmdT4MUYPuSCuIHeugJDqwojXFTa36+lo yYgG806lZmC9FCyKgIDdNDNQ3+WkeP25lM8wWRNIwy7OYy6JOgq7dO+Yl1tLzFRcz3vM E5Sg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1739809718; x=1740414518; h=mime-version:content-language:accept-language:in-reply-to :references:message-id:date:thread-index:thread-topic:subject:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=7NOLxmm2QhxGHdFSDjc7NjjsFUDK6Vv7UaWzxwWpkB0=; b=hkGOnQZsE4YC38fX1HtGDAbGrwSm45apO6KnjoUbZvNqFrG2/7EnxlojBCKP/YXInp Wxoq2jH2oorObaykPbYqAImry9S6wuEgooLPmxZJtiizQUv9SZfVwCmphuL8/6cz/tyk fHFmTNmvVIlxdvbhX4/zYCL/DxqjlC2TFOf9Hc8+PQESngtR/7ZVd84n1puLUIYX31jk uXC1Y+BteWBEkgMc3F1LwBU/wojr1il+9kUDSr2fVCSqg78uiVGaboJ3xNvUETNbSHXc ovFhvW0O2fXRUFbfsJMSi6r0GESGls96ND/Kz7yXqTgxbi7ZfqNuNF6lCD3By4r94W7x 58hg== X-Gm-Message-State: AOJu0YzCnEC9XioQCs9TDUDwPTXlFt/kqdVkMiA7e975v1hhZlVMlI6f kVk5deJ6NS2sHjA9z4EUYKz9TKj+ohH6HWqwfMZFJw36cRV8Jxxddz9gsg== X-Gm-Gg: ASbGncsVPNr097oGYEZ6yvwF/MjrxHxB2n6C6ITinHmClV2uSJ1aYF3JNxbIlTwUOhU mk88Z5ct3taWrX18GpflMkI16k+SnDr6qz8qTLRdaE/QnrRnSQjGH0aVyk0awWF4O7x6uODqT3x Bs5CQopJ5wl7J+wrofMze4RRxah9490L4f7O1I9uw3OosHlzWCFqkt0pcM/u7jBDt9NX+S2btbE ePUzpqQ6VClJV/9n/KAk8M50ukaDW4TY+IlafTL6iYPLHiY3KnFWtpMACEXoD7w8rZoiELp0uEm YIV41EgomhbqW4TsOCNAzNE5dehHUOdFZY1ntz6Uqfk8srqbYF4xPUY7Qm8ALBBzCflQcn9hgDH sUdZW X-Google-Smtp-Source: AGHT+IGQmufreyPQLIrh64QdIxRxus9JpiVq1KjF0N5QM9sVP3a6o5W0Ly5KTbJqR6VWebZmrvHuBw== X-Received: by 2002:a17:907:9494:b0:ab7:ec84:10af with SMTP id a640c23a62f3a-abb70b1d813mr1081405466b.16.1739809717403; Mon, 17 Feb 2025 08:28:37 -0800 (PST) Received: from AS4PR03MB8436.eurprd03.prod.outlook.com ([2603:1026:c03:704b::5]) by smtp.gmail.com with ESMTPSA id a640c23a62f3a-abb9a65bea0sm231159866b.46.2025.02.17.08.28.37 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 17 Feb 2025 08:28:37 -0800 (PST) From: Maximilian Kaindl To: FFmpeg development discussions and patches Thread-Topic: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image classification using CLIP models Thread-Index: AdtyhuRcwdeGikTTTrap4GomiMz7rQABg6HQA2r0iPAAR8jiHQ== X-MS-Exchange-MessageSentRepresentingType: 1 Date: Mon, 17 Feb 2025 16:28:36 +0000 Message-ID: References: <001701db728d$09fa37b0$1deea710$@gmail.com> In-Reply-To: Accept-Language: en-US, de-DE Content-Language: en-US X-MS-Has-Attach: X-MS-Exchange-Organization-SCL: -1 X-MS-TNEF-Correlator: X-MS-Exchange-Organization-RecordReviewCfmType: 0 x-ms-reactions: allow MIME-Version: 1.0 X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image classification using CLIP models X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: Hello Yejun Guo, yes i can do that and submit it in another patch. Do you also have some feedback for the clip backend? I have already made some small changes (cuda accel and new preprocessing) that i will submit along with the other patch, but i would like to hear your thoughts. Thanks ________________________________ From: ffmpeg-devel on behalf of Guo, Yejun Sent: Sunday, February 16, 2025 7:09 AM To: FFmpeg development discussions and patches Subject: Re: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image classification using CLIP models > -----Original Message----- > From: ffmpeg-devel On Behalf Of > m.kaindl0208@gmail.com > Sent: Thursday, January 30, 2025 4:33 AM > To: ffmpeg-devel@ffmpeg.org > Subject: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image > classification using CLIP models > > Add a new filter 'dnn_clip' that performs zero-shot image classification using > CLIP (Contrastive Language-Image Pre-Training) models. The filter supports: For image classification with new dnn models, we'd better add the new model support with dnn_classify at https://ffmpeg.org/ffmpeg-filters.html#dnn_005fclassify _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe". _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".