From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTPS id 0059D4E327 for ; Mon, 10 Mar 2025 19:54:50 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 48ECF68E0A7; Mon, 10 Mar 2025 21:54:40 +0200 (EET) Received: from mail-wm1-f50.google.com (mail-wm1-f50.google.com [209.85.128.50]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id D555968E090 for ; Mon, 10 Mar 2025 21:54:38 +0200 (EET) Received: by mail-wm1-f50.google.com with SMTP id 5b1f17b1804b1-43cfba466b2so14287055e9.3 for ; Mon, 10 Mar 2025 12:54:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1741636478; x=1742241278; darn=ffmpeg.org; h=thread-index:content-language:content-transfer-encoding :mime-version:message-id:date:subject:to:from:from:to:cc:subject :date:message-id:reply-to; bh=7/8vfb77SNs7yQ1+cZ0CVcX7/0YN2lGufjCh2fddOYI=; b=L1xUxYySjhGDA/xU5/nHOF9fwJ0ydK5LC/iNY9oqYbO8/EO/2S9p/2ohGK4p9uLCRx gTBmyM/NrgsUWlDKjaa+UOeDKxPgfICPp/xxfYcSU1wxGcCK7aSwzADskde4hGC8OK2K SkNxyiTK+iQ2HniJJ+OMpTK7A5t/JNKIKv4+D5CaTn/Y94MfqGREN5xh4rfjNX1Mm7kf khe5RjIwSWXAMqOFf0eQsNToSIJKDOxn+oMKfZq+yXz9C385428N/bakn4kfMkoO6/X0 hroMOV3nxXPaLdAmoilIK5Gfbl+J2i9+maf+KM9n7eHFQ3LW5jSJIW0YMYvzvo27KGhp MAKg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741636478; x=1742241278; h=thread-index:content-language:content-transfer-encoding :mime-version:message-id:date:subject:to:from:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=7/8vfb77SNs7yQ1+cZ0CVcX7/0YN2lGufjCh2fddOYI=; b=gzIJ9ranteEcE6kTPp1L82DkQiObtKKKJl6CVmx21VEvpkfQJKKA/A0/LpNFpS7U1t O5EWkMQhVDlUzOrnAQXSSs6c6Dy7WhjCj9JaNOo3Hk+mF/IH0rOeebh4P6CKuZ7dUq2D S3oxIIMTl5zKnMM1AjcKyIrc1O7/tVVJ5YdvZOVgMFXotpD/2FMee25Tw1Hl4aJzx/fr Xt0Z+hx72VPSy+D2BLUiuBHB34U/31BomPch/XjsctWirC7kFrM5rMKBcIjiMpx1UimF UDTNP/VmW8waZDUK7KPBjjQ0hjuwq+7tE0CSLn3npOU8ZtN14ghnYqSiMZ+/OBRiDzls +fiQ== X-Gm-Message-State: AOJu0YwOXgYDIwrrtfi/tRoft53oN9hDRyOQYPwtAUVYdR5zdsVqeJDR P+QOSbr608hqj7z7B5y75O2I1FEJb3+c2AgaiIYIVOYCNqDYmfntOX+KMg== X-Gm-Gg: ASbGncviQba7QeFT4K6oqFxp93qHvbnFsjRBHMhj7PrNmOLTmAHDA3ZOjEaSbpzlCTS 6i3J6fwUpe7Scg3Wh49w949xycdLAgH+tBj+kp9zIuT+UiQzL7VPYgl/UnqrHIia3YHVzh0Aaaq CbUBhzqy4qL8FHPwEWZOuLct066J9zOZCviNUQ17v9z1EP2YXwTY7Ou1iSzzUw6DG+0M25ncjoQ Ydjuy87WULxezaeQFfPwqLPmAbaBj9Pqb1TA1AzVmzF51T72rnJ7Dygc8hXJHzJKnv37iI3lzLM Gp8HLO4fVq5thYXbO3ivFHknSVcHUa7+OI3kfEnrld7I/IK8Km0U0YQchF8R6A78EjdPfdSAS6o UkSxSpvR3E0Xhy6Sk X-Google-Smtp-Source: AGHT+IFupTs55CPeTqe3j8gjs7ugTqJh9ntUIfJ49i4EkIK06KPvTtX2/r5orB9QlIP9w7zlOJxoXA== X-Received: by 2002:a05:600c:4f09:b0:43c:fa52:7d2d with SMTP id 5b1f17b1804b1-43cfa527f9dmr47434225e9.20.1741636477603; Mon, 10 Mar 2025 12:54:37 -0700 (PDT) Received: from MK2 (80-108-16-220.cable.dynamic.surfer.at. [80.108.16.220]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43d031d2c26sm648945e9.0.2025.03.10.12.54.36 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 10 Mar 2025 12:54:37 -0700 (PDT) From: To: Date: Mon, 10 Mar 2025 20:54:37 +0100 Message-ID: <004001db91f6$40f45ba0$c2dd12e0$@gmail.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 16.0 Content-Language: en-at Thread-Index: AduR9j78ZyjlnzxsQ9KCICBBqx6P5g== Subject: [FFmpeg-devel] [PATCH v2 FFmpeg 12/20] libavfilter/dnn/dnn_backend_torch: Add ClxpContext to THModel X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: Signed-off-by: MaximilianKaindl --- libavfilter/dnn/dnn_backend_torch.cpp | 26 ++++++++++++++++++++++++++ 1 file changed, 26 insertions(+) diff --git a/libavfilter/dnn/dnn_backend_torch.cpp b/libavfilter/dnn/dnn_backend_torch.cpp index 062821949d..ea09845e05 100644 --- a/libavfilter/dnn/dnn_backend_torch.cpp +++ b/libavfilter/dnn/dnn_backend_torch.cpp @@ -39,6 +39,13 @@ extern "C" { #include #endif +typedef struct THClxpContext { + torch::Tensor *tokenized_text; + torch::Tensor *attention_mask; + int *softmax_units; + int softmax_units_count; +} THClxpContext; + typedef struct THModel { DNNModel model; DnnContext *ctx; @@ -46,6 +53,7 @@ typedef struct THModel { SafeQueue *request_queue; Queue *task_queue; Queue *lltask_queue; + THClxpContext *clxp_ctx; } THModel; typedef struct THInferRequest { @@ -116,6 +124,21 @@ static inline void destroy_request_item(THRequestItem **arg) av_freep(arg); } +static void free_clxp_context(THClxpContext *clxp_ctx) +{ + if (!clxp_ctx) + return; + if (clxp_ctx->tokenized_text) { + delete clxp_ctx->tokenized_text; + clxp_ctx->tokenized_text = nullptr; + } + if (clxp_ctx->attention_mask) { + delete clxp_ctx->attention_mask; + clxp_ctx->attention_mask = nullptr; + } + av_freep(&clxp_ctx); +} + static void dnn_free_model_th(DNNModel **model) { THModel *th_model; @@ -143,6 +166,9 @@ static void dnn_free_model_th(DNNModel **model) } ff_queue_destroy(th_model->task_queue); delete th_model->jit_model; +#if (CONFIG_LIBTOKENIZERS == 1) + free_clxp_context(th_model->clxp_ctx); +#endif av_freep(&th_model); *model = NULL; } -- 2.34.1 _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".