From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.ffmpeg.org (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTPS id 0DC934DBBB for ; Thu, 1 Jan 2026 08:10:50 +0000 (UTC) Authentication-Results: ffbox; dkim=fail (body hash mismatch (got b'udM7uXfBIGPyBN5jJKXISvb8n0PWwyYnRtqZJClbf1I=', expected b'68UJ4pRktoMhIzW0gfd01zENoxQ23a9wp0vy5qkZgzY=')) header.d=gmail.com header.a=rsa-sha256 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ffmpeg.org; i=@ffmpeg.org; q=dns/txt; s=mail; t=1767254936; h=to : date : message-id : in-reply-to : references : mime-version : reply-to : subject : list-id : list-archive : list-archive : list-help : list-owner : list-post : list-subscribe : list-unsubscribe : from : cc : content-type : content-transfer-encoding : from; bh=wD9nni42Wt75V8Vh32IdJwQziBV282KiNav/PpQA3lA=; b=o+pHLM8EYYB8GDejD0JaUi8fEU47ag/x7cIIj6VZiGBn8QIfoUczAdPUcdTXw9JPsdIxM gUZ0gNOi8q60dEvukPPFf26AXthVf75wGf5zxsabg7NfQd15pnIzUDVIzpvwd/0AUkhVWWf Xr5C5y4dRonWseR4IC1ZVF3mEGEzXKKU9HtGVk1WVid4U5ockhOtztgecpWqgZ0r8i+2zDZ WyRGgumvoDsT5vk9WL0EfTxVx33Zw8qBoxlx6umzpXHF55qSHF4U7+whSbwxDA+5GwuSAjT wWGJTwi8HK5fubVbny/BiDpaWuvD/EwvI8FgVYjAKo2YQiVPio5+KwskOKTA== Received: from [172.20.0.4] (unknown [172.20.0.4]) by ffbox0-bg.ffmpeg.org (Postfix) with ESMTP id A4D7B690DCA; Thu, 1 Jan 2026 10:08:56 +0200 (EET) ARC-Seal: i=1; cv=none; a=rsa-sha256; d=ffmpeg.org; s=arc; t=1767254903; b=rwroP1mLJIvyiSKtPjcYiEkSKrMad6fp7+HIey5odcl0v26lt8iqCEFOzbZzIz/7jQcCe T4nbdCuYJQcmigfiBeceg2G4D5JHXhckq3wnp6RBD6cwu26NLaWPLTGRZUQRjhZ7RT4k+IU 5s8fsYo+8hzyzpZOyvUxiWgd3WhIo8+giM263j+cq5UcfxNqi1Yavr8AHvRRw4FKxnLo3ka fC097gJA+4oUIhzZ9e/VZ+u1YyUk9NhcWvoPAxb6A0HKD+mzMeT96ta2/F5GpJsgvaTEKQl 9KlzC1p1jOoS3rOZeAhEDp781VIjB3bOXSDVEqRpTzGKQUH5Dp/D+xeKegMw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=ffmpeg.org; s=arc; t=1767254903; h=from : sender : reply-to : subject : date : message-id : to : cc : mime-version : content-type : content-transfer-encoding : content-id : content-description : resent-date : resent-from : resent-sender : resent-to : resent-cc : resent-message-id : in-reply-to : references : list-id : list-help : list-unsubscribe : list-subscribe : list-post : list-owner : list-archive; bh=udM7uXfBIGPyBN5jJKXISvb8n0PWwyYnRtqZJClbf1I=; b=kE+aa/qoo9xDASRZ7AdDq0/9hsjMXx2gA5lbh/L+FDvAQw8fLkAAxnpnzGNo1AAnEbW7o Of0ny+bN4aa7Los1ItUfBa+7opblOlxc5jm0IJS6T6FqwZM0LTKxwEx8PgN9hoa1yrBIsH+ mRDMH7njr+B3XDeUsJ64RZWSJkhiyR1zYwmIlpm7i6tnwvxDb8Pw5oXFAfgNkjY3UQJmSLh /GLLqF0pbNE7+mhk+IE89sRhTQs6/oF5EmzPPTpe9IRV1tGbCJuSmW6ZqWsX+m5GJXF1ElK w0LcOIvU4pcaSwwLSvZzeB5d+gLsMgxLfuSP00pujACofLYZCJnoJ760g5SQ== ARC-Authentication-Results: i=1; ffmpeg.org; dkim=pass header.d=gmail.com; arc=none; dmarc=pass header.from=gmail.com policy.dmarc=quarantine Authentication-Results: ffmpeg.org; dkim=pass header.d=gmail.com; arc=none (Message is not ARC signed); dmarc=pass (Used From Domain Record) header.from=gmail.com policy.dmarc=quarantine Received: from mail-pf1-f178.google.com (mail-pf1-f178.google.com [209.85.210.178]) by ffbox0-bg.ffmpeg.org (Postfix) with ESMTPS id EE163690CCA for ; Thu, 1 Jan 2026 10:07:47 +0200 (EET) Received: by mail-pf1-f178.google.com with SMTP id d2e1a72fcca58-7e1651ae0d5so8767492b3a.1 for ; Thu, 01 Jan 2026 00:07:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1767254866; x=1767859666; darn=ffmpeg.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=68UJ4pRktoMhIzW0gfd01zENoxQ23a9wp0vy5qkZgzY=; b=Cx27fZflSgCMyLrCja1gEi2T2Lzj1v5sWNkfMJZiaB3ZEnDzAD4gWXDJ+VsIvsfysC xEA8bnuDE/zENHAskZnUtRc0YumXGzNgXCu/A07GHTUg5VdoouuIaTI0zieTVcbn9+j+ EuhmlbxeC22jy6qEcXDhLJNY284HNRJSOwLu1QwMm2vIeeYwMnXbbrsHIRYv0AwRlLgA xk1hQW/C8AJe+n9MYtJL0f/05fflt6xCd9a0t0/IujVg0IN5Vskroy3bK7s6nIK2PS4o 2u02rUtw62yzrtpWY8PiKVNTAU+kCnJ/nyqORuGHKwRQripJV1B1yQPiJxjyV86JLHU2 gpbg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1767254866; x=1767859666; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=68UJ4pRktoMhIzW0gfd01zENoxQ23a9wp0vy5qkZgzY=; b=wLwS+aSGWq47r6US7xUpmC9Pd3eSNHrNV+/WrS7DstmTw1xnL1g+m2qssfekY75DDj cmHtzT7tC59gFRzT1+hJ80QvU/D+H5mYkjHnQtcgBuSiZ95AmQHiscfuHrEU7d86yGrb NuWKVizeXlQP/0bI7O/bNVQ1AqLnMV9cfKg5xzrI3bHrglwN9Cs/QLZ6ZJRf4qKBJen5 Z4sOJe9e5gf0MnOYcA3JNiQMTbefBxPmCRpA+zgYeRZj+txtpoJaGjQKGexweu8Czwdq +OvjtsSs2FGFYLYxnGokeHa7SXe1ArITXVXsPBA6db8llfCBCNvaC1twRd9gIm6QtJeo kuog== X-Gm-Message-State: AOJu0YwAkCuhUg/yX2TKsZqp7BZTaQDAwVQaFjxzgmn9dv0V3DPa7Sns u/LLK5oEuzoIOUz3l8s0PE7wqI5DoYaZ8yzt+DVn+7MAnoZQgL1MbC1aytQ84Q== X-Gm-Gg: AY/fxX57VybVDPQnJO0V6h2WSh+9Zbu5qMD4X+ddkrg9EBK7vLXLO9LtJy96qI41b+I J/fyn8Ctr1CalSaQrPBI4ouJiuygIXMU03SwbD1ISbOiqHq5+8607l2Ex92ZD/xpuw9zT1woBkx w446h7ftPZdW7lxyDGh1IZtyfSpOM0gvRcKb7zAI8sIFPYIZ8Zlkcb8Z5LQbf7aBe91BhbpgaIY bCqCB1bOD5LX7l1/dVF5q83OCgODnEbZ5dPAnHvSoUdiM9m2vJf/+AvHn9j0TvBWvsJOs6mzZuV tTHH//BWG4r0fZ19Pl0eVIoBmDhRwYOOJtmxxdwwDFk6+yACwcNHxlDdM2apyOiPSnzYgh6apSd YxICispwmHE65o56M+6clzzorpeB9AKJoKUE6INlujakMauYy0JpvaN4SZ3WabbpjaWiGylg1hb 73emcqXDrWP1klVfLpALlwzz49Ww1pRkNEK5a80eve X-Google-Smtp-Source: AGHT+IHAMSILhZipm2vzOMhQI1b8ehXFXbo0YteFeDO977JQA5ahkp4TUmf1mOozreEDDHVXa30hhg== X-Received: by 2002:a05:6a00:450d:b0:7e8:4587:e8c2 with SMTP id d2e1a72fcca58-7ff66480794mr34747769b3a.53.1767254865909; Thu, 01 Jan 2026 00:07:45 -0800 (PST) Received: from Raja-Rathour-ASUS-TUF-Gaming-A15.. ([103.227.71.253]) by smtp.gmail.com with ESMTPSA id d2e1a72fcca58-7ff7b127b00sm37251304b3a.21.2026.01.01.00.07.44 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 01 Jan 2026 00:07:45 -0800 (PST) To: ffmpeg-devel@ffmpeg.org Date: Thu, 1 Jan 2026 13:37:20 +0530 Message-ID: <20260101080722.133215-2-imraja729@gmail.com> X-Mailer: git-send-email 2.48.1 In-Reply-To: <20260101080722.133215-1-imraja729@gmail.com> References: <20260101080722.133215-1-imraja729@gmail.com> MIME-Version: 1.0 Message-ID-Hash: 5KTZTTEFAOOM2TGYLNBMB2KVQ3N4QP4S X-Message-ID-Hash: 5KTZTTEFAOOM2TGYLNBMB2KVQ3N4QP4S X-MailFrom: SRS0=om1i=7G=gmail.com=imraja729@ffmpeg.org X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; loop; banned-address; header-match-ffmpeg-devel.ffmpeg.org-0; header-match-ffmpeg-devel.ffmpeg.org-1; header-match-ffmpeg-devel.ffmpeg.org-2; header-match-ffmpeg-devel.ffmpeg.org-3; emergency; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header X-Mailman-Version: 3.3.10 Precedence: list Reply-To: FFmpeg development discussions and patches Subject: [FFmpeg-devel] [PATCH v2 1/3] avfilter/dnn_backend_torch: add async infrastructure List-Id: FFmpeg development discussions and patches Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: From: Raja Rathour via ffmpeg-devel Cc: guoyejun@gmail.com, Raja Rathour Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Archived-At: List-Archive: List-Post: Add worker thread, mutex, and condition variable to THModel. --- libavfilter/dnn/dnn_backend_torch.cpp | 31 +++++++++++++++++++++++++++ 1 file changed, 31 insertions(+) diff --git a/libavfilter/dnn/dnn_backend_torch.cpp b/libavfilter/dnn/dnn_backend_torch.cpp index 2e4326d9d4..af92cd13da 100644 --- a/libavfilter/dnn/dnn_backend_torch.cpp +++ b/libavfilter/dnn/dnn_backend_torch.cpp @@ -25,6 +25,10 @@ #include #include +#include +#include +#include +#include extern "C" { #include "dnn_io_proc.h" @@ -42,6 +46,11 @@ typedef struct THModel { SafeQueue *request_queue; Queue *task_queue; Queue *lltask_queue; + SafeQueue *pending_queue; ///< requests waiting for inference + std::thread *worker_thread; ///< background worker thread + std::mutex *mutex; ///< mutex for the condition variable + std::condition_variable *cond; ///< condition variable for worker wakeup + std::atomic worker_stop; ///< signal for thread exit } THModel; typedef struct THInferRequest { @@ -318,6 +327,28 @@ err: } } +static void th_worker_thread(THModel *th_model) { + while (true) { + THRequestItem *request = NULL; + { + std::unique_lock lock(*th_model->mutex); + th_model->cond->wait(lock, [&]{ + return th_model->worker_stop || ff_safe_queue_size(th_model->pending_queue) > 0; + }); + + if (th_model->worker_stop && ff_safe_queue_size(th_model->pending_queue) == 0) + break; + + request = (THRequestItem *)ff_safe_queue_pop_front(th_model->pending_queue); + } + + if (request) { + th_start_inference(request); + infer_completion_callback(request); + } + } +} + static int execute_model_th(THRequestItem *request, Queue *lltask_queue) { THModel *th_model = NULL; -- 2.48.1 _______________________________________________ ffmpeg-devel mailing list -- ffmpeg-devel@ffmpeg.org To unsubscribe send an email to ffmpeg-devel-leave@ffmpeg.org