From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.ffmpeg.org (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTPS id B94CC4E652 for ; Mon, 26 Jan 2026 03:04:01 +0000 (UTC) Authentication-Results: ffbox; dkim=fail (body hash mismatch (got b'/HTTaAkp0iqG3tP16zCNgEoc6quM2BW6J7lFtOzcm7A=', expected b'Pk8ANcqKdM/ppExn1CrwxE3FIn4N7W5rxyRpTd2SDnc=')) header.d=niedermayer.cc header.a=rsa-sha256 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ffmpeg.org; i=@ffmpeg.org; q=dns/txt; s=mail; t=1769396630; h=date : to : message-id : references : mime-version : in-reply-to : reply-to : subject : list-id : list-archive : list-archive : list-help : list-owner : list-post : list-subscribe : list-unsubscribe : from : cc : content-type : from; bh=wraHtEeAUz9SFSXkgPic8sq2TISNr7cJLRmK8t5xBmY=; b=L6pWwTU3LnZ/wo360zWGLb0mxYChzLVbNepa3ltdM9vRapMfhgwZxj6CQTbW/e0WniBBD zGZG2cW26qc+n5zCrvbx7mTUpXtKNfl2xZTokd7Jim7iBSdTYKuCpDhEBB2zzVjef1bcZ72 BHXdOOG2HR9W3e3xAGgR7pO4TJAYApzkZ0DtHal6KWm1uEasp0JiTsBuOmndMUxSQGoycMV 7nS69WyHOxOnqdFZZiNZAtm1HQgZccX0TszGRw1hwOfxxjysTLeGxxgCHTuQFX5KRtTNeg4 HSlXyfFb5x5EzgBhs0g1PbKdBkTvD7nLT90yana8ozkzLtv9n7JyUW8sPwAg== Received: from [172.20.0.4] (unknown [172.20.0.4]) by ffbox0-bg.ffmpeg.org (Postfix) with ESMTP id E4914690D5F; Mon, 26 Jan 2026 05:03:50 +0200 (EET) ARC-Seal: i=1; cv=none; a=rsa-sha256; d=ffmpeg.org; s=arc; t=1769396610; b=ed804mwfqbANiokE+PbGyPF6FYQxSn8cu3yioRJ8qWkB8biWpupSMtRi0P/WWs+UPvRfN rBsnh4TZEZNZaRk8zyBSwMDwD0JXuqTDQ4Sywg75MRag8IDt1igDl9pimRBosBg2EV+OKbZ YmCk7uttOgxLgPlL7OrlPlplScn6xmNAwfp4yQXWihh2GaS1/A5WH/PuYpA9kJA3xrjg+Mh Eb9cpEYuGmQAif5AjHmtCSVNi19w6mm2qvL3wNJn8TZ4zoePlu4AWz1/5Rlp7KeXVTKJtxt 8ekDpXTtsdjloSBT/4i8Q66SGd5PIXqmjdIfQvPyk7yDEhMJ9aJ8GKtptx5w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=ffmpeg.org; s=arc; t=1769396610; h=from : sender : reply-to : subject : date : message-id : to : cc : mime-version : content-type : content-transfer-encoding : content-id : content-description : resent-date : resent-from : resent-sender : resent-to : resent-cc : resent-message-id : in-reply-to : references : list-id : list-help : list-unsubscribe : list-subscribe : list-post : list-owner : list-archive; bh=/HTTaAkp0iqG3tP16zCNgEoc6quM2BW6J7lFtOzcm7A=; b=maWyvUBx27FxNLhu2l5PY5KRk4Q9Vu6LeibhLxRPKHMBwMRnaVRL2SgOp23bEinoyl47i SGKU2sn/HfKJuM7BMSNoaYDBOdSG6vshUnpgU3tG0YKgteJxNwnnPPz95iBuzSusRq3GuNL ORMfHwp53aAsdLq0OWjeLPaNbeKzjnm80aSHt7v2i7fCJvG6RmIXl4+2uH0xkcBl7Pdu5ps nlGiQzhE6xVOvxy+6tPkGkWg+XslbyyDDKB1EpvTRRM1PiRlnECyUlX81Rehy0KpxhuwEBQ X86xbGy2gH2Lo33+vxwiV5Y6ROIF1ugPluS1yAkPTdSDstghQ2ySGT/DLXZQ== ARC-Authentication-Results: i=1; ffmpeg.org; dkim=pass header.d=niedermayer.cc; arc=none; dmarc=none Authentication-Results: ffmpeg.org; dkim=pass header.d=niedermayer.cc; arc=none (Message is not ARC signed); dmarc=none Received: from relay6-d.mail.gandi.net (relay6-d.mail.gandi.net [217.70.183.198]) by ffbox0-bg.ffmpeg.org (Postfix) with ESMTPS id 671C3690878 for ; Mon, 26 Jan 2026 05:03:17 +0200 (EET) Received: by mail.gandi.net (Postfix) with ESMTPSA id 38F0F44293; Mon, 26 Jan 2026 03:03:16 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=niedermayer.cc; s=gm1; t=1769396596; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=Pk8ANcqKdM/ppExn1CrwxE3FIn4N7W5rxyRpTd2SDnc=; b=PpGNG0gOWa85POaVdn4tN9egm8VbCNFSRHOMV+SOY/d2voGLPQzFpjUlCb10qNUVZuIz0n ejbD6oh1mPdX7HkwWUOHkBZhgqR+Z/qGfIp4CgPVTdytycP8SqgNrH0ivYOmeCAPufgnDA aUPujXvoFSEB6m2hTt+Tt0LFg96+PN77J2RGTa3e99RodXXCT5C6ayqT4v8iKgJtFl6/8C HYmziwV4+u7sXPWYUfcyX4izH6IBCF+pXqY3IrHLR83skWU6qM+RkXFIPV7MXpPQgmVlfo Vz4fPWNYECsZjIyNjz2DPu1zAtFYwA16WGAIVZGCuUO+7AqzwLd7IZ5BwxlEGQ== Date: Mon, 26 Jan 2026 04:03:14 +0100 To: FFmpeg development discussions and patches Message-ID: References: MIME-Version: 1.0 In-Reply-To: X-GND-Sasl: michael@niedermayer.cc X-GND-State: clean X-GND-Score: -85 X-GND-Cause: gggruggvucftvghtrhhoucdtuddrgeefgedrtddtgdduheeiheegucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuifetpfffkfdpucggtfgfnhhsuhgsshgtrhhisggvnecuuegrihhlohhuthemuceftddunecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenfghrlhcuvffnffculdduhedmnecujfgurhepfffhvfevuffkfhggtggujgesghdtreertddtvdenucfhrhhomhepofhitghhrggvlhcupfhivgguvghrmhgrhigvrhcuoehmihgthhgrvghlsehnihgvuggvrhhmrgihvghrrdgttgeqnecuggftrfgrthhtvghrnhepieejuefgieffheekhfejheevfeekuefhtedvleeigfdtkeffhfeihffhhfevjeeknecuffhomhgrihhnpehffhhmphgvghdrohhrghenucfkphepgedurdeiiedrieeirdehtdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepihhnvghtpeeguddrieeirdeiiedrhedtpdhhvghloheplhhotggrlhhhohhsthdpmhgrihhlfhhrohhmpehmihgthhgrvghlsehnihgvuggvrhhmrgihvghrrdgttgdpqhhiugepfeekhfdthfeggedvleefpdhmohguvgepshhmthhpohhuthdpnhgspghrtghpthhtohepfedprhgtphhtthhopehffhhmphgvghdquggvvhgvlhesfhhfmhhpvghgrdhorhhgpdhrtghpthhtohephigvjhhunhdrghhuohesihhnthgvlhdrtghomhdprhgtphhtthhopehimhhrrghjrgejvdelsehgmhgrihhlrdgtohhm Message-ID-Hash: YZQL4REFVN2WDABJXXFD4DVL2BONP5T2 X-Message-ID-Hash: YZQL4REFVN2WDABJXXFD4DVL2BONP5T2 X-MailFrom: SRS0=fgy4=77=niedermayer.cc=michael@ffmpeg.org X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; loop; banned-address; header-match-ffmpeg-devel.ffmpeg.org-0; header-match-ffmpeg-devel.ffmpeg.org-1; header-match-ffmpeg-devel.ffmpeg.org-2; header-match-ffmpeg-devel.ffmpeg.org-3; emergency; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header X-Mailman-Version: 3.3.10 Precedence: list Reply-To: FFmpeg development discussions and patches Subject: [FFmpeg-devel] Re: [GSoC][RFC] GSoC 2026 Proposal (350 Hours): High-Performance LibTorch Backend Modernization List-Id: FFmpeg development discussions and patches Archived-At: Archived-At: List-Archive: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: From: Michael Niedermayer via ffmpeg-devel Cc: "Guo, Yejun" , Raja Rathour , Michael Niedermayer Content-Type: multipart/mixed; boundary="===============4143895529469197282==" Archived-At: List-Archive: List-Post: --===============4143895529469197282== Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="67Yhg/Uj+bigFsYE" Content-Disposition: inline --67Yhg/Uj+bigFsYE Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi Raja, Guo On Sun, Jan 25, 2026 at 10:30:25PM +0530, Raja Rathour via ffmpeg-devel wro= te: > *GSoC 2026 Proposal: High-Performance LibTorch Backend Modernization* >=20 > *Candidate:* Raja Rathour > *Project Type:* Large (350 Hours) > *Mentor:* Guo Yejun if guo agrees then someone should add this to https://trac.ffmpeg.org/wiki/SponsoringPrograms/GSoC/2026 we need more projects listed on the above idea page ASAP because google will look at this and say "wtf that page is nearly empty" > *1. Problem Statement: Bridging the Integration Gap* >=20 > While the LibTorch backend logic was present in the source tree, it was > functionally inaccessible to end-users due to a registration mismatch in > the AVOption system. Specifically, the dnn_backend unit in > vf_dnn_processing.c lacked the necessary constants to map the user input > string "torch" to the internal DNN_TH backend ID. This caused the followi= ng > failure: >=20 > *The Error:* > [Parsed_dnn_processing_0 @ 0x...] Option 'dnn_backend' not found >=20 > *The Fix:* > I have already diagnosed and resolved this by correctly registering the > torch constant in the dnn_processing_options array and updating DnnContext > offsets. > *2. Current Progress & Functional Verification* >=20 > I have verified the end-to-end inference pipeline using a local build > (--enable-libtorch). The following terminal output serves as proof of > concept, showing successful 25-frame inference at 14.8x speed using the n= ew > LibTorch integration: >=20 > *# Verified Command Line Proof* >=20 > ./ffmpeg -f lavfi -i testsrc=3Dduration=3D1 -vf > "dnn_processing=3Dmodel=3Dmodel.pt:dnn_backend=3Dtorch" -f null - > ... > Stream mapping: Stream #0:0 -> #0:0 (wrapped_avframe -> wrapped_avframe) > frame=3D 25 fps=3D0.0 time=3D00:00:01.00 speed=3D14.8x >=20 > This confirms that the "plumbing" between FFmpeg's filtergraph and the > LibTorch engine (using at::from_blob for memory wrapping) is fully > operational. > [image: image.png] >=20 >=20 > *3. 350-Hour Technical Roadmap (12-Week Plan)* I do like the idea of improving libtorch support I have to admit i probably never used FFmpeg with libtorch but i used libtorch directly in another project i wrote. thx [...] --=20 Michael GnuPG fingerprint: 9FF2128B147EF6730BADF133611EC787040B0FAB Take away the freedom of one citizen and you will be jailed, take away the freedom of all citizens and you will be congratulated by your peers in Parliament. --67Yhg/Uj+bigFsYE Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iF0EABEKAB0WIQSf8hKLFH72cwut8TNhHseHBAsPqwUCaXbZbgAKCRBhHseHBAsP q3mYAJ9ml2uCtEQc1ACIZ1krKMGA8qAf3wCeJ+lanFGUtji/L+uB5edhYU/dtgU= =I1kI -----END PGP SIGNATURE----- --67Yhg/Uj+bigFsYE-- --===============4143895529469197282== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ ffmpeg-devel mailing list -- ffmpeg-devel@ffmpeg.org To unsubscribe send an email to ffmpeg-devel-leave@ffmpeg.org --===============4143895529469197282==--