From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTP id E0F7446CB2 for ; Fri, 7 Jul 2023 10:43:28 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 76D0B68C7A3; Fri, 7 Jul 2023 13:43:25 +0300 (EEST) Received: from mail0.khirnov.net (red.khirnov.net [176.97.15.12]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 7EC1D68C70C for ; Fri, 7 Jul 2023 13:43:18 +0300 (EEST) Received: from localhost (localhost [IPv6:::1]) by mail0.khirnov.net (Postfix) with ESMTP id 34A822404EC for ; Fri, 7 Jul 2023 12:43:18 +0200 (CEST) Received: from mail0.khirnov.net ([IPv6:::1]) by localhost (mail0.khirnov.net [IPv6:::1]) (amavisd-new, port 10024) with ESMTP id SNn77n-MUSKX for ; Fri, 7 Jul 2023 12:43:17 +0200 (CEST) Received: from libav.khirnov.net (libav.khirnov.net [IPv6:2a00:c500:561:201::7]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "libav.khirnov.net", Issuer "smtp.khirnov.net SMTP CA" (verified OK)) by mail0.khirnov.net (Postfix) with ESMTPS id 3C2912404EA for ; Fri, 7 Jul 2023 12:43:17 +0200 (CEST) Received: from libav.khirnov.net (libav.khirnov.net [IPv6:::1]) by libav.khirnov.net (Postfix) with ESMTP id E704E3A0153 for ; Fri, 7 Jul 2023 12:43:16 +0200 (CEST) From: Anton Khirnov To: ffmpeg-devel@ffmpeg.org Date: Fri, 7 Jul 2023 12:42:52 +0200 Message-Id: <20230707104251.19707-1-anton@khirnov.net> X-Mailer: git-send-email 2.40.1 In-Reply-To: <20230623144147.7940-2-anton@khirnov.net> References: <20230623144147.7940-2-anton@khirnov.net> MIME-Version: 1.0 Subject: [FFmpeg-devel] [PATCH] tests/fate-run: add testing with a random number of threads X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: Useful for discovering bugs that depend on a specific thread count. Use like THREADS=randomX for a random thread count from 1 to X, with X=16 when not specified. --- Now using the awk rand() function, also used in configure. The thread count can now be written into the errfile on test failure. --- doc/fate.texi | 8 ++++++++ tests/fate-run.sh | 10 ++++++++++ 2 files changed, 18 insertions(+) diff --git a/doc/fate.texi b/doc/fate.texi index 8450856015..2fa8c34c2d 100644 --- a/doc/fate.texi +++ b/doc/fate.texi @@ -223,6 +223,14 @@ meaning only while running the regression tests. Specify how many threads to use while running regression tests, it is quite useful to detect thread-related regressions. +This variable may be set to the string "random", optionally followed by a +number, like "random99", This will cause each test to use a random number of +threads. If a number is specified, it is used as a maximum number of threads, +otherwise 16 is the maximum. + +In case a test fails, the thread count used for it will be written into the +errfile. + @item THREAD_TYPE Specify which threading strategy test, either @samp{slice} or @samp{frame}, by default @samp{slice+frame} diff --git a/tests/fate-run.sh b/tests/fate-run.sh index e12279e4cf..5a71ac001e 100755 --- a/tests/fate-run.sh +++ b/tests/fate-run.sh @@ -33,6 +33,15 @@ errfile="${outdir}/${test}.err" cmpfile="${outdir}/${test}.diff" repfile="${outdir}/${test}.rep" +case $threads in + random*) + threads_max=${threads#random} + [ -z "$threads_max" ] && threads_max=16 + threads=$(awk "BEGIN { print 1+int(rand() * $threads_max) }" < /dev/null) + ;; +esac + + target_path(){ test ${1} = ${1#/} && p=${target_path}/ echo ${p}${1} @@ -630,6 +639,7 @@ fi if [ $err -eq 0 ] && test $report_type = "standard" ; then unset cmpo erro else + echo "threads=$threads" >> "$errfile" cmpo="$($base64 <$cmpfile)" erro="$($base64 <$errfile)" fi -- 2.40.1 _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".