Git Inbox Mirror of the ffmpeg-devel mailing list - see https://ffmpeg.org/mailman/listinfo/ffmpeg-devel
 help / color / mirror / Atom feed
* [FFmpeg-devel] Issue - Error Due to higher number of threads
@ 2022-05-12  2:22 Srihari Sridhar
  2022-05-12 11:14 ` Timo Rothenpieler
  0 siblings, 1 reply; 6+ messages in thread
From: Srihari Sridhar @ 2022-05-12  2:22 UTC (permalink / raw)
  To: ffmpeg-devel


[-- Attachment #1.1: Type: text/plain, Size: 600 bytes --]

Hi,

I was building ffmpeg through windows. While I was able to successfully
able to build for smaller number of threads, for larger number of threads I
faced an issue

The commands I used were
bash ./configure --arch=x86 --target-os=mingw32 --disable-x86asm
make -j <no_of_Threads>

While building with 4 Threads the build was successful
Screenshot:
[image: image.png]

While building with 64 threads, I faced the following error,
Screenshot :
[image: image.png]
 semaphore or child process wait (Error 87 : The parameter is incorrect)

Please could you check this issue. Thanks

Regards,
S Srihari

[-- Attachment #1.2: image.png --]
[-- Type: image/png, Size: 134936 bytes --]

[-- Attachment #1.3: image.png --]
[-- Type: image/png, Size: 156035 bytes --]

[-- Attachment #2: Type: text/plain, Size: 251 bytes --]

_______________________________________________
ffmpeg-devel mailing list
ffmpeg-devel@ffmpeg.org
https://ffmpeg.org/mailman/listinfo/ffmpeg-devel

To unsubscribe, visit link above, or email
ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [FFmpeg-devel] Issue - Error Due to higher number of threads
  2022-05-12  2:22 [FFmpeg-devel] Issue - Error Due to higher number of threads Srihari Sridhar
@ 2022-05-12 11:14 ` Timo Rothenpieler
  2022-05-19  9:32   ` Srihari Sridhar
  0 siblings, 1 reply; 6+ messages in thread
From: Timo Rothenpieler @ 2022-05-12 11:14 UTC (permalink / raw)
  To: ffmpeg-devel

On 12.05.2022 04:22, Srihari Sridhar wrote:
> Hi,
> 
> I was building ffmpeg through windows. While I was able to successfully
> able to build for smaller number of threads, for larger number of threads I
> faced an issue
> 
> The commands I used were
> bash ./configure --arch=x86 --target-os=mingw32 --disable-x86asm
> make -j <no_of_Threads>
> 
> While building with 4 Threads the build was successful
> Screenshot:
> [image: image.png]
> 
> While building with 64 threads, I faced the following error,
> Screenshot :
> [image: image.png]
>   semaphore or child process wait (Error 87 : The parameter is incorrect)

Please don't use images for plain text. It's hard to access and barely 
legible.

> Please could you check this issue. Thanks

You probably just ran out of RAM or something. Highly unlikely that this 
is an issue with ffmpeg.
_______________________________________________
ffmpeg-devel mailing list
ffmpeg-devel@ffmpeg.org
https://ffmpeg.org/mailman/listinfo/ffmpeg-devel

To unsubscribe, visit link above, or email
ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [FFmpeg-devel] Issue - Error Due to higher number of threads
  2022-05-12 11:14 ` Timo Rothenpieler
@ 2022-05-19  9:32   ` Srihari Sridhar
  2022-05-19 10:12     ` Wolfgang Haupt
  0 siblings, 1 reply; 6+ messages in thread
From: Srihari Sridhar @ 2022-05-19  9:32 UTC (permalink / raw)
  To: FFmpeg development discussions and patches

[-- Attachment #1: Type: text/plain, Size: 1695 bytes --]

Hi,

Thanks for the reply. I checked the memory usage while building ffmpeg with
64 threads. The machine I tested has 128 GB ram. While I tested it I found
that maximum memory utilized by the build of ffmpeg was 17GB.  Still the
build throws up error semaphore or child process wait (Error 87 : The
parameter is incorrect). Hence could you check on the same please. I have
attached screenshots of memory utilized from the task manager.

Regards,
S Srihari

On Thu, 12 May 2022 at 16:45, Timo Rothenpieler <timo@rothenpieler.org>
wrote:

> On 12.05.2022 04:22, Srihari Sridhar wrote:
> > Hi,
> >
> > I was building ffmpeg through windows. While I was able to successfully
> > able to build for smaller number of threads, for larger number of
> threads I
> > faced an issue
> >
> > The commands I used were
> > bash ./configure --arch=x86 --target-os=mingw32 --disable-x86asm
> > make -j <no_of_Threads>
> >
> > While building with 4 Threads the build was successful
> > Screenshot:
> > [image: image.png]
> >
> > While building with 64 threads, I faced the following error,
> > Screenshot :
> > [image: image.png]
> >   semaphore or child process wait (Error 87 : The parameter is incorrect)
>
> Please don't use images for plain text. It's hard to access and barely
> legible.
>
> > Please could you check this issue. Thanks
>
> You probably just ran out of RAM or something. Highly unlikely that this
> is an issue with ffmpeg.
> _______________________________________________
> ffmpeg-devel mailing list
> ffmpeg-devel@ffmpeg.org
> https://ffmpeg.org/mailman/listinfo/ffmpeg-devel
>
> To unsubscribe, visit link above, or email
> ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".
>

[-- Attachment #2: memory used ffmpeg.png --]
[-- Type: image/png, Size: 12672 bytes --]

[-- Attachment #3: error message ffmeg build.png --]
[-- Type: image/png, Size: 12479 bytes --]

[-- Attachment #4: Type: text/plain, Size: 251 bytes --]

_______________________________________________
ffmpeg-devel mailing list
ffmpeg-devel@ffmpeg.org
https://ffmpeg.org/mailman/listinfo/ffmpeg-devel

To unsubscribe, visit link above, or email
ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [FFmpeg-devel] Issue - Error Due to higher number of threads
  2022-05-19  9:32   ` Srihari Sridhar
@ 2022-05-19 10:12     ` Wolfgang Haupt
  2022-05-23 12:30       ` Srihari Sridhar
  0 siblings, 1 reply; 6+ messages in thread
From: Wolfgang Haupt @ 2022-05-19 10:12 UTC (permalink / raw)
  To: FFmpeg development discussions and patches, Srihari Sridhar

> Hi,
>
> Thanks for the reply. I checked the memory usage while building ffmpeg with
> 64 threads. The machine I tested has 128 GB ram. While I tested it I found
> that maximum memory utilized by the build of ffmpeg was 17GB.  Still the
> build throws up error semaphore or child process wait (Error 87 : The
> parameter is incorrect). Hence could you check on the same please. I have
> attached screenshots of memory utilized from the task manager.

What CPU are you on?
There is some complexity regarding the amount of threads and
process groups on windows, see: 
https://www.windowscentral.com/windows-10-pro-cant-handle-amd-threadripper-3990xs-128-threads

Do you even have a processor that will utilize 64 cores?
I recommend trying with smaller values and see where "windows make" 
starts to fail.

>
> Regards,
> S Srihari
>
> On Thu, 12 May 2022 at 16:45, Timo Rothenpieler <timo@rothenpieler.org>
> wrote:
>
>> On 12.05.2022 04:22, Srihari Sridhar wrote:
>>> Hi,
>>>
>>> I was building ffmpeg through windows. While I was able to successfully
>>> able to build for smaller number of threads, for larger number of
>> threads I
>>> faced an issue
>>>
>>> The commands I used were
>>> bash ./configure --arch=x86 --target-os=mingw32 --disable-x86asm
>>> make -j <no_of_Threads>
>>>
>>> While building with 4 Threads the build was successful
>>> Screenshot:
>>> [image: image.png]
>>>
>>> While building with 64 threads, I faced the following error,
>>> Screenshot :
>>> [image: image.png]
>>>    semaphore or child process wait (Error 87 : The parameter is incorrect)
>> Please don't use images for plain text. It's hard to access and barely
>> legible.
>>
>>> Please could you check this issue. Thanks
>> You probably just ran out of RAM or something. Highly unlikely that this
>> is an issue with ffmpeg.
>> _______________________________________________
>> ffmpeg-devel mailing list
>> ffmpeg-devel@ffmpeg.org
>> https://ffmpeg.org/mailman/listinfo/ffmpeg-devel
>>
>> To unsubscribe, visit link above, or email
>> ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".
>>
>>
>> _______________________________________________
>> ffmpeg-devel mailing list
>> ffmpeg-devel@ffmpeg.org
>> https://ffmpeg.org/mailman/listinfo/ffmpeg-devel
>>
>> To unsubscribe, visit link above, or email
>> ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".
_______________________________________________
ffmpeg-devel mailing list
ffmpeg-devel@ffmpeg.org
https://ffmpeg.org/mailman/listinfo/ffmpeg-devel

To unsubscribe, visit link above, or email
ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [FFmpeg-devel] Issue - Error Due to higher number of threads
  2022-05-19 10:12     ` Wolfgang Haupt
@ 2022-05-23 12:30       ` Srihari Sridhar
  2022-05-26 15:53         ` Srihari Sridhar
  0 siblings, 1 reply; 6+ messages in thread
From: Srihari Sridhar @ 2022-05-23 12:30 UTC (permalink / raw)
  To: Wolfgang Haupt, ffmpeg-devel

Hi,

I tried on AMD ThreadRipper 3990x machine. It has 64 cores and 128 logical
processors. The windows make starts failing with 64 threads.It worked
successfully until 32 and even 48 threads.

Regards,
S Srihari

On Thu, 19 May 2022 at 15:42, Wolfgang Haupt <haupt.wolfgang@gmail.com>
wrote:

> > Hi,
> >
> > Thanks for the reply. I checked the memory usage while building ffmpeg
> with
> > 64 threads. The machine I tested has 128 GB ram. While I tested it I
> found
> > that maximum memory utilized by the build of ffmpeg was 17GB.  Still the
> > build throws up error semaphore or child process wait (Error 87 : The
> > parameter is incorrect). Hence could you check on the same please. I have
> > attached screenshots of memory utilized from the task manager.
>
> What CPU are you on?
> There is some complexity regarding the amount of threads and
> process groups on windows, see:
>
> https://www.windowscentral.com/windows-10-pro-cant-handle-amd-threadripper-3990xs-128-threads
>
> Do you even have a processor that will utilize 64 cores?
> I recommend trying with smaller values and see where "windows make"
> starts to fail.
>
> >
> > Regards,
> > S Srihari
> >
> > On Thu, 12 May 2022 at 16:45, Timo Rothenpieler <timo@rothenpieler.org>
> > wrote:
> >
> >> On 12.05.2022 04:22, Srihari Sridhar wrote:
> >>> Hi,
> >>>
> >>> I was building ffmpeg through windows. While I was able to successfully
> >>> able to build for smaller number of threads, for larger number of
> >> threads I
> >>> faced an issue
> >>>
> >>> The commands I used were
> >>> bash ./configure --arch=x86 --target-os=mingw32 --disable-x86asm
> >>> make -j <no_of_Threads>
> >>>
> >>> While building with 4 Threads the build was successful
> >>> Screenshot:
> >>> [image: image.png]
> >>>
> >>> While building with 64 threads, I faced the following error,
> >>> Screenshot :
> >>> [image: image.png]
> >>>    semaphore or child process wait (Error 87 : The parameter is
> incorrect)
> >> Please don't use images for plain text. It's hard to access and barely
> >> legible.
> >>
> >>> Please could you check this issue. Thanks
> >> You probably just ran out of RAM or something. Highly unlikely that this
> >> is an issue with ffmpeg.
> >> _______________________________________________
> >> ffmpeg-devel mailing list
> >> ffmpeg-devel@ffmpeg.org
> >> https://ffmpeg.org/mailman/listinfo/ffmpeg-devel
> >>
> >> To unsubscribe, visit link above, or email
> >> ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".
> >>
> >>
> >> _______________________________________________
> >> ffmpeg-devel mailing list
> >> ffmpeg-devel@ffmpeg.org
> >> https://ffmpeg.org/mailman/listinfo/ffmpeg-devel
> >>
> >> To unsubscribe, visit link above, or email
> >> ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".
>
_______________________________________________
ffmpeg-devel mailing list
ffmpeg-devel@ffmpeg.org
https://ffmpeg.org/mailman/listinfo/ffmpeg-devel

To unsubscribe, visit link above, or email
ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [FFmpeg-devel] Issue - Error Due to higher number of threads
  2022-05-23 12:30       ` Srihari Sridhar
@ 2022-05-26 15:53         ` Srihari Sridhar
  0 siblings, 0 replies; 6+ messages in thread
From: Srihari Sridhar @ 2022-05-26 15:53 UTC (permalink / raw)
  To: Wolfgang Haupt, FFmpeg development discussions and patches

Hi,

Any updates or new ideas on the issue?

Yours truly,
S Srihari

On Mon, 23 May 2022 at 18:00, Srihari Sridhar <gshari9918@gmail.com> wrote:

> Hi,
>
> I tried on AMD ThreadRipper 3990x machine. It has 64 cores and 128 logical
> processors. The windows make starts failing with 64 threads.It worked
> successfully until 32 and even 48 threads.
>
> Regards,
> S Srihari
>
> On Thu, 19 May 2022 at 15:42, Wolfgang Haupt <haupt.wolfgang@gmail.com>
> wrote:
>
>> > Hi,
>> >
>> > Thanks for the reply. I checked the memory usage while building ffmpeg
>> with
>> > 64 threads. The machine I tested has 128 GB ram. While I tested it I
>> found
>> > that maximum memory utilized by the build of ffmpeg was 17GB.  Still the
>> > build throws up error semaphore or child process wait (Error 87 : The
>> > parameter is incorrect). Hence could you check on the same please. I
>> have
>> > attached screenshots of memory utilized from the task manager.
>>
>> What CPU are you on?
>> There is some complexity regarding the amount of threads and
>> process groups on windows, see:
>>
>> https://www.windowscentral.com/windows-10-pro-cant-handle-amd-threadripper-3990xs-128-threads
>>
>> Do you even have a processor that will utilize 64 cores?
>> I recommend trying with smaller values and see where "windows make"
>> starts to fail.
>>
>> >
>> > Regards,
>> > S Srihari
>> >
>> > On Thu, 12 May 2022 at 16:45, Timo Rothenpieler <timo@rothenpieler.org>
>> > wrote:
>> >
>> >> On 12.05.2022 04:22, Srihari Sridhar wrote:
>> >>> Hi,
>> >>>
>> >>> I was building ffmpeg through windows. While I was able to
>> successfully
>> >>> able to build for smaller number of threads, for larger number of
>> >> threads I
>> >>> faced an issue
>> >>>
>> >>> The commands I used were
>> >>> bash ./configure --arch=x86 --target-os=mingw32 --disable-x86asm
>> >>> make -j <no_of_Threads>
>> >>>
>> >>> While building with 4 Threads the build was successful
>> >>> Screenshot:
>> >>> [image: image.png]
>> >>>
>> >>> While building with 64 threads, I faced the following error,
>> >>> Screenshot :
>> >>> [image: image.png]
>> >>>    semaphore or child process wait (Error 87 : The parameter is
>> incorrect)
>> >> Please don't use images for plain text. It's hard to access and barely
>> >> legible.
>> >>
>> >>> Please could you check this issue. Thanks
>> >> You probably just ran out of RAM or something. Highly unlikely that
>> this
>> >> is an issue with ffmpeg.
>> >> _______________________________________________
>> >> ffmpeg-devel mailing list
>> >> ffmpeg-devel@ffmpeg.org
>> >> https://ffmpeg.org/mailman/listinfo/ffmpeg-devel
>> >>
>> >> To unsubscribe, visit link above, or email
>> >> ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".
>> >>
>> >>
>> >> _______________________________________________
>> >> ffmpeg-devel mailing list
>> >> ffmpeg-devel@ffmpeg.org
>> >> https://ffmpeg.org/mailman/listinfo/ffmpeg-devel
>> >>
>> >> To unsubscribe, visit link above, or email
>> >> ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".
>>
>
_______________________________________________
ffmpeg-devel mailing list
ffmpeg-devel@ffmpeg.org
https://ffmpeg.org/mailman/listinfo/ffmpeg-devel

To unsubscribe, visit link above, or email
ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".

^ permalink raw reply	[flat|nested] 6+ messages in thread

end of thread, other threads:[~2022-05-26 15:53 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-05-12  2:22 [FFmpeg-devel] Issue - Error Due to higher number of threads Srihari Sridhar
2022-05-12 11:14 ` Timo Rothenpieler
2022-05-19  9:32   ` Srihari Sridhar
2022-05-19 10:12     ` Wolfgang Haupt
2022-05-23 12:30       ` Srihari Sridhar
2022-05-26 15:53         ` Srihari Sridhar

Git Inbox Mirror of the ffmpeg-devel mailing list - see https://ffmpeg.org/mailman/listinfo/ffmpeg-devel

This inbox may be cloned and mirrored by anyone:

	git clone --mirror https://master.gitmailbox.com/ffmpegdev/0 ffmpegdev/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 ffmpegdev ffmpegdev/ https://master.gitmailbox.com/ffmpegdev \
		ffmpegdev@gitmailbox.com
	public-inbox-index ffmpegdev

Example config snippet for mirrors.


AGPL code for this site: git clone https://public-inbox.org/public-inbox.git