Git Inbox Mirror of the ffmpeg-devel mailing list - see https://ffmpeg.org/mailman/listinfo/ffmpeg-devel
 help / color / mirror / Atom feed
From: softworkz <ffmpegagent@gmail.com>
To: ffmpeg-devel@ffmpeg.org
Cc: softworkz <softworkz@hotmail.com>
Subject: [FFmpeg-devel] [PATCH v3] ffbuild/commonmak: Fix rebuild check with implicit rule chains
Date: Tue, 20 May 2025 23:32:57 +0000
Message-ID: <pull.80.v3.ffstaging.FFmpeg.1747783977790.ffmpegagent@gmail.com> (raw)
In-Reply-To: <pull.80.v2.ffstaging.FFmpeg.1747549830700.ffmpegagent@gmail.com>

From: softworkz <softworkz@hotmail.com>

When there's a chain of implicit rules, make treats files generated
inside that chain as intermediate files. Those intermediate files are
removed after completion of make. When make is run again, it normally
determines the need for a rebuild by comparing the timestamps of the
original source file and the final output of the chain and if still
up-to-date, it doesn't rebuild, even when the intermediate files are
not present. That makes sense of course - why would it delete them
otherwise, it would end up in builds being never up-to-date.
But this original by-the-book logic appeared to be broken and has been
worked around by adding all intermediate files to the .SECONDARY
special target, which required extra logic and issues with make clean.

What broke the up-to-date checking is the dependency file generation.
For the .c files generated by BIN2C the compile target created a .d
file which indicated that the .ptx.o file has a dependency on the
ptx.c file. And that dependency broke the normal make behavior with
intermediate files.

This patch compiles the BIN2C generated .c files without generating
.d files. In turn the files do not longer need to be added to the
.SECONDARY target in common.mak.

When interested in those files for debugging, a line can be added to
the corresponding Makefile like

.SECONDARY: %.ptx.c %.ptx.gz

Signed-off-by: softworkz <softworkz@hotmail.com>
---
    ffbuild/commonmak: Fix rebuild check with implicit rule chains
    
    When there's a chain of implicit rules, make treats files generated
    inside that chain as intermediate files. Those intermediate files are
    removed after completion of make. When make is run again, it normally
    determines the need for a rebuild by comparing the timestamps of the
    original source file and the final output of the chain and if still
    up-to-date, it doesn't rebuild, even when the intermediate files are not
    present. That makes sense of course - why would it delete them
    otherwise, it would end up in builds being never up-to-date. But this
    original by-the-book logic appeared to be broken and has been worked
    around by adding all intermediate files to the .SECONDARY special
    target, which required extra logic and issues with make clean.
    
    What broke the up-to-date checking is the dependency file generation.
    For the .c files generated by BIN2C the compile target created a .d file
    which indicated that the .ptx.o file has a dependency on the ptx.c file.
    And that dependency broke the normal make behavior with intermediate
    files.
    
    This patch compiles the BIN2C generated .c files without generating .d
    files. In turn the files do not longer need to be added to the
    .SECONDARY target in common.mak.
    
    When interested in those files for debugging, a line can be added to the
    corresponding Makefile like
    
    .SECONDARY: %.ptx.c %.ptx.gz
    
    
    V2
    ==
    
     * Fix MSVC build
       (use the universal command pattern)
    
    
    V3
    ==
    
     * Skip dependency generation by clearing CC_DEPS instead
       (as suggested by Ramiro - thanks!)
    
    .

Published-As: https://github.com/ffstaging/FFmpeg/releases/tag/pr-ffstaging-80%2Fsoftworkz%2Fsubmit_commonmak-v3
Fetch-It-Via: git fetch https://github.com/ffstaging/FFmpeg pr-ffstaging-80/softworkz/submit_commonmak-v3
Pull-Request: https://github.com/ffstaging/FFmpeg/pull/80

Range-diff vs v2:

 1:  f468ea2431 ! 1:  981329e5d9 ffbuild/commonmak: Fix rebuild check with implicit rule chains
     @@ ffbuild/common.mak: else
       	$(BIN2C) $(patsubst $(SRC_PATH)/%,$(SRC_LINK)/%,$<) $@ $(subst .,_,$(basename $(notdir $@)))
       endif
       
     -+%.ptx.o: %.ptx.c
     -+	$(CC) $(CCFLAGS) $(CC_C) $(CC_O) $(patsubst $(SRC_PATH)/%,$(SRC_LINK)/%,$<)
     ++%.ptx.o: CCDEP       =
     ++%.ptx.o: CC_DEPFLAGS =
      +
      +
       # 1) Preprocess CSS to a minified version
     @@ ffbuild/common.mak: else   # NO COMPRESSION
       	$(BIN2C) $< $@ $(subst .,_,$(basename $(notdir $@)))
       endif
       
     -+%.html.o: %.html.c
     -+	$(CC) $(CCFLAGS) $(CC_C) $(CC_O) $(patsubst $(SRC_PATH)/%,$(SRC_LINK)/%,$<)
     -+
     -+%.css.o: %.css.c
     -+	$(CC) $(CCFLAGS) $(CC_C) $(CC_O) $(patsubst $(SRC_PATH)/%,$(SRC_LINK)/%,$<)
     ++%.html.o %.css.o: CCDEP       =
     ++%.html.o %.css.o: CC_DEPFLAGS =
      +
      +
       clean::


 ffbuild/common.mak | 12 +++++++++---
 1 file changed, 9 insertions(+), 3 deletions(-)

diff --git a/ffbuild/common.mak b/ffbuild/common.mak
index 0e1eb1f62b..c503dce6b0 100644
--- a/ffbuild/common.mak
+++ b/ffbuild/common.mak
@@ -139,6 +139,10 @@ else
 	$(BIN2C) $(patsubst $(SRC_PATH)/%,$(SRC_LINK)/%,$<) $@ $(subst .,_,$(basename $(notdir $@)))
 endif
 
+%.ptx.o: CCDEP       =
+%.ptx.o: CC_DEPFLAGS =
+
+
 # 1) Preprocess CSS to a minified version
 %.css.min: %.css
 	# Must start with a tab in the real Makefile
@@ -177,6 +181,10 @@ else   # NO COMPRESSION
 	$(BIN2C) $< $@ $(subst .,_,$(basename $(notdir $@)))
 endif
 
+%.html.o %.css.o: CCDEP       =
+%.html.o %.css.o: CC_DEPFLAGS =
+
+
 clean::
 	$(RM) $(BIN2CEXE) $(CLEANSUFFIXES:%=ffbuild/%)
 
@@ -228,11 +236,9 @@ ALLHEADERS := $(subst $(SRC_DIR)/,$(SUBDIR),$(wildcard $(SRC_DIR)/*.h $(SRC_DIR)
 SKIPHEADERS += $(ARCH_HEADERS:%=$(ARCH)/%) $(SKIPHEADERS-)
 SKIPHEADERS := $(SKIPHEADERS:%=$(SUBDIR)%)
 HOBJS        = $(filter-out $(SKIPHEADERS:.h=.h.o),$(ALLHEADERS:.h=.h.o))
-PTXOBJS      = $(filter %.ptx.o,$(OBJS))
-RESOURCEOBJS = $(filter %.css.o %.html.o,$(OBJS))
 $(HOBJS):     CCFLAGS += $(CFLAGS_HEADERS)
 checkheaders: $(HOBJS)
-.SECONDARY:   $(HOBJS:.o=.c) $(PTXOBJS:.o=.c) $(PTXOBJS:.o=.gz) $(PTXOBJS:.o=) $(RESOURCEOBJS:.o=.c) $(RESOURCEOBJS:%.css.o=%.css.min) $(RESOURCEOBJS:%.css.o=%.css.min.gz) $(RESOURCEOBJS:%.html.o=%.html.gz) $(RESOURCEOBJS:.o=)
+.SECONDARY:   $(HOBJS:.o=.c)
 
 alltools: $(TOOLS)
 

base-commit: fd18ae88ae736b5aabff34e17394fcd103f9e5ad
-- 
ffmpeg-codebot
_______________________________________________
ffmpeg-devel mailing list
ffmpeg-devel@ffmpeg.org
https://ffmpeg.org/mailman/listinfo/ffmpeg-devel

To unsubscribe, visit link above, or email
ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".

  parent reply	other threads:[~2025-05-20 23:33 UTC|newest]

Thread overview: 17+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-05-18  2:14 [FFmpeg-devel] [PATCH] " softworkz
2025-05-18  6:30 ` [FFmpeg-devel] [PATCH v2] " softworkz
2025-05-20 19:09   ` softworkz .
2025-05-20 19:36   ` Ramiro Polla
2025-05-20 19:46     ` softworkz .
2025-05-20 20:28       ` Ramiro Polla
2025-05-20 21:13         ` softworkz .
2025-05-20 21:51           ` softworkz .
2025-05-20 23:32   ` softworkz [this message]
2025-05-23 22:05     ` [FFmpeg-devel] [PATCH v4] " softworkz
2025-05-27 21:41       ` [FFmpeg-devel] [PATCH v5 0/2] " ffmpegagent
2025-05-27 21:41         ` [FFmpeg-devel] [PATCH v5 1/2] " softworkz
2025-05-27 21:41         ` [FFmpeg-devel] [PATCH v5 2/2] ffbuild/commonmak: Consolidate pattern rules for compression softworkz
2025-06-17 16:01         ` [FFmpeg-devel] [PATCH v6 0/2] ffbuild/commonmak: Fix rebuild check with implicit rule chains ffmpegagent
2025-06-17 16:01           ` [FFmpeg-devel] [PATCH v6 1/2] " softworkz
2025-06-17 16:01           ` [FFmpeg-devel] [PATCH v6 2/2] ffbuild/commonmak: Consolidate pattern rules for compression softworkz
2025-06-17 16:41           ` [FFmpeg-devel] [PATCH v6 0/2] ffbuild/commonmak: Fix rebuild check with implicit rule chains softworkz .

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=pull.80.v3.ffstaging.FFmpeg.1747783977790.ffmpegagent@gmail.com \
    --to=ffmpegagent@gmail.com \
    --cc=ffmpeg-devel@ffmpeg.org \
    --cc=softworkz@hotmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

Git Inbox Mirror of the ffmpeg-devel mailing list - see https://ffmpeg.org/mailman/listinfo/ffmpeg-devel

This inbox may be cloned and mirrored by anyone:

	git clone --mirror https://master.gitmailbox.com/ffmpegdev/0 ffmpegdev/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 ffmpegdev ffmpegdev/ https://master.gitmailbox.com/ffmpegdev \
		ffmpegdev@gitmailbox.com
	public-inbox-index ffmpegdev

Example config snippet for mirrors.


AGPL code for this site: git clone https://public-inbox.org/public-inbox.git