lilypond-devel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Race condition with 'make test'?


From: Jean Abou Samra
Subject: Re: Race condition with 'make test'?
Date: Tue, 16 Nov 2021 21:54:53 +0100
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.2.1

Le 16/11/2021 à 20:33, Aaron Hill a écrit :
As recommended for a quad-core CPU, I am running the tests with:

  make test -j4 CPU_COUNT=4

Consistently after a clean build, I encounter errors.  Here is a snippet from the end of the run:

========================================================================
Making input/regression/lilypond-book/out-test/html-newline-after-tag.html < html Making input/regression/lilypond-book/out-test/html-space-after-tag.html < html Making input/regression/lilypond-book/out-test/html-version-newline.html < html
Making input/regression/lilypond-book/out-test/html-version.html < html
Making input/regression/lilypond-book/out-test/suffix-html.html < html
Making input/regression/lilypond-book/out-test/suffix-htmly.html < htmly
Command '/home/seraku/sources/seraku24-lilypond/build/out/bin/lilypond -dseparate-page-formats=ps,pdf -djob-count=4 -dinclude-eps-fonts -dgs-load-fonts --header=doctitle --header=doctitleen --header=doctitleca --header=doctitlecs --header=doctitlede --header=doctitlees --header=doctitlefr --header=doctitlehu --header=doctitleit --header=doctitleja --header=doctitlenl --header=doctitlept --header=doctitlezh --header=texidoc --header=texidocen --header=texidocca --header=texidoccs --header=texidocde --header=texidoces --header=texidocfr --header=texidochu --header=texidocit --header=texidocja --header=texidocnl --header=texidocpt --header=texidoczh -dcheck-internal-types -ddump-signatures -danti-alias-factor=2 -dfont-ps-resdir=/home/seraku/sources/seraku24-lilypond/build/out-fonts -O TeX-GS -I "/home/seraku/sources/seraku24-lilypond/input/regression/lilypond-book" -I "/home/seraku/sources/seraku24-lilypond/build/input/regression/lilypond-book" -daux-files  -dread-file-list -dno-strip-output-dir -dtall-page-formats=eps,png "/home/seraku/sources/seraku24-lilypond/build/out/lybook-testdb/snippet-names-61b30dd81bd87a312f904a4169dc2d27.ly"' returned non-zero exit status 1. /home/seraku/sources/seraku24-lilypond/build/.././input/regression/lilypond-book/GNUmakefile:31: recipe for target 'out-test/suffix-html.html' failed
make[2]: *** [out-test/suffix-html.html] Error 1
make[2]: *** Waiting for unfinished jobs....
/usr/lib/python3/dist-packages/apport/report.py:13: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import fnmatch, glob, traceback, errno, sys, atexit, locale, imp, stat
Traceback (most recent call last):
  File "/home/seraku/sources/seraku24-lilypond/build/../scripts/lilypond-book.py", line 731, in <module>
    main()
  File "/home/seraku/sources/seraku24-lilypond/build/../scripts/lilypond-book.py", line 713, in main
    do_process_cmd(chunks, global_options)
  File "/home/seraku/sources/seraku24-lilypond/build/../scripts/lilypond-book.py", line 416, in do_process_cmd
    do_process_cmd_locked(snippets, options)
  File "/home/seraku/sources/seraku24-lilypond/build/../scripts/lilypond-book.py", line 440, in do_process_cmd_locked
    options.formatter, options.lily_output_dir)
  File "/home/seraku/sources/seraku24-lilypond/build/../scripts/lilypond-book.py", line 383, in process_snippets
    os.unlink(snippet_names_path)
FileNotFoundError: [Errno 2] No such file or directory: '/home/seraku/sources/seraku24-lilypond/build/out/lybook-testdb/snippet-names-61b30dd81bd87a312f904a4169dc2d27.ly' /usr/lib/python3/dist-packages/apport/report.py:13: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import fnmatch, glob, traceback, errno, sys, atexit, locale, imp, stat
Traceback (most recent call last):
  File "/home/seraku/sources/seraku24-lilypond/build/../scripts/lilypond-book.py", line 731, in <module>
    main()
  File "/home/seraku/sources/seraku24-lilypond/build/../scripts/lilypond-book.py", line 713, in main
    do_process_cmd(chunks, global_options)
  File "/home/seraku/sources/seraku24-lilypond/build/../scripts/lilypond-book.py", line 416, in do_process_cmd
    do_process_cmd_locked(snippets, options)
  File "/home/seraku/sources/seraku24-lilypond/build/../scripts/lilypond-book.py", line 440, in do_process_cmd_locked
    options.formatter, options.lily_output_dir)
  File "/home/seraku/sources/seraku24-lilypond/build/../scripts/lilypond-book.py", line 383, in process_snippets
    os.unlink(snippet_names_path)
FileNotFoundError: [Errno 2] No such file or directory: '/home/seraku/sources/seraku24-lilypond/build/out/lybook-testdb/snippet-names-61b30dd81bd87a312f904a4169dc2d27.ly' /home/seraku/sources/seraku24-lilypond/build/.././input/regression/lilypond-book/GNUmakefile:31: recipe for target 'out-test/html-space-after-tag.html' failed
make[2]: *** [out-test/html-space-after-tag.html] Error 1
/home/seraku/sources/seraku24-lilypond/build/.././input/regression/lilypond-book/GNUmakefile:35: recipe for target 'out-test/suffix-htmly.html' failed
make[2]: *** [out-test/suffix-htmly.html] Error 1
/home/seraku/sources/seraku24-lilypond/build/.././input/regression/lilypond-book/GNUmakefile:19: recipe for target 'local-test' failed
make[1]: *** [local-test] Error 2
/home/seraku/sources/seraku24-lilypond/build/../GNUmakefile.in:299: recipe for target 'test' failed
make: *** [test] Error 2
========================================================================

I can eventually finish the tests by running the command again to pick up where the previous run left off, though it would be nice to have it complete in a single invocation.

This is not a blocking issue, and I will experiment with fewer jobs/lower CPU count to see if I can find a balance between execution time and reliability.


I cannot reproduce (I tried both normal builds and
with ./autogen.sh --enable-cairo-backend).

- What do you get when running the grepping shell
  commands advised at the top of the make test output?

- Does it reproduce on a slightly older version, say,
  release/2.23.4-1? If so, it might be related to
  Han-Wen's recent lilypond-book infrastructure changes.

Best,
Jean




reply via email to

[Prev in Thread] Current Thread [Next in Thread]