Created
March 14, 2026 17:57
-
-
Save Flamefire/f387b5f0f6dc5a5ea0a756abda836d02 to your computer and use it in GitHub Desktop.
(partial) EasyBuild log for failed build of /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1-foss-2024a-CUDA-12.6.0.eb (PR(s) #24365)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| == 2026-03-14 18:48:28,787 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-_2rmvebo/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-_2rmvebo/out.txt | |
| == 2026-03-14 18:48:28,788 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:28,788 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.0_skip-test_convolution1-on-H100.patch | |
| == 2026-03-14 18:48:28,798 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:28,799 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/inductor/test_select_algorithm.py | |
| == 2026-03-14 18:48:28,799 easyblock.py:2923 INFO Applying patch PyTorch-2.9.0_skip-test_inductor_all_gather_into_tensor_coalesced.patch | |
| == 2026-03-14 18:48:28,813 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-8mpc5aml/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-8mpc5aml/out.txt | |
| == 2026-03-14 18:48:28,814 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:28,814 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.0_skip-test_inductor_all_gather_into_tensor_coalesced.patch | |
| == 2026-03-14 18:48:28,824 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:28,824 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/distributed/test_c10d_functional_native.py | |
| == 2026-03-14 18:48:28,825 easyblock.py:2923 INFO Applying patch PyTorch-2.9.0_skip-test_original_aten_preserved_pad_mm.patch | |
| == 2026-03-14 18:48:28,837 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-clcrrdq_/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-clcrrdq_/out.txt | |
| == 2026-03-14 18:48:28,838 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:28,838 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.0_skip-test_original_aten_preserved_pad_mm.patch | |
| == 2026-03-14 18:48:28,849 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:28,850 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/inductor/test_pad_mm.py | |
| Hunk #1 succeeded at 511 (offset 3 lines). | |
| == 2026-03-14 18:48:28,850 easyblock.py:2923 INFO Applying patch PyTorch-2.9.0_skip-test_override-without-CUDA.patch | |
| == 2026-03-14 18:48:28,861 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-aeun1s1q/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-aeun1s1q/out.txt | |
| == 2026-03-14 18:48:28,862 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:28,862 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.0_skip-test_override-without-CUDA.patch | |
| == 2026-03-14 18:48:28,873 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:28,873 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/test_overrides.py | |
| == 2026-03-14 18:48:28,874 easyblock.py:2923 INFO Applying patch PyTorch-2.9.0_skip-tests-requiring-CUDA-12.8.patch | |
| == 2026-03-14 18:48:28,886 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-yda6lt0q/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-yda6lt0q/out.txt | |
| == 2026-03-14 18:48:28,887 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:28,887 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.0_skip-tests-requiring-CUDA-12.8.patch | |
| == 2026-03-14 18:48:28,899 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:28,899 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/inductor/test_aot_inductor.py | |
| patching file test/inductor/test_aot_inductor_package.py | |
| patching file torch/testing/_internal/common_cuda.py | |
| == 2026-03-14 18:48:28,899 easyblock.py:2923 INFO Applying patch PyTorch-2.9.0_skip-test_unbacked_reduction.patch | |
| == 2026-03-14 18:48:28,912 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-oqkoxm8g/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-oqkoxm8g/out.txt | |
| == 2026-03-14 18:48:28,913 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:28,913 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.0_skip-test_unbacked_reduction.patch | |
| == 2026-03-14 18:48:28,924 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:28,925 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/inductor/test_torchinductor_dynamic_shapes.py | |
| == 2026-03-14 18:48:28,925 easyblock.py:2923 INFO Applying patch PyTorch-2.9.0_skip-unexpected-success-in-test_fake_export.patch | |
| == 2026-03-14 18:48:28,938 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-_bsrby3k/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-_bsrby3k/out.txt | |
| == 2026-03-14 18:48:28,939 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:28,939 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.0_skip-unexpected-success-in-test_fake_export.patch | |
| == 2026-03-14 18:48:28,950 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:28,950 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/export/test_export_opinfo.py | |
| == 2026-03-14 18:48:28,950 easyblock.py:2923 INFO Applying patch PyTorch-2.9.0_update-exptected-output-for-z3-4.13.0.patch | |
| == 2026-03-14 18:48:28,962 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-14xepfin/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-14xepfin/out.txt | |
| == 2026-03-14 18:48:28,963 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:28,963 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.0_update-exptected-output-for-z3-4.13.0.patch | |
| == 2026-03-14 18:48:28,974 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:28,974 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/dynamo/test_exc.py | |
| == 2026-03-14 18:48:28,975 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_avoid-multiprocess-tests-hanging-forever.patch | |
| == 2026-03-14 18:48:28,986 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-e9g4ibye/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-e9g4ibye/out.txt | |
| == 2026-03-14 18:48:28,987 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:28,987 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_avoid-multiprocess-tests-hanging-forever.patch | |
| == 2026-03-14 18:48:28,998 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:28,999 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file torch/testing/_internal/common_distributed.py | |
| == 2026-03-14 18:48:28,999 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_avoid-using-wrong-libomp.patch | |
| == 2026-03-14 18:48:29,011 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-94_m7iry/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-94_m7iry/out.txt | |
| == 2026-03-14 18:48:29,012 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,012 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_avoid-using-wrong-libomp.patch | |
| == 2026-03-14 18:48:29,023 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,024 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file cmake/Modules/FindOpenMP.cmake | |
| == 2026-03-14 18:48:29,024 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_check-device-avail-test_schedule.patch | |
| == 2026-03-14 18:48:29,037 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-mouh6mxm/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-mouh6mxm/out.txt | |
| == 2026-03-14 18:48:29,038 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,038 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_check-device-avail-test_schedule.patch | |
| == 2026-03-14 18:48:29,049 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,049 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/distributed/pipelining/test_schedule.py | |
| == 2026-03-14 18:48:29,050 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_disable-slow-tests.patch | |
| == 2026-03-14 18:48:29,062 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-eqg5y3n7/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-eqg5y3n7/out.txt | |
| == 2026-03-14 18:48:29,063 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,063 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_disable-slow-tests.patch | |
| == 2026-03-14 18:48:29,075 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,076 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/run_test.py | |
| patching file tools/stats/import_test_stats.py | |
| patching file torch/testing/_internal/common_utils.py | |
| == 2026-03-14 18:48:29,076 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_dont-print-test-items.patch | |
| == 2026-03-14 18:48:29,088 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-tt1ehsfz/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-tt1ehsfz/out.txt | |
| == 2026-03-14 18:48:29,089 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,089 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_dont-print-test-items.patch | |
| == 2026-03-14 18:48:29,100 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,101 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/run_test.py | |
| == 2026-03-14 18:48:29,101 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_fix-hypothesis-deadline.patch | |
| == 2026-03-14 18:48:29,113 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-yz107dl3/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-yz107dl3/out.txt | |
| == 2026-03-14 18:48:29,114 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,114 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_fix-hypothesis-deadline.patch | |
| == 2026-03-14 18:48:29,125 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,125 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file torch/testing/_internal/hypothesis_utils.py | |
| == 2026-03-14 18:48:29,126 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_fix-iteration-in-fligh-reporter.patch | |
| == 2026-03-14 18:48:29,140 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-s9eg1hng/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-s9eg1hng/out.txt | |
| == 2026-03-14 18:48:29,141 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,141 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_fix-iteration-in-fligh-reporter.patch | |
| == 2026-03-14 18:48:29,155 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,155 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file tools/flight_recorder/components/types.py | |
| == 2026-03-14 18:48:29,155 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_fix-test_dist2-decorators.patch | |
| == 2026-03-14 18:48:29,169 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-ugs08wst/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-ugs08wst/out.txt | |
| == 2026-03-14 18:48:29,170 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,170 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_fix-test_dist2-decorators.patch | |
| == 2026-03-14 18:48:29,183 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,184 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/distributed/test_dist2.py | |
| patching file torch/testing/_internal/common_distributed.py | |
| == 2026-03-14 18:48:29,184 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_fix-TestExportOpInfoCPU-with-single-GPU.patch | |
| == 2026-03-14 18:48:29,198 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-_8aqnt61/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-_8aqnt61/out.txt | |
| == 2026-03-14 18:48:29,199 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,199 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_fix-TestExportOpInfoCPU-with-single-GPU.patch | |
| == 2026-03-14 18:48:29,210 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,211 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/export/test_export_opinfo.py | |
| == 2026-03-14 18:48:29,211 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_GCC14-ARM-workaround.patch | |
| == 2026-03-14 18:48:29,227 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-e8uxcl6e/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-e8uxcl6e/out.txt | |
| == 2026-03-14 18:48:29,228 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,228 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_GCC14-ARM-workaround.patch | |
| == 2026-03-14 18:48:29,239 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,239 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file aten/src/ATen/native/cpu/Unfold2d.cpp | |
| == 2026-03-14 18:48:29,239 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_ignore-warning-incompatible-pointer-types.patch | |
| == 2026-03-14 18:48:29,251 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-15j7k_e4/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-15j7k_e4/out.txt | |
| == 2026-03-14 18:48:29,252 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,252 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_ignore-warning-incompatible-pointer-types.patch | |
| == 2026-03-14 18:48:29,263 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,263 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file CMakeLists.txt | |
| == 2026-03-14 18:48:29,264 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_normalize_tree_output.patch | |
| == 2026-03-14 18:48:29,276 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-1az9p2i2/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-1az9p2i2/out.txt | |
| == 2026-03-14 18:48:29,277 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,277 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_normalize_tree_output.patch | |
| == 2026-03-14 18:48:29,287 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,288 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/profiler/test_profiler_tree.py | |
| == 2026-03-14 18:48:29,288 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_set-test-timeout.patch | |
| == 2026-03-14 18:48:29,301 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-2_ycvvmo/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-2_ycvvmo/out.txt | |
| == 2026-03-14 18:48:29,302 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,302 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_set-test-timeout.patch | |
| == 2026-03-14 18:48:29,313 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,313 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/run_test.py | |
| == 2026-03-14 18:48:29,313 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_skip-cutlass-addmm-test.patch | |
| == 2026-03-14 18:48:29,325 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-tdaao87e/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-tdaao87e/out.txt | |
| == 2026-03-14 18:48:29,326 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,326 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_skip-cutlass-addmm-test.patch | |
| == 2026-03-14 18:48:29,338 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,339 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/inductor/test_cutlass_backend.py | |
| == 2026-03-14 18:48:29,339 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_skip-flex-attention-test_block_mask_non_divisible.patch | |
| == 2026-03-14 18:48:29,351 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-893j7hge/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-893j7hge/out.txt | |
| == 2026-03-14 18:48:29,352 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,352 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_skip-flex-attention-test_block_mask_non_divisible.patch | |
| == 2026-03-14 18:48:29,364 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,365 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/inductor/test_flex_attention.py | |
| == 2026-03-14 18:48:29,365 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_skip-flex-attention-tests-on-unsupported-cpus.patch | |
| == 2026-03-14 18:48:29,378 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-rnkhbwv_/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-rnkhbwv_/out.txt | |
| == 2026-03-14 18:48:29,379 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,379 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_skip-flex-attention-tests-on-unsupported-cpus.patch | |
| == 2026-03-14 18:48:29,391 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,391 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/inductor/test_flex_attention.py | |
| patching file torch/testing/_internal/common_device_type.py | |
| == 2026-03-14 18:48:29,391 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_skip-RingFlexAttentionTest.patch | |
| == 2026-03-14 18:48:29,404 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-1exynqdz/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-1exynqdz/out.txt | |
| == 2026-03-14 18:48:29,405 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,405 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_skip-RingFlexAttentionTest.patch | |
| == 2026-03-14 18:48:29,415 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,416 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/distributed/tensor/test_attention.py | |
| == 2026-03-14 18:48:29,416 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_skip-test_dtensor_op_db_nn_functional_multi_head_attention_forward_cpu_float32.patch | |
| == 2026-03-14 18:48:29,428 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-sdf_2eph/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-sdf_2eph/out.txt | |
| == 2026-03-14 18:48:29,428 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,429 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_skip-test_dtensor_op_db_nn_functional_multi_head_attention_forward_cpu_float32.patch | |
| == 2026-03-14 18:48:29,439 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,440 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/distributed/tensor/test_dtensor_ops.py | |
| == 2026-03-14 18:48:29,440 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_skip-tests-requiring-SM90.patch | |
| == 2026-03-14 18:48:29,452 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-kkwvmwq1/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-kkwvmwq1/out.txt | |
| == 2026-03-14 18:48:29,453 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,453 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_skip-tests-requiring-SM90.patch | |
| == 2026-03-14 18:48:29,465 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,466 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/distributed/test_c10d_nccl.py | |
| Hunk #1 succeeded at 3334 (offset -16 lines). | |
| Hunk #2 succeeded at 3342 (offset -16 lines). | |
| patching file test/distributed/test_symmetric_memory.py | |
| == 2026-03-14 18:48:29,466 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_increase-tolerance-TestDecomp-matmul.patch | |
| == 2026-03-14 18:48:29,479 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-9swfi2xw/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-9swfi2xw/out.txt | |
| == 2026-03-14 18:48:29,480 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,480 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_increase-tolerance-TestDecomp-matmul.patch | |
| == 2026-03-14 18:48:29,494 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,495 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file torch/testing/_internal/common_methods_invocations.py | |
| == 2026-03-14 18:48:29,495 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_skip-cpu_repro-tests-failing-on-ARM.patch | |
| == 2026-03-14 18:48:29,508 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-eewy3bes/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-eewy3bes/out.txt | |
| == 2026-03-14 18:48:29,509 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,509 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_skip-cpu_repro-tests-failing-on-ARM.patch | |
| == 2026-03-14 18:48:29,520 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,520 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/inductor/test_cpu_repro.py | |
| == 2026-03-14 18:48:29,520 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_skip-svd-pca-lowrank-tests-on-cpu.patch | |
| == 2026-03-14 18:48:29,533 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-0g417ul3/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-0g417ul3/out.txt | |
| == 2026-03-14 18:48:29,534 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,534 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_skip-svd-pca-lowrank-tests-on-cpu.patch | |
| == 2026-03-14 18:48:29,547 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,548 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/test_linalg.py | |
| == 2026-03-14 18:48:29,548 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_skip-test_optree_graph_break_message.patch | |
| == 2026-03-14 18:48:29,561 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-97bcx27f/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-97bcx27f/out.txt | |
| == 2026-03-14 18:48:29,562 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,562 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_skip-test_optree_graph_break_message.patch | |
| == 2026-03-14 18:48:29,573 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,573 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/dynamo/test_error_messages.py | |
| == 2026-03-14 18:48:29,574 easyblock.py:2923 INFO Applying patch PyTorch-2.9.1_skip-tests-requiring-MKLDNN.patch | |
| == 2026-03-14 18:48:29,586 run.py:482 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command | |
| will be saved to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-dgrtbhbh/cmd.sh | |
| output will be logged to /tmp/easybuild-tmp/eb-zmxfgtci/run-shell-cmd-output/patch-dgrtbhbh/out.txt | |
| == 2026-03-14 18:48:29,587 run.py:508 INFO Path to bash that will be used to run shell commands: /usr/bin/bash | |
| == 2026-03-14 18:48:29,587 run.py:522 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| patch -p1 -i /tmp/easybuild-tmp/eb-zmxfgtci/files_pr24365/p/PyTorch/PyTorch-2.9.1_skip-tests-requiring-MKLDNN.patch | |
| == 2026-03-14 18:48:29,598 run.py:636 INFO 'patch ...' shell command completed successfully | |
| == 2026-03-14 18:48:29,599 run.py:638 INFO Output of 'patch ...' shell command (stdout + stderr): | |
| patching file test/inductor/test_cpu_select_algorithm.py | |
| == 2026-03-14 18:48:29,599 build_log.py:329 INFO ... (took 1 secs) | |
| == 2026-03-14 18:48:29,600 build_log.py:329 INFO preparing... | |
| == 2026-03-14 18:48:29,600 easyblock.py:4786 INFO Starting prepare step | |
| == 2026-03-14 18:48:29,600 easyconfig.py:1826 INFO Generating template values... | |
| == 2026-03-14 18:48:29,601 mpi.py:123 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI' | |
| == 2026-03-14 18:48:29,602 mpi.py:299 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'}) | |
| == 2026-03-14 18:48:29,602 easyconfig.py:1845 INFO Template values: arch='x86_64', bitbucket_account='pytorch', builddir='/dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0', cuda_cc_cmake='70;80', cuda_cc_nvhpc='cc70,cc80', cuda_cc_semicolon_sep='7.0;8.0', cuda_cc_space_sep='7.0 8.0', cuda_cc_space_sep_no_period='70 80', cuda_compute_capabilities='7.0,8.0', cuda_int_comma_sep='70,80', cuda_int_semicolon_sep='70;80', cuda_int_space_sep='70 80', cuda_sm_comma_sep='sm_70,sm_80', cuda_sm_space_sep='sm_70 sm_80', cudamajver='12', cudaminver='6', cudashortver='12.6', cudaver='12.6.0', github_account='pytorch', installdir='/data/horse/ws/s3248973-EasyBuild/easybuild-rome/software/PyTorch/2.9.1-foss-2024a-CUDA-12.6.0', module_name='PyTorch/2.9.1-foss-2024a-CUDA-12.6.0', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', parallel='42', pymajver='3', pyminver='12', pyshortver='3.12', pyver='3.12.3', rpath_enabled='false', software_commit='', start_dir='None', sysroot='', toolchain_name='foss', toolchain_version='2024a', version='2.9.1', version_major='2', version_major_minor='2.9', version_major_minor_patch='2.9.1', version_minor='9', version_minor_patch='9.1', version_patch='1', versionprefix='', versionsuffix='-CUDA-12.6.0' | |
| == 2026-03-14 18:48:29,602 easyblock.py:4797 INFO Running method prepare_step part of step prepare | |
| == 2026-03-14 18:48:29,603 run.py:522 INFO Running '/usr/share/lmod/lmod/libexec/lmod ...' command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| /usr/share/lmod/lmod/libexec/lmod python --terse --show-hidden avail | |
| == 2026-03-14 18:48:31,669 run.py:636 INFO '/usr/share/lmod/lmod/libexec/lmod ...' command completed successfully | |
| == 2026-03-14 18:48:31,684 modules.py:1054 INFO Checking whether CMake/3.29.3-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:31,684 modules.py:1059 INFO Module CMake/3.29.3-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,684 modules.py:1082 INFO Result for existence check of CMake/3.29.3-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:31,684 modules.py:1054 INFO Checking whether hypothesis/6.103.1-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:31,684 modules.py:1059 INFO Module hypothesis/6.103.1-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,684 modules.py:1082 INFO Result for existence check of hypothesis/6.103.1-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:31,684 modules.py:1054 INFO Checking whether setuptools/80.9.0-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:31,684 modules.py:1059 INFO Module setuptools/80.9.0-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,684 modules.py:1082 INFO Result for existence check of setuptools/80.9.0-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:31,684 modules.py:1054 INFO Checking whether parameterized/0.9.0-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:31,684 modules.py:1059 INFO Module parameterized/0.9.0-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,684 modules.py:1082 INFO Result for existence check of parameterized/0.9.0-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:31,685 modules.py:1054 INFO Checking whether pytest-flakefinder/1.1.0-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:31,685 modules.py:1059 INFO Module pytest-flakefinder/1.1.0-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,685 modules.py:1082 INFO Result for existence check of pytest-flakefinder/1.1.0-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:31,685 modules.py:1054 INFO Checking whether pytest-rerunfailures/15.0-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:31,685 modules.py:1059 INFO Module pytest-rerunfailures/15.0-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,685 modules.py:1082 INFO Result for existence check of pytest-rerunfailures/15.0-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:31,685 modules.py:1054 INFO Checking whether pytest-subtests/0.13.1-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:31,685 modules.py:1059 INFO Module pytest-subtests/0.13.1-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,685 modules.py:1082 INFO Result for existence check of pytest-subtests/0.13.1-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:31,685 modules.py:1054 INFO Checking whether tlparse/0.4.0-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:31,685 modules.py:1059 INFO Module tlparse/0.4.0-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,685 modules.py:1082 INFO Result for existence check of tlparse/0.4.0-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:31,686 modules.py:1054 INFO Checking whether optree/0.14.1-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:31,686 modules.py:1059 INFO Module optree/0.14.1-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,686 modules.py:1082 INFO Result for existence check of optree/0.14.1-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:31,686 modules.py:1054 INFO Checking whether unittest-xml-reporting/3.1.0-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:31,686 modules.py:1059 INFO Module unittest-xml-reporting/3.1.0-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,686 modules.py:1082 INFO Result for existence check of unittest-xml-reporting/3.1.0-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:31,686 modules.py:1054 INFO Checking whether CUDA/12.6.0 exists... | |
| == 2026-03-14 18:48:31,686 modules.py:1059 INFO Module CUDA/12.6.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,686 modules.py:1082 INFO Result for existence check of CUDA/12.6.0 module: True | |
| == 2026-03-14 18:48:31,686 modules.py:1054 INFO Checking whether NCCL/2.27.5-GCCcore-13.3.0-CUDA-12.6.0 exists... | |
| == 2026-03-14 18:48:31,686 modules.py:1059 INFO Module NCCL/2.27.5-GCCcore-13.3.0-CUDA-12.6.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:31,686 modules.py:1082 INFO Result for existence check of NCCL/2.27.5-GCCcore-13.3.0-CUDA-12.6.0 module: True | |
| == 2026-03-14 18:48:31,686 modules.py:1054 INFO Checking whether cuDNN/9.10.2.21-CUDA-12.6.0 exists... | |
| == 2026-03-14 18:48:31,687 modules.py:1061 INFO Module cuDNN/9.10.2.21-CUDA-12.6.0 not found in list of available modules, checking via 'module show'... | |
| == 2026-03-14 18:48:31,687 run.py:522 INFO Running '/usr/share/lmod/lmod/libexec/lmod ...' command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2024a-CUDA-12.6.0/pytorch-v2.9.1: | |
| /usr/share/lmod/lmod/libexec/lmod python show cuDNN/9.10.2.21-CUDA-12.6.0 | |
| == 2026-03-14 18:48:33,653 run.py:636 INFO '/usr/share/lmod/lmod/libexec/lmod ...' command completed successfully | |
| == 2026-03-14 18:48:33,654 modules.py:1075 INFO Module cuDNN/9.10.2.21-CUDA-12.6.0 not found via module avail/show, checking whether it is a wrapper | |
| == 2026-03-14 18:48:33,659 modules.py:1082 INFO Result for existence check of cuDNN/9.10.2.21-CUDA-12.6.0 module: False | |
| == 2026-03-14 18:48:33,659 modules.py:1054 INFO Checking whether magma/2.9.0-foss-2024a-CUDA-12.6.0 exists... | |
| == 2026-03-14 18:48:33,659 modules.py:1059 INFO Module magma/2.9.0-foss-2024a-CUDA-12.6.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,659 modules.py:1082 INFO Result for existence check of magma/2.9.0-foss-2024a-CUDA-12.6.0 module: True | |
| == 2026-03-14 18:48:33,660 modules.py:1054 INFO Checking whether cuSPARSELt/0.6.3.2-CUDA-12.6.0 exists... | |
| == 2026-03-14 18:48:33,660 modules.py:1059 INFO Module cuSPARSELt/0.6.3.2-CUDA-12.6.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,660 modules.py:1082 INFO Result for existence check of cuSPARSELt/0.6.3.2-CUDA-12.6.0 module: True | |
| == 2026-03-14 18:48:33,660 modules.py:1054 INFO Checking whether Triton/3.5.0-gfbf-2024a-CUDA-12.6.0 exists... | |
| == 2026-03-14 18:48:33,660 modules.py:1059 INFO Module Triton/3.5.0-gfbf-2024a-CUDA-12.6.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,660 modules.py:1082 INFO Result for existence check of Triton/3.5.0-gfbf-2024a-CUDA-12.6.0 module: True | |
| == 2026-03-14 18:48:33,660 modules.py:1054 INFO Checking whether Ninja/1.12.1-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,661 modules.py:1059 INFO Module Ninja/1.12.1-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,661 modules.py:1082 INFO Result for existence check of Ninja/1.12.1-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,661 modules.py:1054 INFO Checking whether Python/3.12.3-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,661 modules.py:1059 INFO Module Python/3.12.3-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,661 modules.py:1082 INFO Result for existence check of Python/3.12.3-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,661 modules.py:1054 INFO Checking whether Python-bundle-PyPI/2024.06-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,661 modules.py:1059 INFO Module Python-bundle-PyPI/2024.06-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,662 modules.py:1082 INFO Result for existence check of Python-bundle-PyPI/2024.06-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,662 modules.py:1054 INFO Checking whether expecttest/0.2.1-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,662 modules.py:1059 INFO Module expecttest/0.2.1-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,662 modules.py:1082 INFO Result for existence check of expecttest/0.2.1-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,662 modules.py:1054 INFO Checking whether GMP/6.3.0-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,662 modules.py:1059 INFO Module GMP/6.3.0-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,662 modules.py:1082 INFO Result for existence check of GMP/6.3.0-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,662 modules.py:1054 INFO Checking whether MPFR/4.2.1-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,662 modules.py:1059 INFO Module MPFR/4.2.1-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,663 modules.py:1082 INFO Result for existence check of MPFR/4.2.1-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,663 modules.py:1054 INFO Checking whether networkx/3.4.2-gfbf-2024a exists... | |
| == 2026-03-14 18:48:33,663 modules.py:1059 INFO Module networkx/3.4.2-gfbf-2024a exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,663 modules.py:1082 INFO Result for existence check of networkx/3.4.2-gfbf-2024a module: True | |
| == 2026-03-14 18:48:33,663 modules.py:1054 INFO Checking whether numactl/2.0.18-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,663 modules.py:1059 INFO Module numactl/2.0.18-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,663 modules.py:1082 INFO Result for existence check of numactl/2.0.18-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,663 modules.py:1054 INFO Checking whether Pillow/10.4.0-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,663 modules.py:1059 INFO Module Pillow/10.4.0-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,664 modules.py:1082 INFO Result for existence check of Pillow/10.4.0-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,664 modules.py:1054 INFO Checking whether protobuf-python/5.28.0-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,664 modules.py:1059 INFO Module protobuf-python/5.28.0-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,664 modules.py:1082 INFO Result for existence check of protobuf-python/5.28.0-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,664 modules.py:1054 INFO Checking whether protobuf/28.0-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,664 modules.py:1059 INFO Module protobuf/28.0-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,664 modules.py:1082 INFO Result for existence check of protobuf/28.0-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,664 modules.py:1054 INFO Checking whether pybind11/2.12.0-GCC-13.3.0 exists... | |
| == 2026-03-14 18:48:33,664 modules.py:1059 INFO Module pybind11/2.12.0-GCC-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,665 modules.py:1082 INFO Result for existence check of pybind11/2.12.0-GCC-13.3.0 module: True | |
| == 2026-03-14 18:48:33,665 modules.py:1054 INFO Checking whether PuLP/2.8.0-foss-2024a exists... | |
| == 2026-03-14 18:48:33,665 modules.py:1059 INFO Module PuLP/2.8.0-foss-2024a exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,665 modules.py:1082 INFO Result for existence check of PuLP/2.8.0-foss-2024a module: True | |
| == 2026-03-14 18:48:33,665 modules.py:1054 INFO Checking whether PyYAML/6.0.2-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,665 modules.py:1059 INFO Module PyYAML/6.0.2-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,665 modules.py:1082 INFO Result for existence check of PyYAML/6.0.2-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,665 modules.py:1054 INFO Checking whether pyzstd/0.16.2-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,665 modules.py:1059 INFO Module pyzstd/0.16.2-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,665 modules.py:1082 INFO Result for existence check of pyzstd/0.16.2-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,665 modules.py:1054 INFO Checking whether SciPy-bundle/2024.05-gfbf-2024a exists... | |
| == 2026-03-14 18:48:33,665 modules.py:1059 INFO Module SciPy-bundle/2024.05-gfbf-2024a exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,665 modules.py:1082 INFO Result for existence check of SciPy-bundle/2024.05-gfbf-2024a module: True | |
| == 2026-03-14 18:48:33,665 modules.py:1054 INFO Checking whether sympy/1.13.3-gfbf-2024a exists... | |
| == 2026-03-14 18:48:33,666 modules.py:1059 INFO Module sympy/1.13.3-gfbf-2024a exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,666 modules.py:1082 INFO Result for existence check of sympy/1.13.3-gfbf-2024a module: True | |
| == 2026-03-14 18:48:33,666 modules.py:1054 INFO Checking whether Z3/4.13.0-GCCcore-13.3.0 exists... | |
| == 2026-03-14 18:48:33,666 modules.py:1059 INFO Module Z3/4.13.0-GCCcore-13.3.0 exists (found in list of available modules) | |
| == 2026-03-14 18:48:33,666 modules.py:1082 INFO Result for existence check of Z3/4.13.0-GCCcore-13.3.0 module: True | |
| == 2026-03-14 18:48:33,897 build_log.py:233 ERROR EasyBuild encountered an error: Missing modules for dependencies (use --robot?): cuDNN/9.10.2.21-CUDA-12.6.0 (at easybuild/tools/toolchain/toolchain.py:605 in _check_dependencies) | |
| Callstack: | |
| easybuild/tools/toolchain/toolchain.py:605 in _check_dependencies | |
| easybuild/tools/toolchain/toolchain.py:905 in prepare | |
| easybuild/toolchains/mpi/openmpi.py:78 in prepare | |
| easybuild/framework/easyblock.py:3034 in prepare_step | |
| easybuild/easyblocks/generic/pythonpackage.py:863 in prepare_step | |
| easybuild/easyblocks/p/pytorch.py:380 in prepare_step | |
| easybuild/framework/easyblock.py:4813 in run_step | |
| easybuild/framework/easyblock.py:4972 in run_all_steps | |
| easybuild/framework/easyblock.py:5160 in build_and_install_one | |
| easybuild/main.py:180 in build_and_install_software | |
| easybuild/main.py:614 in process_eb_args | |
| easybuild/main.py:798 in main | |
| easybuild/main.py:847 in main_with_hooks | |
| easybuild/main.py:862 in <module> | |
| == 2026-03-14 18:48:33,898 build_log.py:329 INFO ... (took 4 secs) | |
| == 2026-03-14 18:48:33,898 filetools.py:2170 INFO Removing lock /data/horse/ws/s3248973-EasyBuild/easybuild-rome/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-rome_software_PyTorch_2.9.1-foss-2024a-CUDA-12.6.0.lock... | |
| == 2026-03-14 18:48:33,903 filetools.py:421 INFO Path /data/horse/ws/s3248973-EasyBuild/easybuild-rome/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-rome_software_PyTorch_2.9.1-foss-2024a-CUDA-12.6.0.lock successfully removed. | |
| == 2026-03-14 18:48:33,903 filetools.py:2174 INFO Lock removed: /data/horse/ws/s3248973-EasyBuild/easybuild-rome/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-rome_software_PyTorch_2.9.1-foss-2024a-CUDA-12.6.0.lock | |
| == 2026-03-14 18:48:33,904 easyblock.py:398 INFO Closing log for application name PyTorch version 2.9.1 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment