Test check result#1

Open

poksumdo wants to merge 28 commits into

poksumdo:test_check_result

poksumdo commented Apr 9, 2023

PR to test if bot/check-result.sh script works.

truib added 24 commits

April 3, 2023 11:24


          added helper scripts and improved bot/build.sh

b8c1b8e

- scripts/utils.sh is borrowed from software-layer. it includes various functions
  to be used with other scripts in this repo.
- scripts/cfg_files.sh is borrowed from software-layer. it provides functions to
  read a file that contains information about a job.
- changes to bot/build.sh:
  - added header, author, license
  - added assumptions
  - added set -e
  - source the above helper scripts
  - read job.cfg file
  - set core settings if needed: HTTP_PROXY, HTTPS_PROXY, LOCAL_TMP, LOAD_MODULES
  - expand LOCAL_TMP into STORAGE
  - load modules
  - obtain cpu_target_arch from job.cfg setting
  - bump eessi_version to 2023.04
  - calling install_compatibility_layer.sh: remove fixed local container, add
    storage option


          updates to install_compatibility_layer.sh

d742027

- add arguments for resuming, retaining tmp and more verbose output
- extended and reformatted usage information
- source helper script scripts/utils.sh
- add support to resume a previous run given its temporary directory
- determine container runtime (singularity or apptainer)
- define env vars for both singularity and apptainer
- unset PKG_CONFIG_PATH before running ansible script
- only tar temporary directory if --retain-tmp option is given
- add message for how to resume a previous run


          add default version + create own /tmp + fix id for tgz

882e6b5


          use version and repository from job.cfg or default + some cleanup

0dfcf90


          bump version to 2023.04

73af988


          replace community.general.portage with calling emerge in shell

cfc0604


          add tasks to install and deselect build dependencies + use emerge to …

486257e

…remove them


          use emerge to install package set (don't rebuild though and only inst…

c4034a7

…all if list not empty)


          provide missing profile for arm64 + make sure bash is used for bootst…

…rapping tasks (because pipefail is needed)


          replacing community.general.portage with emerge (noreplace false is d…

1db0017

…efault)


          ensure ReFrame tests are working

f816a83

- added some debugging
- remove any existing virtualenv
- make sure ReFrame is installed
- left some more example debugging (could be cleaned up)


          attempt to fix Ansible lint issues

0a5f11c


          attempt to fix Ansible lint issues, part 2

a756141


          attempt to fix Ansible lint issues, part 3

3173d4c


          attempt to fix Ansible lint issues, part 4

ae8ea3d


          attempt to fix Ansible lint issues, part 5

2648ddf


          fix typo

f92e956


          add arg to retain eessi_tmpdir + improved messages

6b2cf67


          add missing APPTAINER_BIND

61997e1


          a few fixes + removing commented out code

016509a


          reverted removal of community.general.portage

7bfa90d

added

```ansible
  vars:
   ansible_python_interpreter: "{{ gentoo_prefix_path }}/usr/bin/python3"
```

to all tasks using communit.general.portage


          test commit from March 13

8f5f5fa


          initial version of script to check result of building compat layer

1cc55a0


          generate output for successful job

937eb6d

Author

poksumdo commented Apr 9, 2023

bot: showconfig

Owner

trz42 commented Apr 9, 2023 •

edited by eessi-bot-devel-trz42 Bot

Loading

bot: showconfig

received bot command showconfig from trz42 (expanded command format: showconfig )
handling showconfig resulted in: added comment https://api.github.com/repos/trz42/compatibility-layer/issues/1 to show configuration

eessi-bot-devel-trz42 Bot commented Apr 9, 2023

Instance CitC-commander is configured to build:

arch x86_64/generic for repo nessi.no-2022.11
arch x86_64/generic for repo nessi.no-2023.04
arch x86_64/generic for repo eessi-2023.04
arch x86_64/amd/zen2 for repo nessi.no-2022.11
arch x86_64/intel/skylake_avx512 for repo nessi.no-2022.11
arch x86_64/intel/cascadelake for repo nessi.no-2022.11
arch aarch64/generic for repo nessi.no-2022.11
arch aarch64/generic for repo nessi.no-2023.04
arch aarch64/generic for repo eessi-2023.04

Owner

trz42 commented Apr 9, 2023 •

edited by eessi-bot-devel-trz42 Bot

Loading

bot: build a:aarch64 r:eessi-2023.04

received bot command build a:aarch64 r:eessi-2023.04 from trz42 (expanded command format: build architecture:aarch64 repository:eessi-2023.04)
handling build resulted in: created jobs: 4538

eessi-bot-devel-trz42 Bot commented Apr 9, 2023 •

edited

Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4538

date	job status	comment
Apr 09 10:19:55 PM UTC 2023	submitted	job id `4538` awaits release by job manager
Apr 09 10:22:12 PM UTC 2023	released	job awaits launch by Slurm scheduler

Owner

trz42 commented Apr 9, 2023 •

edited by eessi-bot-devel-trz42 Bot

Loading

bot: build a:aarch64 r:eessi-2023.04

received bot command build a:aarch64 r:eessi-2023.04 from trz42 (expanded command format: build architecture:aarch64 repository:eessi-2023.04)
handling build resulted in: created jobs: 4539

eessi-bot-devel-trz42 Bot commented Apr 9, 2023 •

edited

Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4539

date	job status	comment
Apr 09 10:33:41 PM UTC 2023	submitted	job id `4539` awaits release by job manager
Apr 09 10:34:10 PM UTC 2023	released	job awaits launch by Slurm scheduler

Owner

trz42 commented Apr 9, 2023 •

edited by eessi-bot-devel-trz42 Bot

Loading

bot: build a:aarch64 r:eessi-2023.04

received bot command build a:aarch64 r:eessi-2023.04 from trz42 (expanded command format: build architecture:aarch64 repository:eessi-2023.04)
handling build resulted in: created jobs: 4540

eessi-bot-devel-trz42 Bot commented Apr 9, 2023 •

edited by trz42

Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4540

date	job status	comment
Apr 09 11:06:09 PM UTC 2023	submitted	job id `4540` awaits release by job manager
Apr 09 11:06:38 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 09 11:09:40 PM UTC 2023	finished	😁 SUCCESS click triangle for details Details: no task failed found tarball(s) Artefacts: eessi-2023.04-compat-linux-aarch64-1681081752.tar.gz

Owner

trz42 commented Apr 9, 2023 •

edited by eessi-bot-devel-trz42 Bot

Loading

bot: build a:aarch64 r:eessi-2023.04

received bot command build a:aarch64 r:eessi-2023.04 from trz42 (expanded command format: build architecture:aarch64 repository:eessi-2023.04)
handling build resulted in: created jobs: 4541

eessi-bot-devel-trz42 Bot commented Apr 9, 2023 •

edited

Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4541

date	job status	comment
Apr 09 11:16:44 PM UTC 2023	submitted	job id `4541` awaits release by job manager
Apr 09 11:17:19 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 09 11:18:20 PM UTC 2023	finished	😁 SUCCESS click triangle for details Details: no task failed found tarball(s) Artefacts: eessi-2023.04-compat-linux-aarch64-1681082238.tar.gz


          make check fail

49d2a4a

Owner

trz42 commented Apr 9, 2023 •

edited by eessi-bot-devel-trz42 Bot

Loading

bot: build a:aarch64 r:eessi-2023.04

received bot command build a:aarch64 r:eessi-2023.04 from trz42 (expanded command format: build architecture:aarch64 repository:eessi-2023.04)
handling build resulted in: created jobs: 4542

eessi-bot-devel-trz42 Bot commented Apr 9, 2023 •

edited

Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4542

date	job status	comment
Apr 09 11:25:19 PM UTC 2023	submitted	job id `4542` awaits release by job manager
Apr 09 11:25:24 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 09 11:26:25 PM UTC 2023	finished	😢 FAILURE click triangle for details Details: some task(s) failed no tarball found Artefacts:


          simulate different scenarios

33b6548

Owner

trz42 commented Apr 9, 2023 •

edited by eessi-bot-devel-trz42 Bot

Loading

bot: build r:nessi.no-2023.04 a:aarch64
bot: build r:nessi.no-2023.04 a:x86_64
bot: build r:eessi a:aarch64
bot: build r:eessi-2023.04 a:x86_64

received bot command build r:nessi.no-2023.04 a:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)
received bot command build r:nessi.no-2023.04 a:x86_64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:x86_64)
received bot command build r:eessi a:aarch64 from trz42 (expanded command format: build repository:eessi architecture:aarch64)
received bot command build r:eessi-2023.04 a:x86_64 from trz42 (expanded command format: build repository:eessi-2023.04 architecture:x86_64)
handling build resulted in: created jobs: 4543
handling build resulted in: created jobs: 4544
handling build resulted in: created jobs: 4545
handling build resulted in: created jobs: 4546

eessi-bot-devel-trz42 Bot commented Apr 9, 2023 •

edited

Loading

New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4543

date	job status	comment
Apr 09 11:37:48 PM UTC 2023	submitted	job id `4543` awaits release by job manager
Apr 09 11:38:39 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 09 11:41:42 PM UTC 2023	finished	😢 FAILURE click triangle for details Details: some task(s) failed no tarball found Artefacts:

eessi-bot-devel-trz42 Bot commented Apr 9, 2023 •

edited

Loading

New job on instance CitC-commander for architecture x86_64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4544

date	job status	comment
Apr 09 11:38:00 PM UTC 2023	submitted	job id `4544` awaits release by job manager
Apr 09 11:38:36 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 09 11:42:46 PM UTC 2023	finished	😢 FAILURE click triangle for details Details: some task(s) failed no tarball found Artefacts:

eessi-bot-devel-trz42 Bot commented Apr 9, 2023 •

edited

Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4545

date	job status	comment
Apr 09 11:38:12 PM UTC 2023	submitted	job id `4545` awaits release by job manager
Apr 09 11:38:33 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 09 11:41:40 PM UTC 2023	finished	😢 FAILURE click triangle for details Details: some task(s) failed found tarball(s) Artefacts: eessi-2023.04-compat-linux-aarch64-1681083674.tar.gz

eessi-bot-devel-trz42 Bot commented Apr 9, 2023 •

edited

Loading

New job on instance CitC-commander for architecture x86_64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4546

date	job status	comment
Apr 09 11:38:23 PM UTC 2023	submitted	job id `4546` awaits release by job manager
Apr 09 11:38:31 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 09 11:42:44 PM UTC 2023	finished	😁 SUCCESS click triangle for details Details: no task failed found tarball(s) Artefacts: eessi-2023.04-compat-linux-x86_64-1681083704.tar.gz

Owner

trz42 commented Apr 10, 2023 •

edited by eessi-bot-devel-trz42 Bot

Loading

bot: build r:nessi.no-2023.04 a:aarch64

received bot command build r:nessi.no-2023.04 a:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)
handling build resulted in: created jobs: 4547

eessi-bot-devel-trz42 Bot commented Apr 10, 2023 •

edited by trz42

Loading

New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4547

date	job status	comment
Apr 10 02:20:28 PM UTC 2023	submitted	job id `4547` awaits release by job manager
Apr 10 02:21:07 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 10 02:24:08 PM UTC 2023	finished	🤷 UNKNOWN click triangle for details Details: Did not find bot/check-result.sh script in '/mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/event_ceebde90-d7aa-11ed-80d8-6976250524d7/run_000/linux_aarch64_generic/nessi.no-2023.04'. Check job manually. Artefacts: no artefacts reported

Owner

trz42 commented Apr 10, 2023 •

edited by eessi-bot-devel-trz42 Bot

Loading

bot: build r:nessi.no-2023.04 a:aarch64

received bot command build r:nessi.no-2023.04 a:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)
handling build resulted in: created jobs: 4548

eessi-bot-devel-trz42 Bot commented Apr 10, 2023 •

edited

Loading

New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4548

date	job status	comment
Apr 10 02:37:22 PM UTC 2023	submitted	job id `4548` awaits release by job manager
Apr 10 02:37:34 PM UTC 2023	released	job awaits launch by Slurm scheduler

Owner

trz42 commented Apr 10, 2023 •

edited by eessi-bot-devel-trz42 Bot

Loading

bot: build r:nessi.no-2023.04 a:aarch64

received bot command build r:nessi.no-2023.04 a:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)
handling build resulted in: created jobs: 4549

eessi-bot-devel-trz42 Bot commented Apr 10, 2023 •

edited

Loading

New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4549

date	job status	comment
Apr 10 02:51:46 PM UTC 2023	submitted	job id `4549` awaits release by job manager
Apr 10 02:52:39 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 10 02:55:41 PM UTC 2023	finished	🤷 UNKNOWN (click triangle for detailed information) Details: Did not find `bot/check-result.sh` script in job's work directory. Check job manually. Artefacts: no artefacts were found/reported

truib added 2 commits

April 10, 2023 23:00


          sync gentoo commit section

98a842e


          remove obsolete commented out code

92f4e46

poksumdo pushed a commit to poksumdo/compatibility-layer that referenced this pull request


          Merge pull request trz42#1 from trz42/eessi-2022.10

3ec3042

Initial package set for EESSI 2022.10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet