Skip to content

Improve support for building on top of EESSI as a site, leveraging upstream software-layer-scripts#239

Draft
casparvl wants to merge 37 commits into
EESSI:mainfrom
SURF-hpcv:improve_building_on_top_support
Draft

Improve support for building on top of EESSI as a site, leveraging upstream software-layer-scripts#239
casparvl wants to merge 37 commits into
EESSI:mainfrom
SURF-hpcv:improve_building_on_top_support

Conversation

@casparvl
Copy link
Copy Markdown
Contributor

@casparvl casparvl commented May 27, 2026

This work was done mostly in preparation for the webinar on July 1st 2026 about building on top of EESSI. The goal here is to make the scripts in software-layer-scripts sufficiently configurable so that sites can use them 'as is' in order to build on top of EESSI, in a way that is as similar as EESSI as possible.

Note that dev.eessi.io practically does this, and that's why a lot of the conditional sections apply to both site builds and dev.eessi.io builds. Eventually, we should make sure that dev.eessi.io essentially just does a 'site build' on top of EESSI (#236). This PR doesn't do that yet, to not introduce more complexity in a single PR

Caspar van Leeuwen and others added 30 commits May 18, 2026 14:20
…d issues with the overlay filesystem not being able to write when doing mkdir calls
…SI env, as the EESSI_CVMFS_REPO doesn't seem to be set any earlier
…is is the custom variable we introduced for the sole purpose of forcing site installs for the build scripts. We introduced a separate var because we don't want to pick up on a EESSI_SITE_INSTALL that may or may be not be set in the general system environment
… to set the EESSI_SITE_SOFTWARE_PATH correctly
…kipped for site installations. Also, make sure that parts that should be installed in /cvmfs/software.eessi.io for site installations (such as the cuda libraries) are actually installed there - and not in the EESSI_SITE_SOFTWARE_PREFIX
…e installs that define EESSI_SITE_SOFTWARE_PREFIX
…o that when we're doing site builds, we are _also_ mounting software.eessi.io _and_ we are using the software.eessi.io compatibility layer
@casparvl casparvl marked this pull request as draft May 27, 2026 13:03
Comment thread EESSI-install-software.sh
# NOTE 3, we have to set a default for EASYBUILD_INSTALLPATH here in cases the
# EESSI-extend module itself needs to be installed.

# Should we introduce an if-clause here for site installs? Do we want site installs to be able to install their own EESSI-extend modules?
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That would be a can of worms, as their local one takes precedence

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They can always have a custom EESSI-extend, but shadowing doesn't feel like a good approach

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I felt the same, which is why I didn't enable that for site installs right now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants