Skip to content

Adding catalyst - #51

Draft
jmorice91 wants to merge 10 commits into
pre_v5from
adding_catalyst
Draft

jmorice91 wants to merge 10 commits into
pre_v5from
adding_catalyst

Conversation

@jmorice91

Copy link
Copy Markdown
Contributor

Reopen the previous #36 due to a force push

Comment thread debuntu/all/Dockerfile
Comment on lines +194 to +195
#RUN git -C /root clone --recurse-submodules https://github.com/pdidev/pdi.git /root/pdi
RUN git -C /root clone -b catalyst-plugin --recurse-submodules https://github.com/francois-kitware/pdi /root/pdi

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this will have to be reverted before integration

@jbigot jbigot left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I proposed a few changes, just for the fun of it. But this is ready to ship! Great work and good news.

Comment thread debuntu/all/Dockerfile Resolved
Comment thread debuntu/all/Dockerfile
fi

git clone --branch v${CATALYST_VERSION}.0 \
--single-branch \

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
--single-branch \
--single-branch \
--depth 1 \
--recurse-submodules \
--shallow-submodules \

If that works, that prevents us from downloading the whole history for nothing and handles the submodules at the same time

Comment thread debuntu/all/Dockerfile Outdated
${HOME}/catalyst_clone/
cd ${HOME}/catalyst_clone/
mkdir build
git submodule update --depth=1 --init --recursive

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
git submodule update --depth=1 --init --recursive

If done above, this can go

Comment thread debuntu/all/Dockerfile Outdated
Comment on lines +124 to +129
cmake_installed=$(cmake --version | head -1 | cut -f3 -d" ")

mapfile -t sorted < <(printf "%s\n" "$cmake_installed" "$CMAKE_MINIMAL_VERSION_FOR_CATALYST" | sort -V)

cmake_exec=cmake
if [[ ${sorted[0]} == ${CMAKE_MINIMAL_VERSION_FOR_CATALYST} ]]; then

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
cmake_installed=$(cmake --version | head -1 | cut -f3 -d" ")
mapfile -t sorted < <(printf "%s\n" "$cmake_installed" "$CMAKE_MINIMAL_VERSION_FOR_CATALYST" | sort -V)
cmake_exec=cmake
if [[ ${sorted[0]} == ${CMAKE_MINIMAL_VERSION_FOR_CATALYST} ]]; then
rejected_cmake_version="$(printf "%s\n" "$(cmake --version | head -1 | cut -f3 -d" ")" "$CMAKE_MINIMAL_VERSION_FOR_CATALYST" | sort -V | head -1)"
if [ "${rejected_cmake_version}" = "${CMAKE_MINIMAL_VERSION_FOR_CATALYST}" ]; then

Comment thread debuntu/all/Dockerfile Outdated

# add Catalyst
COPY --from=builder_catalyst /opt/catalyst /opt/catalyst
ENV catalyst_DIR=/opt/catalyst/lib/cmake/catalyst-${CATALYST_VERSION}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
ENV catalyst_DIR=/opt/catalyst/lib/cmake/catalyst-${CATALYST_VERSION}
ENV catalyst_ROOT=/opt/catalyst/

Comment thread debuntu/all/Dockerfile Outdated
# force parallel HDF5 as first try (see #43)
ENV HDF5_DIR=/usr/lib/x86_64-linux-gnu/cmake/hdf5_${MPI}

# create user ci

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
# create user ci

Comment thread spack/3-baselibs/deps.sh
# libraries that depend on MPI & are required in all cases
BASE_MPILIBS="py-mpi4py veloc"
BASE_MPILIBS="py-mpi4py veloc libcatalyst+mpi+python"
BASE_MPILIBS_OLDSPACK="py-mpi4py veloc libcatalyst+mpi"

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
BASE_MPILIBS_OLDSPACK="py-mpi4py veloc libcatalyst+mpi"
#TODO: libcatalyst+python was introduced in spack 0.22, switch back to a single list when our minimum requirement goes at or above above that
BASE_MPILIBS_OLDSPACK="py-mpi4py veloc libcatalyst+mpi"

Comment thread spack/4-mini/Dockerfile
# Add our MPI of choice and base MPI-dependant libs to the environment and install it
RUN spack -e pdienv add -l mpi "${MPI}"
RUN . deps.sh && spack -e pdienv add -l mpilibs ${BASE_MPILIBS}
RUN <<EORUN

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
RUN <<EORUN
RUN <<EORUN
#TODO: introduced to handle a missing variant in spack<0.22, remove when our minimum requirement goes at or above above that

Comment thread spack/4-mini/Dockerfile
Comment on lines +18 to +26
if ( spack --version | grep -qs '^1\.' )
then
. deps.sh
spack -e pdienv add -l mpilibs ${BASE_MPILIBS}
else
. deps.sh
spack -e pdienv add -l mpilibs ${BASE_MPILIBS_OLDSPACK}
fi
EORUN

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if ( spack --version | grep -qs '^1\.' )
then
. deps.sh
spack -e pdienv add -l mpilibs ${BASE_MPILIBS}
else
. deps.sh
spack -e pdienv add -l mpilibs ${BASE_MPILIBS_OLDSPACK}
fi
EORUN
. deps.sh
if ( spack --version | grep -qs '^1\.' )
then
spack -e pdienv add -l mpilibs ${BASE_MPILIBS}
else
spack -e pdienv add -l mpilibs ${BASE_MPILIBS_OLDSPACK}
fi
EORUN

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants